[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:16:19.474997 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:34561
I20260709 13:16:19.476644 14501 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:16:19.477768 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:19.495751 14510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:19.495817 14508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:19.495848 14507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:20.704576 14509 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 13:16:20.704735 14501 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 13:16:20.709327 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:20.709580 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:20.709860 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602980709828 us; error 0 us; skew 500 ppm
I20260709 13:16:20.710733 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:20.716338 14501 webserver.cc:533] Webserver started at http://127.14.41.126:39391/ using document root <none> and password file <none>
I20260709 13:16:20.717279 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:20.717522 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:20.718003 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:20.723803 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "1aec0c5dfa4049ef9a416622b3ef0cae"
format_stamp: "Formatted at 2026-07-09 13:16:20 on dist-test-slave-56lb"
I20260709 13:16:20.731755 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:20.737185 14516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:20.738517 14501 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:16:20.738943 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "1aec0c5dfa4049ef9a416622b3ef0cae"
format_stamp: "Formatted at 2026-07-09 13:16:20 on dist-test-slave-56lb"
I20260709 13:16:20.739296 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:20.795226 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:20.796887 14501 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:16:20.797405 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:20.871912 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:34561
I20260709 13:16:20.871996 14567 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:34561 every 8 connection(s)
I20260709 13:16:20.880290 14568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:20.902761 14568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae: Bootstrap starting.
I20260709 13:16:20.909073 14568 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:20.911127 14568 log.cc:826] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae: Log is configured to *not* fsync() on all Append() calls
I20260709 13:16:20.916034 14568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae: No bootstrap required, opened a new log
I20260709 13:16:20.937105 14568 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" member_type: VOTER }
I20260709 13:16:20.937704 14568 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:20.937924 14568 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aec0c5dfa4049ef9a416622b3ef0cae, State: Initialized, Role: FOLLOWER
I20260709 13:16:20.938898 14568 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" member_type: VOTER }
I20260709 13:16:20.939421 14568 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:20.939669 14568 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:20.939965 14568 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:20.944231 14568 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" member_type: VOTER }
I20260709 13:16:20.945065 14568 leader_election.cc:304] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1aec0c5dfa4049ef9a416622b3ef0cae; no voters: 
I20260709 13:16:20.946802 14568 leader_election.cc:290] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:20.947134 14571 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:20.949676 14571 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 1 LEADER]: Becoming Leader. State: Replica: 1aec0c5dfa4049ef9a416622b3ef0cae, State: Running, Role: LEADER
I20260709 13:16:20.950763 14571 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" member_type: VOTER }
I20260709 13:16:20.951923 14568 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:20.962659 14572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" member_type: VOTER } }
I20260709 13:16:20.962862 14573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aec0c5dfa4049ef9a416622b3ef0cae. Latest consensus state: current_term: 1 leader_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1aec0c5dfa4049ef9a416622b3ef0cae" member_type: VOTER } }
I20260709 13:16:20.963815 14573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:20.965281 14572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:20.968099 14581 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:20.981168 14581 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:20.983687 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:20.998533 14581 catalog_manager.cc:1383] Generated new cluster ID: 1ddecae2ab3648caa5e6936bb88a58bb
I20260709 13:16:20.998842 14581 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:21.018334 14581 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:21.019925 14581 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:21.034341 14581 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae: Generated new TSK 0
I20260709 13:16:21.035393 14581 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:21.050761 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:21.061379 14591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:21.060186 14590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:21.065460 14501 server_base.cc:1061] running on GCE node
W20260709 13:16:21.065780 14593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:21.066753 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:21.066992 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:21.067226 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602981067169 us; error 0 us; skew 500 ppm
I20260709 13:16:21.067932 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:21.072273 14501 webserver.cc:533] Webserver started at http://127.14.41.65:42849/ using document root <none> and password file <none>
I20260709 13:16:21.073081 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:21.073355 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:21.073720 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:21.075314 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
format_stamp: "Formatted at 2026-07-09 13:16:21 on dist-test-slave-56lb"
I20260709 13:16:21.082726 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:16:21.088274 14598 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.089284 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:16:21.089696 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
format_stamp: "Formatted at 2026-07-09 13:16:21 on dist-test-slave-56lb"
I20260709 13:16:21.090090 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:21.119237 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:21.121297 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:21.124338 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:21.130138 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:21.130478 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.130811 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:21.131043 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.225639 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:46609
I20260709 13:16:21.225684 14660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:46609 every 8 connection(s)
I20260709 13:16:21.234012 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:21.248525 14665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:21.249393 14666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:21.258714 14501 server_base.cc:1061] running on GCE node
W20260709 13:16:21.258625 14668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:21.260365 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:21.260694 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:21.260902 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602981260887 us; error 0 us; skew 500 ppm
I20260709 13:16:21.261680 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:21.266276 14661 heartbeater.cc:344] Connected to a master server at 127.14.41.126:34561
I20260709 13:16:21.266243 14501 webserver.cc:533] Webserver started at http://127.14.41.66:42931/ using document root <none> and password file <none>
I20260709 13:16:21.266865 14661 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:21.267174 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:21.267446 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:21.267793 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:21.267990 14661 heartbeater.cc:507] Master 127.14.41.126:34561 requested a full tablet report, sending...
I20260709 13:16:21.269410 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "0d7c2858f55c4bb888941715bdb89bf6"
format_stamp: "Formatted at 2026-07-09 13:16:21 on dist-test-slave-56lb"
I20260709 13:16:21.271119 14533 ts_manager.cc:194] Registered new tserver with Master: fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609)
I20260709 13:16:21.273487 14533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47734
I20260709 13:16:21.276808 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:21.282395 14673 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.283313 14501 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:21.283668 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "0d7c2858f55c4bb888941715bdb89bf6"
format_stamp: "Formatted at 2026-07-09 13:16:21 on dist-test-slave-56lb"
I20260709 13:16:21.284039 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:21.300379 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:21.302115 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:21.304843 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:21.308655 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:21.308945 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.309237 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:21.309446 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.399605 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:39553
I20260709 13:16:21.399674 14735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:39553 every 8 connection(s)
I20260709 13:16:21.406824 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:21.416160 14739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:21.419044 14740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:21.424517 14736 heartbeater.cc:344] Connected to a master server at 127.14.41.126:34561
I20260709 13:16:21.425155 14736 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:21.426512 14736 heartbeater.cc:507] Master 127.14.41.126:34561 requested a full tablet report, sending...
I20260709 13:16:21.429893 14533 ts_manager.cc:194] Registered new tserver with Master: 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:21.432304 14533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47738
W20260709 13:16:21.439465 14742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:21.440407 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:21.441504 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:21.441766 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:21.441977 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602981441930 us; error 0 us; skew 500 ppm
I20260709 13:16:21.442624 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:21.445755 14501 webserver.cc:533] Webserver started at http://127.14.41.67:33365/ using document root <none> and password file <none>
I20260709 13:16:21.446306 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:21.446525 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:21.446846 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:21.448077 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "90623b8327d2492eacfa011b104c2eb2"
format_stamp: "Formatted at 2026-07-09 13:16:21 on dist-test-slave-56lb"
I20260709 13:16:21.453498 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:21.457480 14747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.458547 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:16:21.458896 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "90623b8327d2492eacfa011b104c2eb2"
format_stamp: "Formatted at 2026-07-09 13:16:21 on dist-test-slave-56lb"
I20260709 13:16:21.459297 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:21.483634 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:21.485319 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:21.487226 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:21.489775 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:21.489981 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.490312 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:21.490491 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:21.592577 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:33381
I20260709 13:16:21.593281 14809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:33381 every 8 connection(s)
I20260709 13:16:21.611824 14810 heartbeater.cc:344] Connected to a master server at 127.14.41.126:34561
I20260709 13:16:21.612284 14810 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:21.613252 14810 heartbeater.cc:507] Master 127.14.41.126:34561 requested a full tablet report, sending...
I20260709 13:16:21.615720 14533 ts_manager.cc:194] Registered new tserver with Master: 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:21.616758 14501 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015897919s
I20260709 13:16:21.617570 14533 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47744
I20260709 13:16:21.672129 14533 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47756:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:21.676222 14533 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:21.775967 14626 tablet_service.cc:1511] Processing CreateTablet for tablet 0b979bcc7ccc4fc99d3104f7a7ad6b24 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:21.777815 14626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b979bcc7ccc4fc99d3104f7a7ad6b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.779597 14625 tablet_service.cc:1511] Processing CreateTablet for tablet 365fda54d9354130af1649cad7b26397 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:21.783047 14625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365fda54d9354130af1649cad7b26397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.786058 14624 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba4e82c54f948b0a98479cbb7ab44a9 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:21.787627 14624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba4e82c54f948b0a98479cbb7ab44a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.791631 14623 tablet_service.cc:1511] Processing CreateTablet for tablet d5a170da421046f0b3e0f2b4c3823aa6 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:21.793162 14623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a170da421046f0b3e0f2b4c3823aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.799708 14622 tablet_service.cc:1511] Processing CreateTablet for tablet 38540bf90c9a40f9a59fb00b24079447 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:21.801395 14622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38540bf90c9a40f9a59fb00b24079447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.804803 14621 tablet_service.cc:1511] Processing CreateTablet for tablet 0da2bfe43b654b12ac0c16a7a9e680aa (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:21.806284 14621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da2bfe43b654b12ac0c16a7a9e680aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.810550 14620 tablet_service.cc:1511] Processing CreateTablet for tablet 18481a30c7794345b086f3f2a95c7dce (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:21.812002 14620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18481a30c7794345b086f3f2a95c7dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.814800 14698 tablet_service.cc:1511] Processing CreateTablet for tablet d5a170da421046f0b3e0f2b4c3823aa6 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:21.816303 14698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a170da421046f0b3e0f2b4c3823aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.823314 14701 tablet_service.cc:1511] Processing CreateTablet for tablet 0b979bcc7ccc4fc99d3104f7a7ad6b24 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:21.825498 14701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b979bcc7ccc4fc99d3104f7a7ad6b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.817219 14699 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba4e82c54f948b0a98479cbb7ab44a9 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:21.833781 14697 tablet_service.cc:1511] Processing CreateTablet for tablet 38540bf90c9a40f9a59fb00b24079447 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:21.838202 14828 tablet_bootstrap.cc:492] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:21.831799 14619 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2f562011642a3ae5c4a0f868fc231 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:21.845359 14700 tablet_service.cc:1511] Processing CreateTablet for tablet 365fda54d9354130af1649cad7b26397 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:21.847771 14619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2f562011642a3ae5c4a0f868fc231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.847760 14699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba4e82c54f948b0a98479cbb7ab44a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.849247 14696 tablet_service.cc:1511] Processing CreateTablet for tablet 0da2bfe43b654b12ac0c16a7a9e680aa (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:21.846047 14695 tablet_service.cc:1511] Processing CreateTablet for tablet 18481a30c7794345b086f3f2a95c7dce (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:21.855109 14697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38540bf90c9a40f9a59fb00b24079447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.855868 14694 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2f562011642a3ae5c4a0f868fc231 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:21.862329 14695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18481a30c7794345b086f3f2a95c7dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.863526 14775 tablet_service.cc:1511] Processing CreateTablet for tablet 0b979bcc7ccc4fc99d3104f7a7ad6b24 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:16:21.880805 14694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2f562011642a3ae5c4a0f868fc231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.884773 14769 tablet_service.cc:1511] Processing CreateTablet for tablet 18481a30c7794345b086f3f2a95c7dce (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:16:21.888497 14775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b979bcc7ccc4fc99d3104f7a7ad6b24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.876699 14773 tablet_service.cc:1511] Processing CreateTablet for tablet 7ba4e82c54f948b0a98479cbb7ab44a9 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:16:21.891741 14769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18481a30c7794345b086f3f2a95c7dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.888677 14774 tablet_service.cc:1511] Processing CreateTablet for tablet 365fda54d9354130af1649cad7b26397 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:16:21.893400 14770 tablet_service.cc:1511] Processing CreateTablet for tablet 0da2bfe43b654b12ac0c16a7a9e680aa (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:16:21.896278 14626 tablet_service.cc:1511] Processing CreateTablet for tablet 02975c85bcfd4326924f80cd0a816669 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:21.888584 14772 tablet_service.cc:1511] Processing CreateTablet for tablet d5a170da421046f0b3e0f2b4c3823aa6 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:16:21.906314 14768 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2f562011642a3ae5c4a0f868fc231 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:16:21.882095 14771 tablet_service.cc:1511] Processing CreateTablet for tablet 38540bf90c9a40f9a59fb00b24079447 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:16:21.908501 14626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02975c85bcfd4326924f80cd0a816669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.916739 14773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ba4e82c54f948b0a98479cbb7ab44a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.920543 14774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365fda54d9354130af1649cad7b26397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.916441 14700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 365fda54d9354130af1649cad7b26397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.923862 14770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da2bfe43b654b12ac0c16a7a9e680aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.924674 14768 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2f562011642a3ae5c4a0f868fc231. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.925967 14696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da2bfe43b654b12ac0c16a7a9e680aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.939234 14772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5a170da421046f0b3e0f2b4c3823aa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.940871 14771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38540bf90c9a40f9a59fb00b24079447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:21.946048 14693 tablet_service.cc:1511] Processing CreateTablet for tablet 02975c85bcfd4326924f80cd0a816669 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:21.947954 14693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02975c85bcfd4326924f80cd0a816669. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:21.987406 14580 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:22.005769 14767 tablet_service.cc:1511] Processing CreateTablet for tablet 02975c85bcfd4326924f80cd0a816669 (DEFAULT_TABLE table=test-workload [id=c63f00f3fd8b42d78e71187a9bca8164]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:16:22.007846 14767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02975c85bcfd4326924f80cd0a816669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:22.070835 14829 tablet_bootstrap.cc:492] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.080282 14828 tablet_bootstrap.cc:654] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.081360 14830 tablet_bootstrap.cc:492] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.120746 14828 tablet_bootstrap.cc:492] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.120867 14829 tablet_bootstrap.cc:654] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.121348 14828 ts_tablet_manager.cc:1403] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.294s	user 0.021s	sys 0.003s
I20260709 13:16:22.121100 14830 tablet_bootstrap.cc:654] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.131295 14828 raft_consensus.cc:359] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.132297 14828 raft_consensus.cc:385] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.132609 14828 raft_consensus.cc:740] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.133266 14828 consensus_queue.cc:260] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.133723 14829 tablet_bootstrap.cc:492] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.134192 14829 ts_tablet_manager.cc:1403] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.010s
I20260709 13:16:22.136489 14661 heartbeater.cc:499] Master 127.14.41.126:34561 was elected leader, sending a full tablet report...
I20260709 13:16:22.136965 14828 ts_tablet_manager.cc:1434] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:16:22.137246 14829 raft_consensus.cc:359] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.137996 14829 raft_consensus.cc:385] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.138279 14829 raft_consensus.cc:740] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.138427 14828 tablet_bootstrap.cc:492] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.139038 14829 consensus_queue.cc:260] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.148164 14828 tablet_bootstrap.cc:654] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.148310 14829 ts_tablet_manager.cc:1434] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.014s
I20260709 13:16:22.149086 14736 heartbeater.cc:499] Master 127.14.41.126:34561 was elected leader, sending a full tablet report...
I20260709 13:16:22.152779 14830 tablet_bootstrap.cc:492] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.153239 14830 ts_tablet_manager.cc:1403] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.012s
I20260709 13:16:22.156399 14830 raft_consensus.cc:359] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.157266 14830 raft_consensus.cc:385] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:22.158059 14737 tablet.cc:2406] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:22.158824 14829 tablet_bootstrap.cc:492] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.157581 14830 raft_consensus.cc:740] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.159974 14830 consensus_queue.cc:260] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.163614 14828 tablet_bootstrap.cc:492] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.164178 14828 ts_tablet_manager.cc:1403] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.002s
I20260709 13:16:22.168792 14828 raft_consensus.cc:359] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.170655 14828 raft_consensus.cc:385] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.171496 14828 raft_consensus.cc:740] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.171929 14829 tablet_bootstrap.cc:654] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.173305 14810 heartbeater.cc:499] Master 127.14.41.126:34561 was elected leader, sending a full tablet report...
I20260709 13:16:22.172804 14828 consensus_queue.cc:260] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.185499 14829 tablet_bootstrap.cc:492] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.186105 14829 ts_tablet_manager.cc:1403] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.010s
I20260709 13:16:22.194026 14830 ts_tablet_manager.cc:1434] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.009s
I20260709 13:16:22.195168 14830 tablet_bootstrap.cc:492] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.196421 14829 raft_consensus.cc:359] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.197299 14829 raft_consensus.cc:385] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.197613 14829 raft_consensus.cc:740] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.197841 14828 ts_tablet_manager.cc:1434] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.033s	user 0.000s	sys 0.009s
I20260709 13:16:22.198921 14828 tablet_bootstrap.cc:492] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.206300 14829 consensus_queue.cc:260] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.210892 14830 tablet_bootstrap.cc:654] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.210995 14829 ts_tablet_manager.cc:1434] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:16:22.211973 14829 tablet_bootstrap.cc:492] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.216951 14828 tablet_bootstrap.cc:654] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.218627 14829 tablet_bootstrap.cc:654] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.225376 14830 tablet_bootstrap.cc:492] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.225899 14830 ts_tablet_manager.cc:1403] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.001s
I20260709 13:16:22.228804 14830 raft_consensus.cc:359] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.229547 14830 raft_consensus.cc:385] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.229846 14830 raft_consensus.cc:740] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.230546 14830 consensus_queue.cc:260] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.233011 14830 ts_tablet_manager.cc:1434] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:16:22.234984 14830 tablet_bootstrap.cc:492] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.242514 14830 tablet_bootstrap.cc:654] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.248960 14828 tablet_bootstrap.cc:492] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.249809 14828 ts_tablet_manager.cc:1403] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 13:16:22.254007 14834 raft_consensus.cc:493] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.254578 14834 raft_consensus.cc:515] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.255373 14828 raft_consensus.cc:359] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.256139 14828 raft_consensus.cc:385] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.256341 14829 tablet_bootstrap.cc:492] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.256464 14828 raft_consensus.cc:740] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.257077 14829 ts_tablet_manager.cc:1403] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.045s	user 0.030s	sys 0.014s
I20260709 13:16:22.257608 14834 leader_election.cc:290] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.263947 14828 consensus_queue.cc:260] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.266640 14829 raft_consensus.cc:359] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.267529 14829 raft_consensus.cc:385] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.267884 14829 raft_consensus.cc:740] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.268067 14830 tablet_bootstrap.cc:492] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.268621 14830 ts_tablet_manager.cc:1403] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.013s
I20260709 13:16:22.268766 14829 consensus_queue.cc:260] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.272771 14829 ts_tablet_manager.cc:1434] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:16:22.273058 14830 raft_consensus.cc:359] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.276670 14834 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.278086 14834 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.280216 14834 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.276365 14828 ts_tablet_manager.cc:1434] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:16:22.280799 14830 raft_consensus.cc:385] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.281188 14830 raft_consensus.cc:740] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.281512 14828 tablet_bootstrap.cc:492] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.282104 14830 consensus_queue.cc:260] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.284739 14830 ts_tablet_manager.cc:1434] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:16:22.285882 14830 tablet_bootstrap.cc:492] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.286087 14829 tablet_bootstrap.cc:492] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.292958 14829 tablet_bootstrap.cc:654] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.293080 14830 tablet_bootstrap.cc:654] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.301385 14828 tablet_bootstrap.cc:654] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.305217 14830 tablet_bootstrap.cc:492] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.305794 14830 ts_tablet_manager.cc:1403] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:16:22.311535 14830 raft_consensus.cc:359] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.312434 14830 raft_consensus.cc:385] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.312417 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.312258 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.313047 14830 raft_consensus.cc:740] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.313369 14784 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:22.313831 14830 consensus_queue.cc:260] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
W20260709 13:16:22.315316 14599 leader_election.cc:343] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.315707 14829 tablet_bootstrap.cc:492] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.316215 14829 ts_tablet_manager.cc:1403] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.004s
I20260709 13:16:22.316391 14599 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:22.317847 14834 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.318217 14834 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.318598 14834 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.318370 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.319307 14829 raft_consensus.cc:359] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.320050 14829 raft_consensus.cc:385] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.320160 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.322248 14830 ts_tablet_manager.cc:1434] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:16:22.323271 14830 tablet_bootstrap.cc:492] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
W20260709 13:16:22.324669 14602 leader_election.cc:343] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.325172 14602 leader_election.cc:304] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:22.326023 14834 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.328205 14834 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.328779 14834 raft_consensus.cc:2749] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.329627 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:22.330353 14830 tablet_bootstrap.cc:654] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.330394 14784 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.320434 14829 raft_consensus.cc:740] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.333292 14829 consensus_queue.cc:260] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.335569 14829 ts_tablet_manager.cc:1434] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:16:22.336542 14829 tablet_bootstrap.cc:492] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.344475 14829 tablet_bootstrap.cc:654] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.364048 14784 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:22.365826 14599 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
W20260709 13:16:22.366245 14602 leader_election.cc:343] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.366639 14834 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:22.367161 14834 raft_consensus.cc:697] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:22.367796 14834 consensus_queue.cc:237] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.368821 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
W20260709 13:16:22.372565 14602 leader_election.cc:343] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.374650 14828 tablet_bootstrap.cc:492] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.375136 14828 ts_tablet_manager.cc:1403] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.094s	user 0.029s	sys 0.022s
I20260709 13:16:22.375509 14830 tablet_bootstrap.cc:492] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.376003 14830 ts_tablet_manager.cc:1403] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.016s
I20260709 13:16:22.379129 14830 raft_consensus.cc:359] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.380999 14830 raft_consensus.cc:385] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.381332 14830 raft_consensus.cc:740] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.381385 14828 raft_consensus.cc:359] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.382166 14828 raft_consensus.cc:385] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.382475 14828 raft_consensus.cc:740] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.383203 14828 consensus_queue.cc:260] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.383249 14830 consensus_queue.cc:260] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.384122 14532 catalog_manager.cc:5697] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.386487 14828 ts_tablet_manager.cc:1434] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:16:22.384426 14837 raft_consensus.cc:493] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.387434 14828 tablet_bootstrap.cc:492] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.387369 14837 raft_consensus.cc:515] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.395514 14828 tablet_bootstrap.cc:654] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.396775 14829 tablet_bootstrap.cc:492] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.398614 14830 ts_tablet_manager.cc:1434] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.022s	user 0.014s	sys 0.007s
I20260709 13:16:22.397460 14829 ts_tablet_manager.cc:1403] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.000s
I20260709 13:16:22.399704 14830 tablet_bootstrap.cc:492] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.400715 14837 leader_election.cc:290] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:22.403555 14829 raft_consensus.cc:359] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.407382 14829 raft_consensus.cc:385] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.407552 14830 tablet_bootstrap.cc:654] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.408372 14829 raft_consensus.cc:740] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.410524 14834 raft_consensus.cc:493] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.411087 14834 raft_consensus.cc:515] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.411543 14829 consensus_queue.cc:260] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.413209 14834 leader_election.cc:290] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.414450 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
W20260709 13:16:22.415979 14599 leader_election.cc:343] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.421298 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.422258 14710 raft_consensus.cc:2468] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:22.424834 14834 raft_consensus.cc:493] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.424782 14602 leader_election.cc:304] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:22.425487 14834 raft_consensus.cc:515] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.426355 14848 raft_consensus.cc:2804] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.426908 14848 raft_consensus.cc:493] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.427342 14848 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.427644 14834 leader_election.cc:290] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.429025 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.429674 14784 raft_consensus.cc:2468] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:22.431212 14599 leader_election.cc:304] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:22.432138 14834 raft_consensus.cc:2804] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.432497 14834 raft_consensus.cc:493] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.432884 14834 raft_consensus.cc:3060] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.438666 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.439442 14834 raft_consensus.cc:515] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.441570 14835 raft_consensus.cc:493] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:22.442068 14602 leader_election.cc:343] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.442107 14835 raft_consensus.cc:515] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.449787 14835 leader_election.cc:290] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.443535 14848 raft_consensus.cc:515] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.445837 14829 ts_tablet_manager.cc:1434] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:16:22.453995 14829 tablet_bootstrap.cc:492] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.469655 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
W20260709 13:16:22.472990 14602 leader_election.cc:343] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.474799 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:22.478210 14710 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.481119 14834 leader_election.cc:290] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.482617 14835 raft_consensus.cc:493] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.483101 14835 raft_consensus.cc:515] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.484938 14828 tablet_bootstrap.cc:492] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.484905 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:22.486881 14828 ts_tablet_manager.cc:1403] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.006s
I20260709 13:16:22.488533 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:22.485211 14835 leader_election.cc:290] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.487473 14784 raft_consensus.cc:3060] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.482183 14848 leader_election.cc:290] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.501842 14829 tablet_bootstrap.cc:654] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.514581 14828 raft_consensus.cc:359] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.515705 14828 raft_consensus.cc:385] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.516115 14828 raft_consensus.cc:740] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.517179 14828 consensus_queue.cc:260] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
W20260709 13:16:22.519707 14599 leader_election.cc:343] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.522711 14828 ts_tablet_manager.cc:1434] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 13:16:22.528684 14828 tablet_bootstrap.cc:492] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.529325 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.530012 14711 raft_consensus.cc:2468] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 0.
I20260709 13:16:22.531940 14751 leader_election.cc:304] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:22.533562 14837 raft_consensus.cc:2804] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.533989 14837 raft_consensus.cc:493] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.536162 14837 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.523772 14710 raft_consensus.cc:2468] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:22.530038 14784 raft_consensus.cc:2468] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:22.539378 14830 tablet_bootstrap.cc:492] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.540117 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.542786 14830 ts_tablet_manager.cc:1403] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.143s	user 0.048s	sys 0.035s
I20260709 13:16:22.544538 14602 leader_election.cc:304] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:22.545886 14848 raft_consensus.cc:2804] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:22.546496 14848 raft_consensus.cc:697] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:22.548780 14848 consensus_queue.cc:237] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.549526 14830 raft_consensus.cc:359] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.550236 14830 raft_consensus.cc:385] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.550513 14830 raft_consensus.cc:740] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.546942 14599 leader_election.cc:304] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 0d7c2858f55c4bb888941715bdb89bf6
W20260709 13:16:22.551240 14750 leader_election.cc:343] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.552515 14834 raft_consensus.cc:2804] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:22.566814 14837 raft_consensus.cc:515] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.560886 14830 consensus_queue.cc:260] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.571743 14830 ts_tablet_manager.cc:1434] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:16:22.572731 14830 tablet_bootstrap.cc:492] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.565263 14828 tablet_bootstrap.cc:654] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.586953 14848 raft_consensus.cc:493] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.587740 14848 raft_consensus.cc:515] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.590495 14848 leader_election.cc:290] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.597057 14829 tablet_bootstrap.cc:492] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.597527 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:22.597548 14829 ts_tablet_manager.cc:1403] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.006s
W20260709 13:16:22.600291 14750 leader_election.cc:343] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.600955 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.601591 14710 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:22.602591 14602 leader_election.cc:304] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:22.603466 14848 raft_consensus.cc:2804] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.605533 14837 leader_election.cc:290] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:22.604173 14531 catalog_manager.cc:5697] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.603206 14829 raft_consensus.cc:359] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.608377 14848 raft_consensus.cc:493] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.614051 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.614713 14784 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:22.611173 14848 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.617197 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:22.609532 14834 raft_consensus.cc:697] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:22.619626 14710 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.611307 14829 raft_consensus.cc:385] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.623394 14829 raft_consensus.cc:740] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.624503 14829 consensus_queue.cc:260] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.626853 14829 ts_tablet_manager.cc:1434] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.003s
I20260709 13:16:22.627868 14829 tablet_bootstrap.cc:492] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.631302 14830 tablet_bootstrap.cc:654] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.639233 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.639657 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.641919 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.641837 14834 consensus_queue.cc:237] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.639951 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.644117 14785 raft_consensus.cc:2393] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7c2858f55c4bb888941715bdb89bf6 in current term 1: Already voted for candidate 90623b8327d2492eacfa011b104c2eb2 in this term.
W20260709 13:16:22.645164 14676 leader_election.cc:343] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.639951 14784 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 0.
I20260709 13:16:22.648181 14674 leader_election.cc:304] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:22.650117 14674 leader_election.cc:304] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6; no voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.650571 14828 tablet_bootstrap.cc:492] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.651069 14835 raft_consensus.cc:2804] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.654160 14835 raft_consensus.cc:493] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.654496 14835 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.651050 14828 ts_tablet_manager.cc:1403] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.124s	user 0.022s	sys 0.022s
I20260709 13:16:22.659441 14710 raft_consensus.cc:2468] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 1.
I20260709 13:16:22.663656 14751 leader_election.cc:304] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.664557 14837 raft_consensus.cc:2804] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:22.665241 14837 raft_consensus.cc:697] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:22.666062 14837 consensus_queue.cc:237] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.668165 14835 raft_consensus.cc:515] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.672137 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:22.677191 14830 tablet_bootstrap.cc:492] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.671805 14835 leader_election.cc:290] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.678109 14830 ts_tablet_manager.cc:1403] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.014s
I20260709 13:16:22.671109 14848 raft_consensus.cc:515] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.681317 14870 raft_consensus.cc:2749] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.673183 14828 raft_consensus.cc:359] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.682912 14636 raft_consensus.cc:2393] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7c2858f55c4bb888941715bdb89bf6 in current term 1: Already voted for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in this term.
I20260709 13:16:22.682053 14835 raft_consensus.cc:493] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.685138 14835 raft_consensus.cc:515] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.687929 14835 leader_election.cc:290] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.689292 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
W20260709 13:16:22.691532 14676 leader_election.cc:343] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.691287 14830 raft_consensus.cc:359] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.696686 14848 leader_election.cc:290] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.677249 14829 tablet_bootstrap.cc:654] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.692283 14830 raft_consensus.cc:385] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.698077 14830 raft_consensus.cc:740] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.697896 14533 catalog_manager.cc:5697] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.699153 14828 raft_consensus.cc:385] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.699595 14828 raft_consensus.cc:740] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.699210 14830 consensus_queue.cc:260] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.701560 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:22.701660 14828 consensus_queue.cc:260] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.702188 14785 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.703692 14531 catalog_manager.cc:5697] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:22.704365 14828 ts_tablet_manager.cc:1434] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:16:22.705866 14828 tablet_bootstrap.cc:492] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.710479 14830 ts_tablet_manager.cc:1434] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.004s
I20260709 13:16:22.710608 14848 raft_consensus.cc:493] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.711158 14848 raft_consensus.cc:515] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.711478 14785 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:22.698076 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:22.711611 14830 tablet_bootstrap.cc:492] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.714047 14599 leader_election.cc:304] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:22.716223 14834 raft_consensus.cc:2804] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:22.716920 14834 raft_consensus.cc:697] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:22.716041 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:22.719597 14710 raft_consensus.cc:2393] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fe3d690f9d9a41b6b09dfde5a0a01830 in current term 1: Already voted for candidate 0d7c2858f55c4bb888941715bdb89bf6 in this term.
I20260709 13:16:22.724249 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.727856 14784 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 0.
I20260709 13:16:22.722116 14834 consensus_queue.cc:237] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.729458 14829 tablet_bootstrap.cc:492] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.729368 14674 leader_election.cc:304] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.730001 14829 ts_tablet_manager.cc:1403] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.007s
I20260709 13:16:22.730472 14835 raft_consensus.cc:2804] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.733095 14835 raft_consensus.cc:493] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.733457 14835 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.736840 14871 raft_consensus.cc:493] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.738210 14785 raft_consensus.cc:2393] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d7c2858f55c4bb888941715bdb89bf6 in current term 1: Already voted for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in this term.
I20260709 13:16:22.739737 14871 raft_consensus.cc:515] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.747201 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.748078 14710 raft_consensus.cc:2393] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fe3d690f9d9a41b6b09dfde5a0a01830 in current term 1: Already voted for candidate 90623b8327d2492eacfa011b104c2eb2 in this term.
I20260709 13:16:22.747866 14835 raft_consensus.cc:515] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.750840 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:22.751612 14871 leader_election.cc:290] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.768220 14828 tablet_bootstrap.cc:654] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.769255 14829 raft_consensus.cc:359] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.768863 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.770689 14829 raft_consensus.cc:385] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:22.773820 14676 leader_election.cc:343] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.770989 14837 raft_consensus.cc:493] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.768380 14848 leader_election.cc:290] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.776046 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:22.776082 14837 raft_consensus.cc:515] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.777321 14783 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.775561 14533 catalog_manager.cc:5697] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.777658 14830 tablet_bootstrap.cc:654] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.776362 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.772396 14835 leader_election.cc:290] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.779867 14674 leader_election.cc:304] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6; no voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.780261 14837 leader_election.cc:290] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
W20260709 13:16:22.780350 14676 leader_election.cc:343] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.781287 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.773499 14829 raft_consensus.cc:740] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.782512 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.783339 14710 raft_consensus.cc:2393] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90623b8327d2492eacfa011b104c2eb2 in current term 1: Already voted for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in this term.
I20260709 13:16:22.784467 14837 raft_consensus.cc:493] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.784957 14837 raft_consensus.cc:515] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.783211 14829 consensus_queue.cc:260] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.786592 14871 raft_consensus.cc:2749] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.790562 14829 ts_tablet_manager.cc:1434] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.006s
I20260709 13:16:22.791612 14829 tablet_bootstrap.cc:492] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.792532 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.794305 14750 leader_election.cc:304] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2; no voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.795696 14852 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.800252 14829 tablet_bootstrap.cc:654] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.803542 14852 raft_consensus.cc:2749] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.796922 14828 tablet_bootstrap.cc:492] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.804272 14828 ts_tablet_manager.cc:1403] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.006s
I20260709 13:16:22.805100 14599 leader_election.cc:304] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:22.806368 14848 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.809302 14837 leader_election.cc:290] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:22.810493 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
W20260709 13:16:22.812116 14751 leader_election.cc:343] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.812362 14828 raft_consensus.cc:359] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
W20260709 13:16:22.813169 14674 leader_election.cc:343] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.813647 14674 leader_election.cc:304] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6; no voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.814678 14835 raft_consensus.cc:2749] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.813158 14828 raft_consensus.cc:385] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.815407 14828 raft_consensus.cc:740] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.816167 14828 consensus_queue.cc:260] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.817981 14783 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 1.
I20260709 13:16:22.818610 14829 tablet_bootstrap.cc:492] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.813612 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.819209 14674 leader_election.cc:304] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.819639 14829 ts_tablet_manager.cc:1403] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.005s
I20260709 13:16:22.819993 14835 raft_consensus.cc:2804] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:16:22.820441 14750 leader_election.cc:343] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:22.820974 14750 leader_election.cc:304] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2; no voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.821197 14828 ts_tablet_manager.cc:1434] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:16:22.820490 14835 raft_consensus.cc:697] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:22.821749 14837 raft_consensus.cc:2749] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.822171 14835 consensus_queue.cc:237] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.823606 14828 tablet_bootstrap.cc:492] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.826884 14830 tablet_bootstrap.cc:492] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.827380 14830 ts_tablet_manager.cc:1403] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.014s
I20260709 13:16:22.829569 14829 raft_consensus.cc:359] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.829896 14830 raft_consensus.cc:359] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.830289 14829 raft_consensus.cc:385] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.830487 14830 raft_consensus.cc:385] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.830567 14829 raft_consensus.cc:740] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.830832 14828 tablet_bootstrap.cc:654] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.830828 14830 raft_consensus.cc:740] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.826895 14848 raft_consensus.cc:2749] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.832209 14830 consensus_queue.cc:260] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.835199 14830 ts_tablet_manager.cc:1434] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:22.835530 14829 consensus_queue.cc:260] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.836210 14830 tablet_bootstrap.cc:492] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2: Bootstrap starting.
I20260709 13:16:22.837540 14829 ts_tablet_manager.cc:1434] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:16:22.838419 14829 tablet_bootstrap.cc:492] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6: Bootstrap starting.
I20260709 13:16:22.846632 14710 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.854151 14830 tablet_bootstrap.cc:654] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.856633 14829 tablet_bootstrap.cc:654] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.860579 14848 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:22.861145 14871 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.861769 14871 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.860399 14532 catalog_manager.cc:5697] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:22.873373 14837 raft_consensus.cc:493] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.873785 14830 tablet_bootstrap.cc:492] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2: No bootstrap required, opened a new log
I20260709 13:16:22.874609 14830 ts_tablet_manager.cc:1403] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.006s
I20260709 13:16:22.874090 14837 raft_consensus.cc:515] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.877509 14828 tablet_bootstrap.cc:492] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.877542 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.878064 14828 ts_tablet_manager.cc:1403] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.055s	user 0.030s	sys 0.009s
I20260709 13:16:22.878266 14636 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 0.
I20260709 13:16:22.878239 14837 leader_election.cc:290] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:22.879884 14750 leader_election.cc:304] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:22.882014 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.884457 14837 raft_consensus.cc:2804] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:22.885016 14837 raft_consensus.cc:493] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.885442 14837 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.888267 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.889186 14783 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 1.
I20260709 13:16:22.890372 14835 raft_consensus.cc:493] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.890990 14835 raft_consensus.cc:515] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.893443 14828 raft_consensus.cc:359] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.894356 14828 raft_consensus.cc:385] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.894702 14828 raft_consensus.cc:740] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.895663 14835 leader_election.cc:290] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.895586 14828 consensus_queue.cc:260] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.893638 14674 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.899283 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:22.900338 14828 ts_tablet_manager.cc:1434] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:16:22.900873 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:22.901234 14828 tablet_bootstrap.cc:492] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830: Bootstrap starting.
I20260709 13:16:22.900355 14783 raft_consensus.cc:2393] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d7c2858f55c4bb888941715bdb89bf6 in current term 1: Already voted for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in this term.
I20260709 13:16:22.904482 14674 leader_election.cc:304] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6; no voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.906209 14710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:22.907059 14710 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 0.
I20260709 13:16:22.907590 14828 tablet_bootstrap.cc:654] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:22.908979 14871 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.909958 14871 raft_consensus.cc:3060] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.915333 14830 raft_consensus.cc:359] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.918072 14871 raft_consensus.cc:2749] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:22.925345 14830 raft_consensus.cc:385] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.925748 14830 raft_consensus.cc:740] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.926471 14830 consensus_queue.cc:260] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.924614 14829 tablet_bootstrap.cc:492] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6: No bootstrap required, opened a new log
I20260709 13:16:22.923401 14865 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:22.928939 14829 ts_tablet_manager.cc:1403] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent bootstrapping tablet: real 0.091s	user 0.040s	sys 0.015s
I20260709 13:16:22.930634 14830 ts_tablet_manager.cc:1434] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:16:22.931516 14829 raft_consensus.cc:359] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.932194 14829 raft_consensus.cc:385] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.935174 14829 raft_consensus.cc:740] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.935822 14829 consensus_queue.cc:260] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.932019 14870 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:22.937916 14829 ts_tablet_manager.cc:1434] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:16:22.938905 14870 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe3d690f9d9a41b6b09dfde5a0a01830)
I20260709 13:16:22.939363 14870 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:22.934820 14837 raft_consensus.cc:515] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.944922 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:22.945322 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:22.945519 14636 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.945896 14711 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:22.946341 14828 tablet_bootstrap.cc:492] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830: No bootstrap required, opened a new log
I20260709 13:16:22.946730 14828 ts_tablet_manager.cc:1403] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.004s
I20260709 13:16:22.948549 14828 raft_consensus.cc:359] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.949230 14828 raft_consensus.cc:385] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:22.949492 14828 raft_consensus.cc:740] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Initialized, Role: FOLLOWER
I20260709 13:16:22.950254 14828 consensus_queue.cc:260] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.952658 14711 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 1.
I20260709 13:16:22.953181 14837 leader_election.cc:290] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:22.954739 14751 leader_election.cc:304] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:22.955706 14837 raft_consensus.cc:2804] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:22.956252 14837 raft_consensus.cc:697] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:22.957716 14865 consensus_queue.cc:1048] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:22.957142 14837 consensus_queue.cc:237] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.962452 14828 ts_tablet_manager.cc:1434] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:16:22.974817 14636 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 1.
I20260709 13:16:22.976341 14870 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:22.978808 14870 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:22.979712 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:22.980463 14784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:22.982878 14674 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6; no voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:22.984205 14870 raft_consensus.cc:2749] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:16:22.990931 14580 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:22.991161 14867 consensus_queue.cc:1048] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.006095 14532 catalog_manager.cc:5697] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.008790 14865 raft_consensus.cc:493] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.009305 14865 raft_consensus.cc:515] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.011476 14865 leader_election.cc:290] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.012665 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:23.013566 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:23.013811 14783 raft_consensus.cc:2468] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:23.014195 14711 raft_consensus.cc:2468] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:23.014918 14599 leader_election.cc:304] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:23.015746 14865 raft_consensus.cc:2804] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.016175 14865 raft_consensus.cc:493] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.016532 14865 raft_consensus.cc:3060] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.022363 14865 raft_consensus.cc:515] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.024861 14865 leader_election.cc:290] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.024945 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:23.025557 14711 raft_consensus.cc:3060] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.025681 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:23.026244 14783 raft_consensus.cc:3060] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.030237 14711 raft_consensus.cc:2468] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:23.031247 14602 leader_election.cc:304] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:23.031914 14865 raft_consensus.cc:2804] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:23.032044 14783 raft_consensus.cc:2468] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:23.032375 14865 raft_consensus.cc:697] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:23.033721 14865 consensus_queue.cc:237] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.042028 14531 catalog_manager.cc:5697] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.053138 14865 raft_consensus.cc:493] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.053606 14865 raft_consensus.cc:515] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.055858 14865 leader_election.cc:290] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.056206 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:23.056461 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:23.056885 14711 raft_consensus.cc:2468] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:23.057068 14783 raft_consensus.cc:2468] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 0.
I20260709 13:16:23.057974 14602 leader_election.cc:304] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:23.058779 14865 raft_consensus.cc:2804] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:23.059165 14865 raft_consensus.cc:493] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.059450 14865 raft_consensus.cc:3060] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.064061 14865 raft_consensus.cc:515] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.065773 14865 leader_election.cc:290] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.066730 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:23.066915 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:23.067246 14711 raft_consensus.cc:3060] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.067499 14783 raft_consensus.cc:3060] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.071878 14711 raft_consensus.cc:2468] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:23.072989 14602 leader_election.cc:304] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:23.073673 14865 raft_consensus.cc:2804] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:23.073887 14783 raft_consensus.cc:2468] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 1.
I20260709 13:16:23.074133 14865 raft_consensus.cc:697] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:23.075002 14865 consensus_queue.cc:237] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.082695 14531 catalog_manager.cc:5697] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.084808 14837 consensus_queue.cc:1048] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.098060 14852 consensus_queue.cc:1048] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.163990 14865 consensus_queue.cc:1048] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.175293 14867 consensus_queue.cc:1048] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.222813 14785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "365fda54d9354130af1649cad7b26397"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
mode: GRACEFUL
new_leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:40950
I20260709 13:16:23.223449 14785 raft_consensus.cc:606] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Received request to transfer leadership to TS fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:23.238541 14848 consensus_queue.cc:1048] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.245056 14636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:16:23.245705 14636 raft_consensus.cc:606] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:23.250921 14834 consensus_queue.cc:1048] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.269848 14636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:16:23.270393 14636 raft_consensus.cc:606] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:23.277673 14785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:40950
I20260709 13:16:23.278467 14785 raft_consensus.cc:606] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:23.284794 14636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
mode: GRACEFUL
new_leader_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:16:23.285472 14636 raft_consensus.cc:606] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Received request to transfer leadership to TS 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:23.289080 14870 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.294148 14636 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:23.304504 14835 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.372788 14711 raft_consensus.cc:1240] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Rejecting Update request from peer fe3d690f9d9a41b6b09dfde5a0a01830 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:23.374346 14848 consensus_queue.cc:1059] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.375223 14848 raft_consensus.cc:3055] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.375571 14848 raft_consensus.cc:740] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:23.376340 14848 consensus_queue.cc:260] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.377435 14848 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.421655 14852 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.433858 14852 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.447072 14837 raft_consensus.cc:993] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2: : Instructing follower fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:23.447611 14837 raft_consensus.cc:1081] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Signalling peer fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:23.449669 14635 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "365fda54d9354130af1649cad7b26397"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:50516
I20260709 13:16:23.450364 14635 raft_consensus.cc:493] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.450767 14635 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.457813 14635 raft_consensus.cc:515] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.459935 14635 leader_election.cc:290] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 2 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.460826 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:23.461257 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:23.461493 14711 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.461848 14785 raft_consensus.cc:3055] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.462198 14785 raft_consensus.cc:740] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:23.463019 14785 consensus_queue.cc:260] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.464258 14785 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.466630 14711 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 2.
I20260709 13:16:23.467818 14602 leader_election.cc:304] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:23.468575 14848 raft_consensus.cc:2804] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.469077 14848 raft_consensus.cc:697] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:23.469914 14848 consensus_queue.cc:237] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.471521 14785 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 2.
I20260709 13:16:23.475826 14837 raft_consensus.cc:993] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:23.476272 14837 raft_consensus.cc:1081] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:23.477941 14711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:16:23.478662 14711 raft_consensus.cc:493] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.479048 14711 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.478533 14530 catalog_manager.cc:5697] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 1 to 2, leader changed from 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67) to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.486227 14711 raft_consensus.cc:515] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.488829 14711 leader_election.cc:290] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.490964 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:23.491648 14635 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.492261 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:23.492866 14785 raft_consensus.cc:3055] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.493165 14785 raft_consensus.cc:740] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:23.493868 14785 consensus_queue.cc:260] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.497057 14785 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.501303 14635 raft_consensus.cc:2468] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:23.505460 14785 raft_consensus.cc:2468] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:23.507112 14674 leader_election.cc:304] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:23.508355 14834 consensus_queue.cc:1048] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:23.508329 14835 raft_consensus.cc:2804] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.509637 14835 raft_consensus.cc:697] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:23.511122 14835 consensus_queue.cc:237] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.520720 14530 catalog_manager.cc:5697] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 1 to 2, leader changed from 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.522027 14848 consensus_queue.cc:1048] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.530534 14867 consensus_queue.cc:1048] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.548983 14834 consensus_queue.cc:1048] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:23.557132 14867 raft_consensus.cc:993] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830: : Instructing follower 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:23.557596 14867 raft_consensus.cc:1081] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Signalling peer 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:23.559645 14783 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:40944
I20260709 13:16:23.560154 14783 raft_consensus.cc:493] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.560472 14783 raft_consensus.cc:3060] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.571465 14783 raft_consensus.cc:515] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.575706 14865 raft_consensus.cc:993] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:23.576188 14865 raft_consensus.cc:1081] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:23.578365 14783 leader_election.cc:290] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:23.578459 14710 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41910
I20260709 13:16:23.579080 14710 raft_consensus.cc:493] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.579454 14710 raft_consensus.cc:3060] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.579869 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:23.580399 14711 raft_consensus.cc:3060] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.586440 14710 raft_consensus.cc:515] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.587062 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02975c85bcfd4326924f80cd0a816669" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:23.587539 14635 raft_consensus.cc:3055] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.587754 14635 raft_consensus.cc:740] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:23.588405 14635 consensus_queue.cc:260] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.589113 14710 leader_election.cc:290] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.589365 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:23.589608 14635 raft_consensus.cc:3060] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.589944 14636 raft_consensus.cc:3055] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.590026 14711 raft_consensus.cc:2468] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 2.
I20260709 13:16:23.590342 14636 raft_consensus.cc:740] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:23.591220 14636 consensus_queue.cc:260] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.592336 14636 raft_consensus.cc:3060] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.593497 14751 leader_election.cc:304] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:23.594400 14837 raft_consensus.cc:2804] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.594880 14837 raft_consensus.cc:697] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:23.595065 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38540bf90c9a40f9a59fb00b24079447" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:23.595721 14783 raft_consensus.cc:3060] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.596925 14635 raft_consensus.cc:2468] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 2.
I20260709 13:16:23.595731 14837 consensus_queue.cc:237] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.602312 14783 raft_consensus.cc:2468] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:23.603459 14636 raft_consensus.cc:2468] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:23.603714 14674 leader_election.cc:304] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:23.604558 14835 raft_consensus.cc:2804] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.605062 14835 raft_consensus.cc:697] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:23.605865 14835 consensus_queue.cc:237] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.608228 14532 catalog_manager.cc:5697] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 1 to 2, leader changed from fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65) to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.612773 14531 catalog_manager.cc:5697] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 1 to 2, leader changed from fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.749112 14834 raft_consensus.cc:993] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:23.749614 14865 raft_consensus.cc:1081] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:23.751159 14711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41910
I20260709 13:16:23.751669 14711 raft_consensus.cc:493] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:23.751996 14711 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.756737 14711 raft_consensus.cc:515] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.758494 14711 leader_election.cc:290] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:23.759387 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:23.759696 14783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:23.760011 14636 raft_consensus.cc:3055] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:23.760293 14783 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.760411 14636 raft_consensus.cc:740] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:23.761322 14636 consensus_queue.cc:260] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.762290 14636 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:23.766803 14636 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:23.767446 14783 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:23.768209 14676 leader_election.cc:304] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:23.769219 14835 raft_consensus.cc:2804] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:23.769721 14835 raft_consensus.cc:697] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:23.770480 14835 consensus_queue.cc:237] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:23.777405 14531 catalog_manager.cc:5697] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 1 to 2, leader changed from fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:23.886765 14783 raft_consensus.cc:1275] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.888080 14865 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.895476 14711 raft_consensus.cc:1275] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.900715 14848 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.984771 14783 raft_consensus.cc:1275] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.986315 14835 consensus_queue.cc:1048] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.994932 14636 raft_consensus.cc:1275] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:23.996382 14871 consensus_queue.cc:1048] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.024379 14785 raft_consensus.cc:1275] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.025698 14835 consensus_queue.cc:1048] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.034171 14636 raft_consensus.cc:1275] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.035610 14870 consensus_queue.cc:1048] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.147994 14711 raft_consensus.cc:1275] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.149878 14837 consensus_queue.cc:1048] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.160401 14635 raft_consensus.cc:1275] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.163149 14837 consensus_queue.cc:1048] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.232195 14635 raft_consensus.cc:1275] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.233600 14870 consensus_queue.cc:1048] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:24.240993 14785 raft_consensus.cc:1275] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:24.243152 14871 consensus_queue.cc:1048] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.449939 14837 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fe3d690f9d9a41b6b09dfde5a0a01830)
I20260709 13:16:24.450389 14837 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:24.452010 14837 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:24.452965 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:24.453143 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6" is_pre_election: true
I20260709 13:16:24.453579 14635 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 2.
I20260709 13:16:24.454001 14711 raft_consensus.cc:2393] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90623b8327d2492eacfa011b104c2eb2 in current term 2: Already voted for candidate 0d7c2858f55c4bb888941715bdb89bf6 in this term.
I20260709 13:16:24.454623 14750 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:24.455488 14837 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:24.455821 14837 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fe3d690f9d9a41b6b09dfde5a0a01830)
I20260709 13:16:24.456107 14837 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:24.460427 14837 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:24.462119 14837 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:24.463032 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:24.463156 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:24.463833 14711 raft_consensus.cc:2393] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 90623b8327d2492eacfa011b104c2eb2 in current term 2: Already voted for candidate 0d7c2858f55c4bb888941715bdb89bf6 in this term.
I20260709 13:16:24.467949 14635 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 2.
I20260709 13:16:24.469086 14750 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:24.469736 14837 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:24.470180 14837 raft_consensus.cc:697] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:24.470933 14837 consensus_queue.cc:237] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:24.478039 14530 catalog_manager.cc:5697] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 1 to 2, leader changed from fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65) to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.660961 14918 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.661454 14918 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:24.663094 14918 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:24.663959 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" is_pre_election: true
I20260709 13:16:24.664208 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2" is_pre_election: true
I20260709 13:16:24.664490 14635 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:24.665652 14676 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:24.666356 14918 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:24.666693 14918 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.666914 14918 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.671428 14918 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:24.673492 14918 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:24.674270 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:24.674855 14635 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:24.674852 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:24.679978 14635 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 3.
I20260709 13:16:24.680962 14676 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:24.681675 14918 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:24.682040 14918 raft_consensus.cc:697] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:24.682808 14918 consensus_queue.cc:237] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:24.691107 14530 catalog_manager.cc:5697] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 2 to 3, leader changed from 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:24.895638 14635 raft_consensus.cc:1240] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Rejecting Update request from peer 90623b8327d2492eacfa011b104c2eb2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.897111 14913 consensus_queue.cc:1059] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:24.897815 14919 raft_consensus.cc:3055] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:24.898088 14919 raft_consensus.cc:740] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:24.898695 14919 consensus_queue.cc:260] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:24.899621 14919 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:25.210865 14635 raft_consensus.cc:1275] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:25.211699 14785 raft_consensus.cc:1275] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:25.212124 14785 pending_rounds.cc:85] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: Aborting all ops after (but not including) 1
I20260709 13:16:25.212488 14785 pending_rounds.cc:107] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:25.212291 14918 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:25.212868 14785 raft_consensus.cc:2889] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.214288 14918 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:26.315866 14501 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:16:26.316673 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:26.332540 14711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
mode: GRACEFUL
new_leader_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:16:26.333166 14711 raft_consensus.cc:606] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 LEADER]: Received request to transfer leadership to TS 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:26.335848 14711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
mode: GRACEFUL
new_leader_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:16:26.336369 14711 raft_consensus.cc:606] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Received request to transfer leadership to TS 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:26.337509 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:26.337994 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:26.469901 14870 raft_consensus.cc:993] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: : Instructing follower 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:26.470338 14928 raft_consensus.cc:1081] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 LEADER]: Signalling peer 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:26.471889 14785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:40946
I20260709 13:16:26.472344 14785 raft_consensus.cc:493] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.472699 14785 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.477408 14785 raft_consensus.cc:515] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:26.479094 14785 leader_election.cc:290] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:26.480008 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:26.480131 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:26.480707 14636 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.480816 14711 raft_consensus.cc:3055] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:26.481184 14711 raft_consensus.cc:740] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:26.481966 14711 consensus_queue.cc:260] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:26.482882 14711 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:26.485603 14636 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 2.
I20260709 13:16:26.486737 14750 leader_election.cc:304] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:26.487422 14919 raft_consensus.cc:2804] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:26.487843 14711 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 2.
I20260709 13:16:26.488811 14919 raft_consensus.cc:697] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:26.489841 14919 consensus_queue.cc:237] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:26.496951 14531 catalog_manager.cc:5697] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 1 to 2, leader changed from 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66) to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:26.690799 14870 raft_consensus.cc:993] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6: : Instructing follower 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:26.691251 14928 raft_consensus.cc:1081] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Signalling peer 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:26.692847 14785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:40946
I20260709 13:16:26.693307 14785 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.693568 14785 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.698015 14785 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:26.700307 14785 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 4 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:26.700624 14635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:26.700977 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:26.701264 14635 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.701556 14711 raft_consensus.cc:3055] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:26.701879 14711 raft_consensus.cc:740] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:26.702685 14711 consensus_queue.cc:260] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:26.703922 14711 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.708659 14635 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 4.
I20260709 13:16:26.709928 14750 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:26.710335 14711 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 4.
I20260709 13:16:26.710732 14919 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:26.711220 14919 raft_consensus.cc:697] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:26.712052 14919 consensus_queue.cc:237] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:26.720455 14531 catalog_manager.cc:5697] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 3 to 4, leader changed from 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66) to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.094769 14635 raft_consensus.cc:1275] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.095798 14711 raft_consensus.cc:1275] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.096076 14919 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.097302 14929 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.128715 14636 raft_consensus.cc:1275] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.130033 14919 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.138501 14711 raft_consensus.cc:1275] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:27.140354 14919 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.338937 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.349601 14636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:16:27.350215 14636 raft_consensus.cc:606] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:27.355343 14636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "365fda54d9354130af1649cad7b26397"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:16:27.355917 14636 raft_consensus.cc:606] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:27.360834 14636 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:50540
I20260709 13:16:27.361426 14636 raft_consensus.cc:606] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:27.366055 14785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:40950
I20260709 13:16:27.366600 14785 raft_consensus.cc:606] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:27.374600 14785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
mode: GRACEFUL
new_leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:40950
I20260709 13:16:27.375187 14785 raft_consensus.cc:606] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Received request to transfer leadership to TS 0d7c2858f55c4bb888941715bdb89bf6
I20260709 13:16:27.403060 14944 raft_consensus.cc:993] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.403887 14834 raft_consensus.cc:1081] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.405265 14711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41910
I20260709 13:16:27.405700 14711 raft_consensus.cc:493] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.405983 14711 raft_consensus.cc:3060] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.409847 14711 raft_consensus.cc:515] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.411262 14711 leader_election.cc:290] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:27.412389 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:27.412508 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ba4e82c54f948b0a98479cbb7ab44a9" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:27.412979 14785 raft_consensus.cc:3060] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.413183 14636 raft_consensus.cc:3055] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:27.413560 14636 raft_consensus.cc:740] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:27.414346 14636 consensus_queue.cc:260] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.415226 14636 raft_consensus.cc:3060] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.417701 14785 raft_consensus.cc:2468] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:27.418768 14674 leader_election.cc:304] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:27.419541 14928 raft_consensus.cc:2804] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:27.419947 14928 raft_consensus.cc:697] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:27.420195 14636 raft_consensus.cc:2468] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:27.420753 14928 consensus_queue.cc:237] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.427438 14531 catalog_manager.cc:5697] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 1 to 2, leader changed from fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.482086 14945 raft_consensus.cc:993] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.482547 14834 raft_consensus.cc:1081] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.483971 14711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41910
I20260709 13:16:27.484556 14711 raft_consensus.cc:493] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.484905 14711 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.489131 14711 raft_consensus.cc:515] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.490674 14711 leader_election.cc:290] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:27.491823 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:27.491768 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:27.492579 14785 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.492671 14636 raft_consensus.cc:3055] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:27.493093 14636 raft_consensus.cc:740] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:27.493912 14636 consensus_queue.cc:260] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.495045 14636 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:27.498934 14785 raft_consensus.cc:2468] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:27.500012 14674 leader_election.cc:304] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:27.500749 14928 raft_consensus.cc:2804] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:27.501227 14928 raft_consensus.cc:697] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:27.501269 14636 raft_consensus.cc:2468] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 2.
I20260709 13:16:27.502151 14928 consensus_queue.cc:237] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.517236 14531 catalog_manager.cc:5697] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 1 to 2, leader changed from fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.532778 14942 raft_consensus.cc:993] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.533252 14929 raft_consensus.cc:1081] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.534734 14711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:16:27.535140 14711 raft_consensus.cc:493] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.535382 14711 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.539995 14711 raft_consensus.cc:515] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.541671 14711 leader_election.cc:290] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:27.542667 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:27.542845 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:27.543183 14636 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.543381 14785 raft_consensus.cc:3055] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:27.543718 14785 raft_consensus.cc:740] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:27.544310 14785 consensus_queue.cc:260] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.545192 14785 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.548014 14636 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 3.
I20260709 13:16:27.549212 14676 leader_election.cc:304] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:27.549908 14928 raft_consensus.cc:2804] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:27.549908 14785 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 3.
I20260709 13:16:27.550618 14928 raft_consensus.cc:697] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:27.551474 14928 consensus_queue.cc:237] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.557111 14531 catalog_manager.cc:5697] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 2 to 3, leader changed from 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.676724 14951 raft_consensus.cc:993] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.677194 14929 raft_consensus.cc:1081] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.678622 14711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41924
I20260709 13:16:27.679068 14711 raft_consensus.cc:493] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.679355 14711 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.683437 14711 raft_consensus.cc:515] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.684973 14711 leader_election.cc:290] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 5 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:27.685936 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:27.686054 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5a170da421046f0b3e0f2b4c3823aa6" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:27.686486 14636 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.686583 14785 raft_consensus.cc:3055] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:27.686996 14785 raft_consensus.cc:740] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:27.687577 14785 consensus_queue.cc:260] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.688390 14785 raft_consensus.cc:3060] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.691339 14636 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 5.
I20260709 13:16:27.692485 14785 raft_consensus.cc:2468] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 5.
I20260709 13:16:27.692456 14676 leader_election.cc:304] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:27.693427 14928 raft_consensus.cc:2804] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:27.693897 14928 raft_consensus.cc:697] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 5 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:27.694739 14928 consensus_queue.cc:237] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.701319 14531 catalog_manager.cc:5697] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 4 to 5, leader changed from 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 5 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.877135 14945 raft_consensus.cc:993] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830: : Instructing follower 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.877562 14834 raft_consensus.cc:1081] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 LEADER]: Signalling peer 0d7c2858f55c4bb888941715bdb89bf6 to start an election
I20260709 13:16:27.879019 14711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "365fda54d9354130af1649cad7b26397"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
 from {username='slave'} at 127.0.0.1:41910
I20260709 13:16:27.879453 14711 raft_consensus.cc:493] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:27.879678 14711 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.883630 14711 raft_consensus.cc:515] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.885076 14711 leader_election.cc:290] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:27.885998 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:27.886106 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "0d7c2858f55c4bb888941715bdb89bf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:27.886521 14636 raft_consensus.cc:3055] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:27.886647 14785 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.886832 14636 raft_consensus.cc:740] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:27.887579 14636 consensus_queue.cc:260] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.888443 14636 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:27.890684 14785 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 3.
I20260709 13:16:27.892161 14674 leader_election.cc:304] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7c2858f55c4bb888941715bdb89bf6, 90623b8327d2492eacfa011b104c2eb2; no voters: 
I20260709 13:16:27.892895 14928 raft_consensus.cc:2804] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:27.893361 14928 raft_consensus.cc:697] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Becoming Leader. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:27.893862 14636 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d7c2858f55c4bb888941715bdb89bf6 in term 3.
I20260709 13:16:27.894219 14928 consensus_queue.cc:237] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:27.900684 14531 catalog_manager.cc:5697] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 reported cstate change: term changed from 2 to 3, leader changed from fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65) to 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "0d7c2858f55c4bb888941715bdb89bf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:27.915973 14785 raft_consensus.cc:1275] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.917215 14928 consensus_queue.cc:1048] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.925835 14636 raft_consensus.cc:1275] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.927596 14870 consensus_queue.cc:1048] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:27.954658 14785 raft_consensus.cc:1275] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.955822 14870 consensus_queue.cc:1048] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.962754 14636 raft_consensus.cc:1275] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:27.964135 14928 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:27.964826 14635 raft_consensus.cc:1275] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:27.967284 14870 consensus_queue.cc:1048] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:27.971211 14785 raft_consensus.cc:1275] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:27.973621 14955 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:28.095146 14636 raft_consensus.cc:1275] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 5 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:28.096382 14870 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.097518 14785 raft_consensus.cc:1275] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 5 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:28.098739 14870 consensus_queue.cc:1048] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.486593 14785 raft_consensus.cc:1275] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:28.487793 14955 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:28.493988 14636 raft_consensus.cc:1275] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Refusing update from remote peer 0d7c2858f55c4bb888941715bdb89bf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:28.495216 14928 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:30.384788 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:30.392067 14711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
mode: GRACEFUL
new_leader_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:16:30.392827 14711 raft_consensus.cc:606] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Received request to transfer leadership to TS 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:30.395464 14711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
mode: GRACEFUL
new_leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:16:30.395916 14711 raft_consensus.cc:606] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Received request to transfer leadership to TS fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:30.398296 14711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
mode: GRACEFUL
new_leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:16:30.398746 14711 raft_consensus.cc:606] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Received request to transfer leadership to TS fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:30.401237 14711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
mode: GRACEFUL
new_leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:16:30.401696 14711 raft_consensus.cc:606] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Received request to transfer leadership to TS fe3d690f9d9a41b6b09dfde5a0a01830
I20260709 13:16:30.403767 14711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "365fda54d9354130af1649cad7b26397"
dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
mode: GRACEFUL
new_leader_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:41932
I20260709 13:16:30.404217 14711 raft_consensus.cc:606] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Received request to transfer leadership to TS 90623b8327d2492eacfa011b104c2eb2
I20260709 13:16:30.405249 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:30.405682 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:30.418861 14966 raft_consensus.cc:993] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6: : Instructing follower 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:30.419417 14964 raft_consensus.cc:1081] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Signalling peer 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:30.420934 14785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "365fda54d9354130af1649cad7b26397"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:40946
I20260709 13:16:30.421442 14785 raft_consensus.cc:493] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.421749 14785 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.427153 14785 raft_consensus.cc:515] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.428702 14785 leader_election.cc:290] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 4 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:30.429781 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:30.429728 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "365fda54d9354130af1649cad7b26397" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:30.430517 14711 raft_consensus.cc:3055] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:30.430596 14636 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.430799 14711 raft_consensus.cc:740] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:30.431471 14711 consensus_queue.cc:260] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.432400 14711 raft_consensus.cc:3060] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.435359 14636 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 4.
I20260709 13:16:30.436474 14750 leader_election.cc:304] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:30.436939 14711 raft_consensus.cc:2468] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 4.
I20260709 13:16:30.437327 14929 raft_consensus.cc:2804] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:30.438445 14929 raft_consensus.cc:697] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 4 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:30.439304 14929 consensus_queue.cc:237] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.446544 14532 catalog_manager.cc:5697] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 3 to 4, leader changed from 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66) to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.500473 14966 raft_consensus.cc:993] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6: : Instructing follower 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:30.500985 14964 raft_consensus.cc:1081] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Signalling peer 90623b8327d2492eacfa011b104c2eb2 to start an election
I20260709 13:16:30.502429 14785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24"
dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
 from {username='slave'} at 127.0.0.1:40946
I20260709 13:16:30.502943 14785 raft_consensus.cc:493] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.503230 14785 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.507334 14785 raft_consensus.cc:515] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.508919 14785 leader_election.cc:290] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 3 election: Requested vote from peers fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609), 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553)
I20260709 13:16:30.509969 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:30.509872 14636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b979bcc7ccc4fc99d3104f7a7ad6b24" candidate_uuid: "90623b8327d2492eacfa011b104c2eb2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
I20260709 13:16:30.510556 14636 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.510514 14711 raft_consensus.cc:3055] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:30.511024 14711 raft_consensus.cc:740] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:30.511799 14711 consensus_queue.cc:260] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.512991 14711 raft_consensus.cc:3060] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.517084 14636 raft_consensus.cc:2468] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 3.
I20260709 13:16:30.518364 14750 leader_election.cc:304] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:30.519042 14711 raft_consensus.cc:2468] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90623b8327d2492eacfa011b104c2eb2 in term 3.
I20260709 13:16:30.519177 14929 raft_consensus.cc:2804] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:30.519678 14929 raft_consensus.cc:697] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 3 LEADER]: Becoming Leader. State: Replica: 90623b8327d2492eacfa011b104c2eb2, State: Running, Role: LEADER
I20260709 13:16:30.520540 14929 consensus_queue.cc:237] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.527943 14532 catalog_manager.cc:5697] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 reported cstate change: term changed from 2 to 3, leader changed from 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66) to 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "90623b8327d2492eacfa011b104c2eb2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.555357 14966 raft_consensus.cc:993] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: : Instructing follower fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:30.555759 14964 raft_consensus.cc:1081] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Signalling peer fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:30.557297 14636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:50524
I20260709 13:16:30.557770 14636 raft_consensus.cc:493] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.558105 14636 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.562973 14636 raft_consensus.cc:515] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.564499 14636 leader_election.cc:290] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 4 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:30.565586 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:30.565609 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da2bfe43b654b12ac0c16a7a9e680aa" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:30.566150 14785 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.566224 14711 raft_consensus.cc:3055] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:30.566568 14711 raft_consensus.cc:740] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:30.567225 14711 consensus_queue.cc:260] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.568378 14711 raft_consensus.cc:3060] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:30.570621 14785 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 4.
I20260709 13:16:30.571851 14599 leader_election.cc:304] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:30.572995 14711 raft_consensus.cc:2468] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 4.
I20260709 13:16:30.573769 14974 raft_consensus.cc:2804] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:30.574904 14974 raft_consensus.cc:697] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:30.575718 14974 consensus_queue.cc:237] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.582667 14532 catalog_manager.cc:5697] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 3 to 4, leader changed from 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66) to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.714969 14966 raft_consensus.cc:993] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: : Instructing follower fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:30.715443 14964 raft_consensus.cc:1081] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Signalling peer fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:30.716945 14636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:50524
I20260709 13:16:30.717402 14636 raft_consensus.cc:493] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.717655 14636 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.722723 14636 raft_consensus.cc:515] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.724165 14636 leader_election.cc:290] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 3 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:30.725100 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:30.725246 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2f562011642a3ae5c4a0f868fc231" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:30.725574 14711 raft_consensus.cc:3055] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:30.725739 14785 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.725849 14711 raft_consensus.cc:740] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:30.726568 14711 consensus_queue.cc:260] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.727385 14711 raft_consensus.cc:3060] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.730001 14785 raft_consensus.cc:2468] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 3.
I20260709 13:16:30.730993 14599 leader_election.cc:304] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:30.731662 14711 raft_consensus.cc:2468] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 3.
I20260709 13:16:30.731824 14974 raft_consensus.cc:2804] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:30.732336 14974 raft_consensus.cc:697] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:30.733290 14974 consensus_queue.cc:237] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.739614 14532 catalog_manager.cc:5697] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 2 to 3, leader changed from 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66) to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.845112 14711 raft_consensus.cc:1275] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:30.846645 14929 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:30.858206 14636 raft_consensus.cc:1275] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:30.860677 14981 consensus_queue.cc:1048] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:30.890872 14966 raft_consensus.cc:993] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6: : Instructing follower fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:30.891291 14964 raft_consensus.cc:1081] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Signalling peer fe3d690f9d9a41b6b09dfde5a0a01830 to start an election
I20260709 13:16:30.892863 14636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce"
dest_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830"
 from {username='slave'} at 127.0.0.1:50524
I20260709 13:16:30.893278 14636 raft_consensus.cc:493] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:30.893509 14636 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.897768 14636 raft_consensus.cc:515] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.899206 14636 leader_election.cc:290] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 3 election: Requested vote from peers 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553), 90623b8327d2492eacfa011b104c2eb2 (127.14.41.67:33381)
I20260709 13:16:30.900161 14711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d7c2858f55c4bb888941715bdb89bf6"
I20260709 13:16:30.900278 14785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18481a30c7794345b086f3f2a95c7dce" candidate_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90623b8327d2492eacfa011b104c2eb2"
I20260709 13:16:30.900692 14711 raft_consensus.cc:3055] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:30.900858 14785 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.901016 14711 raft_consensus.cc:740] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d7c2858f55c4bb888941715bdb89bf6, State: Running, Role: LEADER
I20260709 13:16:30.901825 14711 consensus_queue.cc:260] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.902724 14711 raft_consensus.cc:3060] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:30.905364 14785 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 3.
I20260709 13:16:30.906373 14599 leader_election.cc:304] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90623b8327d2492eacfa011b104c2eb2, fe3d690f9d9a41b6b09dfde5a0a01830; no voters: 
I20260709 13:16:30.906936 14711 raft_consensus.cc:2468] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe3d690f9d9a41b6b09dfde5a0a01830 in term 3.
I20260709 13:16:30.907076 14974 raft_consensus.cc:2804] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:30.907588 14974 raft_consensus.cc:697] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 LEADER]: Becoming Leader. State: Replica: fe3d690f9d9a41b6b09dfde5a0a01830, State: Running, Role: LEADER
I20260709 13:16:30.908372 14974 consensus_queue.cc:237] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } }
I20260709 13:16:30.915414 14530 catalog_manager.cc:5697] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 reported cstate change: term changed from 2 to 3, leader changed from 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66) to fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.019639 14785 raft_consensus.cc:1275] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:31.020876 14974 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:31.031642 14711 raft_consensus.cc:1275] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:31.034075 14986 consensus_queue.cc:1048] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:31.034951 14636 raft_consensus.cc:1275] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:31.036196 14981 consensus_queue.cc:1048] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe3d690f9d9a41b6b09dfde5a0a01830" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 46609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.047500 14711 raft_consensus.cc:1275] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Refusing update from remote peer 90623b8327d2492eacfa011b104c2eb2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:31.054193 14981 consensus_queue.cc:1048] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.116390 14711 raft_consensus.cc:1275] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:31.117733 14986 consensus_queue.cc:1048] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.126286 14785 raft_consensus.cc:1275] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:31.127641 14974 consensus_queue.cc:1048] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.296303 14711 raft_consensus.cc:1275] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:31.297678 14975 consensus_queue.cc:1048] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7c2858f55c4bb888941715bdb89bf6" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 39553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.306087 14785 raft_consensus.cc:1275] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Refusing update from remote peer fe3d690f9d9a41b6b09dfde5a0a01830: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:31.307776 14975 consensus_queue.cc:1048] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90623b8327d2492eacfa011b104c2eb2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 33381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.406582 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:31.412089 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
I20260709 13:16:31.441902 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:31.442730 14501 tablet_replica.cc:333] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.443408 14501 raft_consensus.cc:2243] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.444188 14501 raft_consensus.cc:2272] T 0da2bfe43b654b12ac0c16a7a9e680aa P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.446771 14501 tablet_replica.cc:333] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.447299 14501 raft_consensus.cc:2243] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.447746 14501 raft_consensus.cc:2272] T 02975c85bcfd4326924f80cd0a816669 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.449376 14501 tablet_replica.cc:333] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.449843 14501 raft_consensus.cc:2243] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.450271 14501 raft_consensus.cc:2272] T 38540bf90c9a40f9a59fb00b24079447 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.451975 14501 tablet_replica.cc:333] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.452466 14501 raft_consensus.cc:2243] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.452936 14501 raft_consensus.cc:2272] T 7ba4e82c54f948b0a98479cbb7ab44a9 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.454645 14501 tablet_replica.cc:333] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.455120 14501 raft_consensus.cc:2243] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.455507 14501 raft_consensus.cc:2272] T 365fda54d9354130af1649cad7b26397 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.457803 14501 tablet_replica.cc:333] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.458335 14501 raft_consensus.cc:2243] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.458811 14501 raft_consensus.cc:2272] T d5a170da421046f0b3e0f2b4c3823aa6 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:31.459990 14750 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:16:31.461012 14501 tablet_replica.cc:333] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.461653 14501 raft_consensus.cc:2243] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.462379 14501 raft_consensus.cc:2272] T 17b2f562011642a3ae5c4a0f868fc231 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:31.463357 14750 consensus_peers.cc:597] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 -> Peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Couldn't send request to peer fe3d690f9d9a41b6b09dfde5a0a01830. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:31.464358 14501 tablet_replica.cc:333] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.464887 14501 raft_consensus.cc:2243] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.465582 14501 raft_consensus.cc:2272] T 18481a30c7794345b086f3f2a95c7dce P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.467353 14501 tablet_replica.cc:333] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830: stopping tablet replica
I20260709 13:16:31.467796 14501 raft_consensus.cc:2243] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.468219 14501 raft_consensus.cc:2272] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P fe3d690f9d9a41b6b09dfde5a0a01830 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.566383 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
I20260709 13:16:31.584987 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
W20260709 13:16:31.592996 14750 consensus_peers.cc:597] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 -> Peer fe3d690f9d9a41b6b09dfde5a0a01830 (127.14.41.65:46609): Couldn't send request to peer fe3d690f9d9a41b6b09dfde5a0a01830. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:46609: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:31.614459 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:31.615078 14501 tablet_replica.cc:333] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.615633 14501 raft_consensus.cc:2243] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.616039 14501 raft_consensus.cc:2272] T 02975c85bcfd4326924f80cd0a816669 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.617848 14501 tablet_replica.cc:333] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.618427 14501 raft_consensus.cc:2243] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.619140 14501 raft_consensus.cc:2272] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.621050 14501 tablet_replica.cc:333] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.621737 14501 raft_consensus.cc:2243] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.622879 14501 raft_consensus.cc:2272] T d5a170da421046f0b3e0f2b4c3823aa6 P 0d7c2858f55c4bb888941715bdb89bf6 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:31.624938 14751 consensus_peers.cc:597] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 -> Peer 0d7c2858f55c4bb888941715bdb89bf6 (127.14.41.66:39553): Couldn't send request to peer 0d7c2858f55c4bb888941715bdb89bf6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:31.625264 14501 tablet_replica.cc:333] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.625837 14501 raft_consensus.cc:2243] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.626242 14501 raft_consensus.cc:2272] T 365fda54d9354130af1649cad7b26397 P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.628779 14501 tablet_replica.cc:333] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.629276 14501 raft_consensus.cc:2243] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.629691 14501 raft_consensus.cc:2272] T 17b2f562011642a3ae5c4a0f868fc231 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.631944 14501 tablet_replica.cc:333] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.632470 14501 raft_consensus.cc:2243] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.632922 14501 raft_consensus.cc:2272] T 18481a30c7794345b086f3f2a95c7dce P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.635028 14501 tablet_replica.cc:333] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.635499 14501 raft_consensus.cc:2243] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.635914 14501 raft_consensus.cc:2272] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 0d7c2858f55c4bb888941715bdb89bf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.637909 14501 tablet_replica.cc:333] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.638382 14501 raft_consensus.cc:2243] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.639086 14501 raft_consensus.cc:2272] T 38540bf90c9a40f9a59fb00b24079447 P 0d7c2858f55c4bb888941715bdb89bf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.640789 14501 tablet_replica.cc:333] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6: stopping tablet replica
I20260709 13:16:31.641215 14501 raft_consensus.cc:2243] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.641597 14501 raft_consensus.cc:2272] T 0da2bfe43b654b12ac0c16a7a9e680aa P 0d7c2858f55c4bb888941715bdb89bf6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.668555 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
I20260709 13:16:31.687017 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
I20260709 13:16:31.713104 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:31.713762 14501 tablet_replica.cc:333] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.714385 14501 raft_consensus.cc:2243] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.714869 14501 raft_consensus.cc:2272] T 38540bf90c9a40f9a59fb00b24079447 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.716573 14501 tablet_replica.cc:333] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.717155 14501 raft_consensus.cc:2243] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.717885 14501 raft_consensus.cc:2272] T 0b979bcc7ccc4fc99d3104f7a7ad6b24 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.719956 14501 tablet_replica.cc:333] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.720446 14501 raft_consensus.cc:2243] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.721226 14501 raft_consensus.cc:2272] T 02975c85bcfd4326924f80cd0a816669 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.722877 14501 tablet_replica.cc:333] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.723352 14501 raft_consensus.cc:2243] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.723747 14501 raft_consensus.cc:2272] T 7ba4e82c54f948b0a98479cbb7ab44a9 P 90623b8327d2492eacfa011b104c2eb2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.725417 14501 tablet_replica.cc:333] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.725874 14501 raft_consensus.cc:2243] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.726267 14501 raft_consensus.cc:2272] T 0da2bfe43b654b12ac0c16a7a9e680aa P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.728827 14501 tablet_replica.cc:333] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.729324 14501 raft_consensus.cc:2243] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.729766 14501 raft_consensus.cc:2272] T 18481a30c7794345b086f3f2a95c7dce P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.731781 14501 tablet_replica.cc:333] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.732244 14501 raft_consensus.cc:2243] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.732712 14501 raft_consensus.cc:2272] T 17b2f562011642a3ae5c4a0f868fc231 P 90623b8327d2492eacfa011b104c2eb2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.734544 14501 tablet_replica.cc:333] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.735011 14501 raft_consensus.cc:2243] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.735682 14501 raft_consensus.cc:2272] T 365fda54d9354130af1649cad7b26397 P 90623b8327d2492eacfa011b104c2eb2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.737489 14501 tablet_replica.cc:333] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2: stopping tablet replica
I20260709 13:16:31.737933 14501 raft_consensus.cc:2243] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:31.738324 14501 raft_consensus.cc:2272] T d5a170da421046f0b3e0f2b4c3823aa6 P 90623b8327d2492eacfa011b104c2eb2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.763873 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:16:31.780702 14501 master.cc:562] Master@127.14.41.126:34561 shutting down...
I20260709 13:16:31.882869 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:31.883419 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:31.883780 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1aec0c5dfa4049ef9a416622b3ef0cae: stopping tablet replica
I20260709 13:16:31.903517 14501 master.cc:584] Master@127.14.41.126:34561 shutdown complete.
0d7c2858f55c4bb888941715bdb89bf6  5
90623b8327d2492eacfa011b104c2eb2  1
fe3d690f9d9a41b6b09dfde5a0a01830  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12471 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:16:31.943343 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:35819
I20260709 13:16:31.944494 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:31.949538 14997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:31.951081 14998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:31.951316 14501 server_base.cc:1061] running on GCE node
W20260709 13:16:31.951308 15000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:31.952411 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:31.952646 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:31.952816 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602991952798 us; error 0 us; skew 500 ppm
I20260709 13:16:31.953333 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:31.955713 14501 webserver.cc:533] Webserver started at http://127.14.41.126:33349/ using document root <none> and password file <none>
I20260709 13:16:31.956209 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:31.956419 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:31.956755 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:31.957883 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "fcbc744defce404fb775333e2ef2742e"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-56lb"
I20260709 13:16:31.962117 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:16:31.965369 15005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:31.966082 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:16:31.966367 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "fcbc744defce404fb775333e2ef2742e"
format_stamp: "Formatted at 2026-07-09 13:16:31 on dist-test-slave-56lb"
I20260709 13:16:31.966653 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:31.978783 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:31.980029 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.018790 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:35819
I20260709 13:16:32.018887 15056 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:35819 every 8 connection(s)
I20260709 13:16:32.022680 15057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.032025 15057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e: Bootstrap starting.
I20260709 13:16:32.036723 15057 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.040918 15057 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e: No bootstrap required, opened a new log
I20260709 13:16:32.043164 15057 raft_consensus.cc:359] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcbc744defce404fb775333e2ef2742e" member_type: VOTER }
I20260709 13:16:32.043540 15057 raft_consensus.cc:385] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.043793 15057 raft_consensus.cc:740] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcbc744defce404fb775333e2ef2742e, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.044452 15057 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcbc744defce404fb775333e2ef2742e" member_type: VOTER }
I20260709 13:16:32.044965 15057 raft_consensus.cc:399] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:32.045185 15057 raft_consensus.cc:493] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:32.045459 15057 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.049551 15057 raft_consensus.cc:515] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcbc744defce404fb775333e2ef2742e" member_type: VOTER }
I20260709 13:16:32.050124 15057 leader_election.cc:304] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcbc744defce404fb775333e2ef2742e; no voters: 
I20260709 13:16:32.051268 15057 leader_election.cc:290] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:32.051674 15060 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.053057 15060 raft_consensus.cc:697] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 1 LEADER]: Becoming Leader. State: Replica: fcbc744defce404fb775333e2ef2742e, State: Running, Role: LEADER
I20260709 13:16:32.053781 15060 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcbc744defce404fb775333e2ef2742e" member_type: VOTER }
I20260709 13:16:32.054327 15057 sys_catalog.cc:565] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:32.058750 15061 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcbc744defce404fb775333e2ef2742e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcbc744defce404fb775333e2ef2742e" member_type: VOTER } }
I20260709 13:16:32.060133 15061 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:32.059864 15062 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcbc744defce404fb775333e2ef2742e. Latest consensus state: current_term: 1 leader_uuid: "fcbc744defce404fb775333e2ef2742e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcbc744defce404fb775333e2ef2742e" member_type: VOTER } }
I20260709 13:16:32.060693 15062 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:32.062162 15068 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:32.067289 15068 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:32.071606 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:32.076161 15068 catalog_manager.cc:1383] Generated new cluster ID: 876e7d51caff4faebb122077dc83f96e
I20260709 13:16:32.076493 15068 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:32.092698 15068 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:32.093959 15068 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:32.107601 15068 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e: Generated new TSK 0
I20260709 13:16:32.108228 15068 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:32.138006 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:32.144042 15078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.145433 15079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.146199 15081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.146628 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:32.147380 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:32.147549 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:32.147676 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602992147665 us; error 0 us; skew 500 ppm
I20260709 13:16:32.148114 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:32.150270 14501 webserver.cc:533] Webserver started at http://127.14.41.65:45673/ using document root <none> and password file <none>
I20260709 13:16:32.150717 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:32.150868 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:32.151072 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:32.152067 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-56lb"
I20260709 13:16:32.156461 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:16:32.159677 15086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.160454 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:16:32.160790 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-56lb"
I20260709 13:16:32.161042 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:32.171343 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:32.172565 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.174016 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:32.176222 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:32.176401 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.176576 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:32.176764 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:16:32.217142 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:38397
I20260709 13:16:32.217275 15148 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:38397 every 8 connection(s)
I20260709 13:16:32.222034 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:32.229288 15153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.230757 15154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.234134 15156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.234877 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:32.236176 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:32.236404 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:32.236575 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602992236560 us; error 0 us; skew 500 ppm
I20260709 13:16:32.237144 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:32.240097 14501 webserver.cc:533] Webserver started at http://127.14.41.66:42127/ using document root <none> and password file <none>
I20260709 13:16:32.240787 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:32.241034 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:32.241349 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:32.241969 15149 heartbeater.cc:344] Connected to a master server at 127.14.41.126:35819
I20260709 13:16:32.242414 15149 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:32.242728 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "dc9ebec2cc424110b05846fe152c46e8"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-56lb"
I20260709 13:16:32.243188 15149 heartbeater.cc:507] Master 127.14.41.126:35819 requested a full tablet report, sending...
I20260709 13:16:32.245376 15022 ts_manager.cc:194] Registered new tserver with Master: 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397)
I20260709 13:16:32.247082 15022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49914
I20260709 13:16:32.247776 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:32.251219 15161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.252058 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:32.252336 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "dc9ebec2cc424110b05846fe152c46e8"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-56lb"
I20260709 13:16:32.252573 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:32.268071 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:32.269470 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.270890 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:32.273092 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:32.273334 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.273571 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:32.273734 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.312999 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:36351
I20260709 13:16:32.313110 15223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:36351 every 8 connection(s)
I20260709 13:16:32.317823 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:32.324972 15227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.325721 15228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:32.329012 15230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:32.329468 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:32.330366 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:32.330597 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:32.330807 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783602992330787 us; error 0 us; skew 500 ppm
I20260709 13:16:32.330899 15224 heartbeater.cc:344] Connected to a master server at 127.14.41.126:35819
I20260709 13:16:32.331290 15224 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:32.331497 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:32.332026 15224 heartbeater.cc:507] Master 127.14.41.126:35819 requested a full tablet report, sending...
I20260709 13:16:32.334234 14501 webserver.cc:533] Webserver started at http://127.14.41.67:40731/ using document root <none> and password file <none>
I20260709 13:16:32.334216 15022 ts_manager.cc:194] Registered new tserver with Master: dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:32.334904 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:32.335139 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:32.335405 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:32.335824 15022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49918
I20260709 13:16:32.336565 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-56lb"
I20260709 13:16:32.341056 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:16:32.344466 15235 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.345281 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:32.345604 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
format_stamp: "Formatted at 2026-07-09 13:16:32 on dist-test-slave-56lb"
I20260709 13:16:32.345919 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:32.360069 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:32.361397 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:32.363057 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:32.365384 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:32.365610 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.365847 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:32.366014 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:32.410015 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:35859
I20260709 13:16:32.410102 15297 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:35859 every 8 connection(s)
I20260709 13:16:32.423441 15298 heartbeater.cc:344] Connected to a master server at 127.14.41.126:35819
I20260709 13:16:32.423861 15298 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:32.424752 15298 heartbeater.cc:507] Master 127.14.41.126:35819 requested a full tablet report, sending...
I20260709 13:16:32.426893 15022 ts_manager.cc:194] Registered new tserver with Master: d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:32.427881 14501 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014698868s
I20260709 13:16:32.428457 15022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49920
I20260709 13:16:32.453110 15022 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49930:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:32.456089 15022 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:32.532809 15114 tablet_service.cc:1511] Processing CreateTablet for tablet 18050e7c7a744e5d890bdaa4e8fa0a5c (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:32.534354 15114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18050e7c7a744e5d890bdaa4e8fa0a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.537382 15112 tablet_service.cc:1511] Processing CreateTablet for tablet 31d13ff3608946869c9f0c9d2dbb409a (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:32.538971 15112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d13ff3608946869c9f0c9d2dbb409a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.541450 15113 tablet_service.cc:1511] Processing CreateTablet for tablet c57f1254f5cc4df38dd28f480e80a8d6 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:32.542956 15262 tablet_service.cc:1511] Processing CreateTablet for tablet c57f1254f5cc4df38dd28f480e80a8d6 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:32.543154 15261 tablet_service.cc:1511] Processing CreateTablet for tablet 31d13ff3608946869c9f0c9d2dbb409a (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:32.544370 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57f1254f5cc4df38dd28f480e80a8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.545732 15188 tablet_service.cc:1511] Processing CreateTablet for tablet c57f1254f5cc4df38dd28f480e80a8d6 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:16:32.546722 15261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d13ff3608946869c9f0c9d2dbb409a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.547191 15188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57f1254f5cc4df38dd28f480e80a8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.545739 15187 tablet_service.cc:1511] Processing CreateTablet for tablet 31d13ff3608946869c9f0c9d2dbb409a (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:16:32.549530 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31d13ff3608946869c9f0c9d2dbb409a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.549870 15189 tablet_service.cc:1511] Processing CreateTablet for tablet 18050e7c7a744e5d890bdaa4e8fa0a5c (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:32.543990 15263 tablet_service.cc:1511] Processing CreateTablet for tablet 18050e7c7a744e5d890bdaa4e8fa0a5c (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:16:32.551187 15189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18050e7c7a744e5d890bdaa4e8fa0a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.551973 15263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18050e7c7a744e5d890bdaa4e8fa0a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.552886 15113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c57f1254f5cc4df38dd28f480e80a8d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.562067 15111 tablet_service.cc:1511] Processing CreateTablet for tablet 8e128b3830c649818b474d995ca3f9b6 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:32.563491 15111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e128b3830c649818b474d995ca3f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.575932 15186 tablet_service.cc:1511] Processing CreateTablet for tablet 8e128b3830c649818b474d995ca3f9b6 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:32.577780 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e128b3830c649818b474d995ca3f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.579553 15260 tablet_service.cc:1511] Processing CreateTablet for tablet 8e128b3830c649818b474d995ca3f9b6 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:16:32.581328 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e128b3830c649818b474d995ca3f9b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.593573 15313 tablet_bootstrap.cc:492] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:32.601717 15314 tablet_bootstrap.cc:492] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:32.604244 15185 tablet_service.cc:1511] Processing CreateTablet for tablet 5888b8d696f4407b901fe38539a1d91f (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:32.605847 15185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5888b8d696f4407b901fe38539a1d91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.605677 15259 tablet_service.cc:1511] Processing CreateTablet for tablet 5888b8d696f4407b901fe38539a1d91f (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:32.607059 15259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5888b8d696f4407b901fe38539a1d91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.610651 15314 tablet_bootstrap.cc:654] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.619330 15313 tablet_bootstrap.cc:654] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.603195 15112 tablet_service.cc:1511] Processing CreateTablet for tablet 5888b8d696f4407b901fe38539a1d91f (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:16:32.620863 15112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5888b8d696f4407b901fe38539a1d91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.638995 15114 tablet_service.cc:1511] Processing CreateTablet for tablet 98f022702d97442d8602d3e82abb2f1b (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:32.640903 15114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f022702d97442d8602d3e82abb2f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.651351 15186 tablet_service.cc:1511] Processing CreateTablet for tablet 98f022702d97442d8602d3e82abb2f1b (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:32.652256 15263 tablet_service.cc:1511] Processing CreateTablet for tablet 98f022702d97442d8602d3e82abb2f1b (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:16:32.653375 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f022702d97442d8602d3e82abb2f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.656718 15263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98f022702d97442d8602d3e82abb2f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.658001 15187 tablet_service.cc:1511] Processing CreateTablet for tablet b46a09f1bea7442f8c88ea4cda3c092f (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:32.659751 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46a09f1bea7442f8c88ea4cda3c092f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.665385 15259 tablet_service.cc:1511] Processing CreateTablet for tablet b46a09f1bea7442f8c88ea4cda3c092f (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:32.666159 15113 tablet_service.cc:1511] Processing CreateTablet for tablet b46a09f1bea7442f8c88ea4cda3c092f (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:16:32.666712 15259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46a09f1bea7442f8c88ea4cda3c092f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.667382 15113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46a09f1bea7442f8c88ea4cda3c092f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.672281 15189 tablet_service.cc:1511] Processing CreateTablet for tablet 96d2e5e8e52d494db194a885d75a9c86 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:32.673620 15189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d2e5e8e52d494db194a885d75a9c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.673491 15262 tablet_service.cc:1511] Processing CreateTablet for tablet 96d2e5e8e52d494db194a885d75a9c86 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:32.674729 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d2e5e8e52d494db194a885d75a9c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.678385 15112 tablet_service.cc:1511] Processing CreateTablet for tablet 96d2e5e8e52d494db194a885d75a9c86 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:16:32.679643 15112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d2e5e8e52d494db194a885d75a9c86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.665395 15315 tablet_bootstrap.cc:492] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:32.681988 15314 tablet_bootstrap.cc:492] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:32.682457 15314 ts_tablet_manager.cc:1403] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.011s
I20260709 13:16:32.685472 15313 tablet_bootstrap.cc:492] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:32.685935 15313 ts_tablet_manager.cc:1403] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.014s
I20260709 13:16:32.686776 15111 tablet_service.cc:1511] Processing CreateTablet for tablet c7fe7f03e9574229876893f65655b92e (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:32.688058 15111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7fe7f03e9574229876893f65655b92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.689173 15188 tablet_service.cc:1511] Processing CreateTablet for tablet c7fe7f03e9574229876893f65655b92e (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:32.690412 15188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7fe7f03e9574229876893f65655b92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.690217 15314 raft_consensus.cc:359] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.690346 15260 tablet_service.cc:1511] Processing CreateTablet for tablet c7fe7f03e9574229876893f65655b92e (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:16:32.690965 15314 raft_consensus.cc:385] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.691279 15314 raft_consensus.cc:740] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.691565 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7fe7f03e9574229876893f65655b92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.700259 15315 tablet_bootstrap.cc:654] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.692255 15313 raft_consensus.cc:359] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.701069 15313 raft_consensus.cc:385] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.701404 15313 raft_consensus.cc:740] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.702276 15313 consensus_queue.cc:260] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.703639 15314 consensus_queue.cc:260] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.712206 15184 tablet_service.cc:1511] Processing CreateTablet for tablet 2216c45c25474faeae0bc0e53f28eac9 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:32.713671 15184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2216c45c25474faeae0bc0e53f28eac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.713517 15261 tablet_service.cc:1511] Processing CreateTablet for tablet 2216c45c25474faeae0bc0e53f28eac9 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:32.714846 15261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2216c45c25474faeae0bc0e53f28eac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.718020 15114 tablet_service.cc:1511] Processing CreateTablet for tablet 2216c45c25474faeae0bc0e53f28eac9 (DEFAULT_TABLE table=test-workload [id=8c066b639de64371a830d3f3381a9b28]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:16:32.719676 15114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2216c45c25474faeae0bc0e53f28eac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:32.734206 15314 ts_tablet_manager.cc:1434] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.051s	user 0.001s	sys 0.010s
I20260709 13:16:32.742241 15149 heartbeater.cc:499] Master 127.14.41.126:35819 was elected leader, sending a full tablet report...
I20260709 13:16:32.756294 15315 tablet_bootstrap.cc:492] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:32.756816 15315 ts_tablet_manager.cc:1403] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.092s	user 0.003s	sys 0.012s
I20260709 13:16:32.760125 15315 raft_consensus.cc:359] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.760905 15315 raft_consensus.cc:385] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.760946 15224 heartbeater.cc:499] Master 127.14.41.126:35819 was elected leader, sending a full tablet report...
I20260709 13:16:32.761322 15315 raft_consensus.cc:740] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.762362 15315 consensus_queue.cc:260] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.774595 15313 ts_tablet_manager.cc:1434] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.002s
I20260709 13:16:32.775771 15313 tablet_bootstrap.cc:492] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:32.778715 15314 tablet_bootstrap.cc:492] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:32.786644 15314 tablet_bootstrap.cc:654] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.797924 15313 tablet_bootstrap.cc:654] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.798524 15314 tablet_bootstrap.cc:492] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:32.799124 15314 ts_tablet_manager.cc:1403] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.002s
I20260709 13:16:32.802269 15318 raft_consensus.cc:493] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.803262 15298 heartbeater.cc:499] Master 127.14.41.126:35819 was elected leader, sending a full tablet report...
I20260709 13:16:32.802881 15318 raft_consensus.cc:515] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.804258 15315 ts_tablet_manager.cc:1434] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.047s	user 0.020s	sys 0.024s
I20260709 13:16:32.804236 15314 raft_consensus.cc:359] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.805251 15314 raft_consensus.cc:385] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.805377 15315 tablet_bootstrap.cc:492] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:32.805683 15314 raft_consensus.cc:740] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.806509 15314 consensus_queue.cc:260] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.808722 15314 ts_tablet_manager.cc:1434] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:16:32.809738 15314 tablet_bootstrap.cc:492] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:32.815871 15318 leader_election.cc:290] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:32.818850 15314 tablet_bootstrap.cc:654] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.822307 15315 tablet_bootstrap.cc:654] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.836926 15314 tablet_bootstrap.cc:492] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:32.837539 15314 ts_tablet_manager.cc:1403] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 13:16:32.837450 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
W20260709 13:16:32.839363 15089 leader_election.cc:343] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.840993 15314 raft_consensus.cc:359] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.841429 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:32.841841 15314 raft_consensus.cc:385] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.842211 15199 raft_consensus.cc:2468] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 0.
I20260709 13:16:32.842818 15313 tablet_bootstrap.cc:492] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:32.842310 15314 raft_consensus.cc:740] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.843639 15090 leader_election.cc:304] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:32.844758 15318 raft_consensus.cc:2804] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:32.844151 15314 consensus_queue.cc:260] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.845117 15318 raft_consensus.cc:493] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.845570 15318 raft_consensus.cc:3060] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.849992 15314 ts_tablet_manager.cc:1434] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:32.850523 15315 tablet_bootstrap.cc:492] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:32.851018 15315 ts_tablet_manager.cc:1403] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.011s
I20260709 13:16:32.851075 15314 tablet_bootstrap.cc:492] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:32.843346 15313 ts_tablet_manager.cc:1403] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.013s
I20260709 13:16:32.852481 15318 raft_consensus.cc:515] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.854372 15315 raft_consensus.cc:359] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.855152 15315 raft_consensus.cc:385] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.855333 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:32.855489 15315 raft_consensus.cc:740] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.855541 15313 raft_consensus.cc:359] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.856549 15313 raft_consensus.cc:385] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.856876 15313 raft_consensus.cc:740] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
W20260709 13:16:32.856936 15089 leader_election.cc:343] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:32.856805 15315 consensus_queue.cc:260] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.857963 15313 consensus_queue.cc:260] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.859566 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:32.860364 15199 raft_consensus.cc:3060] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:32.862425 15315 ts_tablet_manager.cc:1434] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:16:32.863747 15315 tablet_bootstrap.cc:492] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:32.868765 15318 leader_election.cc:290] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 election: Requested vote from peers d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:32.870092 15314 tablet_bootstrap.cc:654] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.872018 15199 raft_consensus.cc:2468] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 1.
I20260709 13:16:32.878135 15315 tablet_bootstrap.cc:654] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.877979 15090 leader_election.cc:304] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:32.879721 15318 raft_consensus.cc:2804] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:32.880456 15318 raft_consensus.cc:697] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:32.881682 15318 consensus_queue.cc:237] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.883989 15313 ts_tablet_manager.cc:1434] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.025s
I20260709 13:16:32.885002 15313 tablet_bootstrap.cc:492] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:32.892061 15314 tablet_bootstrap.cc:492] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:32.892283 15313 tablet_bootstrap.cc:654] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.892848 15314 ts_tablet_manager.cc:1403] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.002s
I20260709 13:16:32.897375 15314 raft_consensus.cc:359] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.898231 15314 raft_consensus.cc:385] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.898547 15314 raft_consensus.cc:740] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.898732 15315 tablet_bootstrap.cc:492] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:32.899255 15315 ts_tablet_manager.cc:1403] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.007s
I20260709 13:16:32.900274 15314 consensus_queue.cc:260] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.900408 15021 catalog_manager.cc:5697] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 1 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.902493 15315 raft_consensus.cc:359] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.903306 15315 raft_consensus.cc:385] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.903640 15315 raft_consensus.cc:740] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.904641 15315 consensus_queue.cc:260] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.906030 15314 ts_tablet_manager.cc:1434] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:16:32.907008 15314 tablet_bootstrap.cc:492] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:32.907313 15315 ts_tablet_manager.cc:1434] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:32.908391 15315 tablet_bootstrap.cc:492] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:32.915391 15315 tablet_bootstrap.cc:654] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.917508 15314 tablet_bootstrap.cc:654] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.922839 15313 tablet_bootstrap.cc:492] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:32.923309 15315 tablet_bootstrap.cc:492] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:32.923383 15313 ts_tablet_manager.cc:1403] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.015s
I20260709 13:16:32.923965 15315 ts_tablet_manager.cc:1403] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.002s
I20260709 13:16:32.925813 15314 tablet_bootstrap.cc:492] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:32.926287 15314 ts_tablet_manager.cc:1403] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:16:32.926275 15313 raft_consensus.cc:359] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.927031 15313 raft_consensus.cc:385] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.926690 15315 raft_consensus.cc:359] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.927315 15313 raft_consensus.cc:740] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.927443 15315 raft_consensus.cc:385] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.927804 15315 raft_consensus.cc:740] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.928155 15313 consensus_queue.cc:260] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.928539 15315 consensus_queue.cc:260] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:32.929330 15314 raft_consensus.cc:359] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.929981 15314 raft_consensus.cc:385] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.930279 15314 raft_consensus.cc:740] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.930683 15313 ts_tablet_manager.cc:1434] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:32.931046 15315 ts_tablet_manager.cc:1434] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:32.931105 15314 consensus_queue.cc:260] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.931842 15313 tablet_bootstrap.cc:492] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:32.932071 15315 tablet_bootstrap.cc:492] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:32.938130 15314 ts_tablet_manager.cc:1434] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:32.938525 15315 tablet_bootstrap.cc:654] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.939194 15314 tablet_bootstrap.cc:492] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:32.939294 15313 tablet_bootstrap.cc:654] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.952226 15313 tablet_bootstrap.cc:492] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:32.952787 15313 ts_tablet_manager.cc:1403] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 13:16:32.955873 15313 raft_consensus.cc:359] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.956719 15313 raft_consensus.cc:385] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.957060 15313 raft_consensus.cc:740] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.958092 15313 consensus_queue.cc:260] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.960218 15314 tablet_bootstrap.cc:654] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.960862 15313 ts_tablet_manager.cc:1434] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:32.962175 15321 raft_consensus.cc:493] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.962674 15321 raft_consensus.cc:515] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.964396 15313 tablet_bootstrap.cc:492] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:32.968218 15321 leader_election.cc:290] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:32.972239 15313 tablet_bootstrap.cc:654] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:32.976440 15315 tablet_bootstrap.cc:492] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:32.977046 15315 ts_tablet_manager.cc:1403] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.007s
I20260709 13:16:32.988157 15314 tablet_bootstrap.cc:492] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:32.988734 15314 ts_tablet_manager.cc:1403] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.014s
I20260709 13:16:32.980475 15315 raft_consensus.cc:359] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.990701 15315 raft_consensus.cc:385] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.991024 15315 raft_consensus.cc:740] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.991812 15315 consensus_queue.cc:260] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.994540 15313 tablet_bootstrap.cc:492] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:32.995023 15313 ts_tablet_manager.cc:1403] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.012s
I20260709 13:16:32.997439 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:32.998143 15124 raft_consensus.cc:2468] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 0.
I20260709 13:16:32.997977 15313 raft_consensus.cc:359] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.998709 15313 raft_consensus.cc:385] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.999014 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:32.999264 15314 raft_consensus.cc:359] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:32.999017 15313 raft_consensus.cc:740] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.999974 15314 raft_consensus.cc:385] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:32.999745 15199 raft_consensus.cc:2468] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 0.
I20260709 13:16:33.000871 15313 consensus_queue.cc:260] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.000398 15314 raft_consensus.cc:740] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:32.999704 15238 leader_election.cc:304] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:33.002480 15321 raft_consensus.cc:2804] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.002352 15314 consensus_queue.cc:260] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.002828 15321 raft_consensus.cc:493] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.003690 15313 ts_tablet_manager.cc:1434] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:33.010735 15319 raft_consensus.cc:493] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.014148 15321 raft_consensus.cc:3060] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.014542 15319 raft_consensus.cc:515] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.015293 15313 tablet_bootstrap.cc:492] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:33.022642 15319 leader_election.cc:290] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.025872 15313 tablet_bootstrap.cc:654] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.002266 15315 ts_tablet_manager.cc:1434] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:16:33.032963 15315 tablet_bootstrap.cc:492] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:33.039868 15321 raft_consensus.cc:515] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.043217 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.045125 15124 raft_consensus.cc:3060] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.053192 15124 raft_consensus.cc:2468] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 1.
I20260709 13:16:33.054499 15238 leader_election.cc:304] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:33.066632 15314 ts_tablet_manager.cc:1434] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.078s	user 0.015s	sys 0.048s
W20260709 13:16:33.067405 15070 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:33.067816 15314 tablet_bootstrap.cc:492] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:33.068714 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:33.069597 15199 raft_consensus.cc:3060] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.073297 15315 tablet_bootstrap.cc:654] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.079964 15345 raft_consensus.cc:2804] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.085772 15321 leader_election.cc:290] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:33.090523 15345 raft_consensus.cc:697] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:33.091509 15314 tablet_bootstrap.cc:654] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.091572 15345 consensus_queue.cc:237] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.094184 15199 raft_consensus.cc:2468] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 1.
I20260709 13:16:33.097829 15315 tablet_bootstrap.cc:492] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:33.098449 15315 ts_tablet_manager.cc:1403] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.009s
I20260709 13:16:33.100034 15314 tablet_bootstrap.cc:492] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:33.100554 15314 ts_tablet_manager.cc:1403] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.033s	user 0.000s	sys 0.013s
I20260709 13:16:33.101233 15321 raft_consensus.cc:493] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.101801 15321 raft_consensus.cc:515] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:33.102739 15315 raft_consensus.cc:359] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.103195 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.103515 15315 raft_consensus.cc:385] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.103809 15273 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.103952 15315 raft_consensus.cc:740] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.104171 15321 leader_election.cc:290] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:33.104203 15314 raft_consensus.cc:359] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.105542 15314 raft_consensus.cc:385] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.105410 15164 leader_election.cc:304] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.105912 15314 raft_consensus.cc:740] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.105929 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:33.106396 15341 raft_consensus.cc:2804] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.106989 15199 raft_consensus.cc:2393] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in current term 1: Already voted for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in this term.
I20260709 13:16:33.106160 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.106788 15314 consensus_queue.cc:260] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.107848 15124 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.109505 15313 tablet_bootstrap.cc:492] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:33.109437 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.110234 15313 ts_tablet_manager.cc:1403] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.095s	user 0.042s	sys 0.033s
I20260709 13:16:33.111153 15238 leader_election.cc:304] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8
I20260709 13:16:33.106782 15341 raft_consensus.cc:493] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.112031 15321 raft_consensus.cc:3060] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.112414 15341 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.116550 15314 ts_tablet_manager.cc:1434] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:16:33.119902 15341 raft_consensus.cc:515] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.122807 15313 raft_consensus.cc:359] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.123662 15313 raft_consensus.cc:385] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.124004 15313 raft_consensus.cc:740] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.124934 15314 tablet_bootstrap.cc:492] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:33.124794 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.124958 15321 raft_consensus.cc:2749] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:33.125521 15124 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.124707 15020 catalog_manager.cc:5697] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.126140 15319 raft_consensus.cc:493] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.126288 15313 consensus_queue.cc:260] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.126612 15319 raft_consensus.cc:515] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.128659 15319 leader_election.cc:290] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.132812 15124 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.134528 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.134709 15347 raft_consensus.cc:493] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.136817 15313 ts_tablet_manager.cc:1434] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.004s
I20260709 13:16:33.121345 15315 consensus_queue.cc:260] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.137240 15347 raft_consensus.cc:515] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.138283 15164 leader_election.cc:304] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.139678 15347 leader_election.cc:290] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:33.140331 15321 raft_consensus.cc:493] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.135301 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.140420 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.140910 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:33.141199 15123 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 0.
I20260709 13:16:33.140460 15314 tablet_bootstrap.cc:654] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.136911 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.141713 15199 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 0.
I20260709 13:16:33.141918 15272 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.142676 15238 leader_election.cc:304] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:33.143991 15313 tablet_bootstrap.cc:492] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:33.144230 15319 raft_consensus.cc:2804] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.144769 15347 raft_consensus.cc:2804] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.145177 15347 raft_consensus.cc:493] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.145586 15347 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.135243 15341 leader_election.cc:290] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
W20260709 13:16:33.147462 15164 leader_election.cc:343] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:33.148967 15164 leader_election.cc:343] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.149462 15164 leader_election.cc:304] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc9ebec2cc424110b05846fe152c46e8; no voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:33.150725 15341 raft_consensus.cc:2749] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:33.151731 15313 tablet_bootstrap.cc:654] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.152573 15319 raft_consensus.cc:697] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:33.140987 15321 raft_consensus.cc:515] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.153569 15319 consensus_queue.cc:237] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.160939 15347 raft_consensus.cc:515] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.162153 15272 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.169938 15347 leader_election.cc:290] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:33.170825 15321 leader_election.cc:290] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:33.170967 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.171592 15124 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.174161 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.175323 15123 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 0.
I20260709 13:16:33.176113 15315 ts_tablet_manager.cc:1434] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.077s	user 0.011s	sys 0.010s
I20260709 13:16:33.176301 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:33.176685 15238 leader_election.cc:304] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:33.176964 15199 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.177629 15321 raft_consensus.cc:2804] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.178009 15321 raft_consensus.cc:493] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.178357 15321 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.177831 15315 tablet_bootstrap.cc:492] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:33.181025 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:33.181743 15198 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 0.
I20260709 13:16:33.185706 15351 raft_consensus.cc:493] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.186206 15351 raft_consensus.cc:515] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.187891 15124 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 1.
I20260709 13:16:33.192273 15321 raft_consensus.cc:515] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.189222 15315 tablet_bootstrap.cc:654] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.193544 15199 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 1.
I20260709 13:16:33.193850 15238 leader_election.cc:304] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:33.194728 15347 raft_consensus.cc:2804] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.195200 15347 raft_consensus.cc:697] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:33.196338 15347 consensus_queue.cc:237] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.189764 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.188462 15351 leader_election.cc:290] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.190229 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.201862 15272 raft_consensus.cc:2468] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.203344 15164 leader_election.cc:304] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.204213 15341 raft_consensus.cc:2804] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.204634 15123 raft_consensus.cc:2468] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.204757 15341 raft_consensus.cc:493] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.206607 15341 raft_consensus.cc:3060] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.213727 15321 leader_election.cc:290] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:33.214473 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.216320 15123 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.220664 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:33.221367 15199 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.228430 15199 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 1.
I20260709 13:16:33.230417 15239 leader_election.cc:304] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.232223 15341 raft_consensus.cc:515] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.228430 15123 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 1.
I20260709 13:16:33.236918 15321 raft_consensus.cc:2804] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.244465 15321 raft_consensus.cc:697] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:33.245743 15341 leader_election.cc:290] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.245828 15321 consensus_queue.cc:237] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.246840 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.247076 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.247464 15124 raft_consensus.cc:3060] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.247648 15272 raft_consensus.cc:3060] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.248960 15020 catalog_manager.cc:5697] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.254437 15314 tablet_bootstrap.cc:492] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:33.254940 15314 ts_tablet_manager.cc:1403] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.130s	user 0.027s	sys 0.056s
I20260709 13:16:33.256004 15313 tablet_bootstrap.cc:492] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:33.256434 15021 catalog_manager.cc:5697] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.258280 15314 raft_consensus.cc:359] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.256476 15313 ts_tablet_manager.cc:1403] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.019s
I20260709 13:16:33.258957 15314 raft_consensus.cc:385] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.259331 15314 raft_consensus.cc:740] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.260118 15314 consensus_queue.cc:260] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.262240 15314 ts_tablet_manager.cc:1434] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:33.263098 15314 tablet_bootstrap.cc:492] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
I20260709 13:16:33.264653 15124 raft_consensus.cc:2468] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.261933 15313 raft_consensus.cc:359] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.265614 15313 raft_consensus.cc:385] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.265895 15313 raft_consensus.cc:740] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.266903 15164 leader_election.cc:304] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.268488 15314 tablet_bootstrap.cc:654] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.268993 15319 raft_consensus.cc:2804] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.269531 15319 raft_consensus.cc:697] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:33.270417 15319 consensus_queue.cc:237] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.271113 15272 raft_consensus.cc:2468] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.275204 15313 consensus_queue.cc:260] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.276422 15314 tablet_bootstrap.cc:492] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:33.276785 15315 tablet_bootstrap.cc:492] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:33.276880 15314 ts_tablet_manager.cc:1403] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:16:33.277649 15315 ts_tablet_manager.cc:1403] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.100s	user 0.033s	sys 0.013s
I20260709 13:16:33.279745 15314 raft_consensus.cc:359] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.280427 15314 raft_consensus.cc:385] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.280747 15314 raft_consensus.cc:740] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.281904 15315 raft_consensus.cc:359] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.283041 15315 raft_consensus.cc:385] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.283440 15315 raft_consensus.cc:740] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.283488 15314 consensus_queue.cc:260] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.284807 15315 consensus_queue.cc:260] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.286160 15313 ts_tablet_manager.cc:1434] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.003s
I20260709 13:16:33.286406 15341 raft_consensus.cc:493] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.286881 15341 raft_consensus.cc:515] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.288763 15315 ts_tablet_manager.cc:1434] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:16:33.289124 15341 leader_election.cc:290] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.290125 15315 tablet_bootstrap.cc:492] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:33.290720 15314 ts_tablet_manager.cc:1434] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:16:33.290652 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.291688 15314 tablet_bootstrap.cc:492] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8: Bootstrap starting.
W20260709 13:16:33.292135 15164 leader_election.cc:343] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.292961 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.293599 15021 catalog_manager.cc:5697] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.296922 15315 tablet_bootstrap.cc:654] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.293587 15272 raft_consensus.cc:2468] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.304045 15314 tablet_bootstrap.cc:654] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.304368 15164 leader_election.cc:304] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:33.305678 15341 raft_consensus.cc:2804] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.306176 15341 raft_consensus.cc:493] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.306536 15341 raft_consensus.cc:3060] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.309729 15314 tablet_bootstrap.cc:492] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8: No bootstrap required, opened a new log
I20260709 13:16:33.309749 15315 tablet_bootstrap.cc:492] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:33.310223 15314 ts_tablet_manager.cc:1403] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 13:16:33.310348 15315 ts_tablet_manager.cc:1403] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 13:16:33.312175 15314 raft_consensus.cc:359] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.312700 15314 raft_consensus.cc:385] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.312973 15314 raft_consensus.cc:740] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.304386 15313 tablet_bootstrap.cc:492] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:33.312960 15315 raft_consensus.cc:359] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.314034 15315 raft_consensus.cc:385] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.313841 15314 consensus_queue.cc:260] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.314332 15315 raft_consensus.cc:740] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.315187 15315 consensus_queue.cc:260] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.315864 15314 ts_tablet_manager.cc:1434] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:33.317127 15315 ts_tablet_manager.cc:1434] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:33.317978 15315 tablet_bootstrap.cc:492] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:33.318873 15022 catalog_manager.cc:5697] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.312950 15318 raft_consensus.cc:493] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.321137 15318 raft_consensus.cc:515] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.322197 15313 tablet_bootstrap.cc:654] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.328173 15315 tablet_bootstrap.cc:654] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.323271 15318 leader_election.cc:290] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.324817 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:33.325007 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.330089 15199 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 0.
W20260709 13:16:33.331202 15089 leader_election.cc:343] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.316807 15341 raft_consensus.cc:515] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.331774 15090 leader_election.cc:304] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:33.332470 15313 tablet_bootstrap.cc:492] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:33.333226 15318 raft_consensus.cc:2804] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.333292 15341 leader_election.cc:290] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.333782 15318 raft_consensus.cc:493] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.334263 15318 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.334544 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.334874 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.335160 15272 raft_consensus.cc:3060] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.336253 15313 ts_tablet_manager.cc:1403] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.008s
W20260709 13:16:33.337608 15164 leader_election.cc:343] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.340524 15313 raft_consensus.cc:359] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.341563 15313 raft_consensus.cc:385] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.341975 15313 raft_consensus.cc:740] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.343053 15313 consensus_queue.cc:260] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.350062 15313 ts_tablet_manager.cc:1434] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:16:33.350522 15318 raft_consensus.cc:515] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.351624 15313 tablet_bootstrap.cc:492] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:33.353382 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:33.353951 15199 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.358800 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
W20260709 13:16:33.360317 15089 leader_election.cc:343] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:33.360934 15318 leader_election.cc:290] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.362243 15199 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 1.
I20260709 13:16:33.363310 15090 leader_election.cc:304] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:33.364169 15318 raft_consensus.cc:2804] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.366815 15272 raft_consensus.cc:2468] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.367750 15315 tablet_bootstrap.cc:492] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:33.368194 15315 ts_tablet_manager.cc:1403] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.018s
I20260709 13:16:33.367980 15164 leader_election.cc:304] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:33.368745 15313 tablet_bootstrap.cc:654] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.369483 15341 raft_consensus.cc:2804] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.369956 15341 raft_consensus.cc:697] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:33.370770 15341 consensus_queue.cc:237] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.371155 15315 raft_consensus.cc:359] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.371754 15315 raft_consensus.cc:385] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.372017 15315 raft_consensus.cc:740] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.372694 15315 consensus_queue.cc:260] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.365484 15318 raft_consensus.cc:697] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:33.374668 15318 consensus_queue.cc:237] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.377595 15315 ts_tablet_manager.cc:1434] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:16:33.378690 15315 tablet_bootstrap.cc:492] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25: Bootstrap starting.
I20260709 13:16:33.385776 15315 tablet_bootstrap.cc:654] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.391968 15313 tablet_bootstrap.cc:492] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:33.392426 15313 ts_tablet_manager.cc:1403] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.015s
I20260709 13:16:33.394953 15313 raft_consensus.cc:359] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.395612 15313 raft_consensus.cc:385] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.395876 15313 raft_consensus.cc:740] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.396485 15313 consensus_queue.cc:260] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.398978 15313 ts_tablet_manager.cc:1434] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:33.399583 15315 tablet_bootstrap.cc:492] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25: No bootstrap required, opened a new log
I20260709 13:16:33.399868 15313 tablet_bootstrap.cc:492] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Bootstrap starting.
I20260709 13:16:33.399982 15315 ts_tablet_manager.cc:1403] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:16:33.399334 15020 catalog_manager.cc:5697] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 1 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.401325 15019 catalog_manager.cc:5697] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.402137 15315 raft_consensus.cc:359] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.402720 15315 raft_consensus.cc:385] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.402971 15315 raft_consensus.cc:740] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.403703 15315 consensus_queue.cc:260] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.405884 15315 ts_tablet_manager.cc:1434] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.005s
I20260709 13:16:33.405966 15313 tablet_bootstrap.cc:654] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:33.417178 15313 tablet_bootstrap.cc:492] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: No bootstrap required, opened a new log
I20260709 13:16:33.417623 15313 ts_tablet_manager.cc:1403] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:16:33.419746 15313 raft_consensus.cc:359] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.420251 15313 raft_consensus.cc:385] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:33.420521 15313 raft_consensus.cc:740] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Initialized, Role: FOLLOWER
I20260709 13:16:33.421165 15313 consensus_queue.cc:260] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.422567 15313 ts_tablet_manager.cc:1434] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:16:33.450708 15341 raft_consensus.cc:493] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.451181 15341 raft_consensus.cc:515] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.452849 15341 leader_election.cc:290] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.453771 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.453994 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.454381 15124 raft_consensus.cc:2468] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.454579 15272 raft_consensus.cc:2468] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.455477 15164 leader_election.cc:304] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.456117 15341 raft_consensus.cc:2804] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.456527 15341 raft_consensus.cc:493] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.456838 15341 raft_consensus.cc:3060] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.461437 15341 raft_consensus.cc:515] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.463186 15341 leader_election.cc:290] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.464097 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.464363 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.464684 15124 raft_consensus.cc:3060] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.464905 15272 raft_consensus.cc:3060] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.469995 15272 raft_consensus.cc:2468] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.470016 15124 raft_consensus.cc:2468] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.471306 15164 leader_election.cc:304] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.472004 15341 raft_consensus.cc:2804] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.471982 15318 consensus_queue.cc:1048] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.472663 15341 raft_consensus.cc:697] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:33.473502 15341 consensus_queue.cc:237] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.485955 15020 catalog_manager.cc:5697] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.493768 15318 consensus_queue.cc:1048] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.534432 15341 raft_consensus.cc:493] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.534871 15341 raft_consensus.cc:515] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.536394 15341 leader_election.cc:290] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.537319 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fe7f03e9574229876893f65655b92e" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.537555 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fe7f03e9574229876893f65655b92e" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.537966 15124 raft_consensus.cc:2468] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.538152 15272 raft_consensus.cc:2468] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 0.
I20260709 13:16:33.539098 15164 leader_election.cc:304] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.539778 15341 raft_consensus.cc:2804] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:33.540084 15341 raft_consensus.cc:493] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.540359 15341 raft_consensus.cc:3060] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.544967 15341 raft_consensus.cc:515] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.546558 15341 leader_election.cc:290] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.547465 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fe7f03e9574229876893f65655b92e" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.547822 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fe7f03e9574229876893f65655b92e" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.548055 15124 raft_consensus.cc:3060] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.548410 15272 raft_consensus.cc:3060] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.552866 15272 raft_consensus.cc:2468] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.553045 15124 raft_consensus.cc:2468] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 1.
I20260709 13:16:33.553925 15164 leader_election.cc:304] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.554581 15341 raft_consensus.cc:2804] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:33.554975 15341 raft_consensus.cc:697] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:33.555665 15341 consensus_queue.cc:237] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.563385 15021 catalog_manager.cc:5697] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.594787 15321 raft_consensus.cc:493] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.595286 15321 raft_consensus.cc:515] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.597091 15321 leader_election.cc:290] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:33.598107 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" is_pre_election: true
I20260709 13:16:33.598274 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:33.599164 15199 raft_consensus.cc:2393] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in current term 1: Already voted for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in this term.
I20260709 13:16:33.599226 15341 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.600240 15239 leader_election.cc:304] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8
I20260709 13:16:33.601046 15321 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.609074 15321 raft_consensus.cc:2749] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:33.610948 15321 consensus_queue.cc:1048] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.614050 15351 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.625164 15350 consensus_queue.cc:1048] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.645992 15350 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.669230 15321 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.672086 15272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:60376
I20260709 13:16:33.672782 15272 raft_consensus.cc:606] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:33.682772 15384 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.694161 15198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:44360
I20260709 13:16:33.694823 15198 raft_consensus.cc:606] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:33.695333 15347 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.701180 15272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:60376
I20260709 13:16:33.701817 15272 raft_consensus.cc:606] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:33.707358 15350 raft_consensus.cc:993] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:33.707966 15350 raft_consensus.cc:1081] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:33.710284 15199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:44360
I20260709 13:16:33.710415 15123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47332
I20260709 13:16:33.710924 15199 raft_consensus.cc:606] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:33.711305 15123 raft_consensus.cc:493] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.711835 15123 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.716231 15272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
mode: GRACEFUL
new_leader_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:60376
I20260709 13:16:33.716820 15272 raft_consensus.cc:606] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Received request to transfer leadership to TS dc9ebec2cc424110b05846fe152c46e8
I20260709 13:16:33.722864 15123 raft_consensus.cc:515] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.726853 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.727504 15272 raft_consensus.cc:3055] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.727871 15272 raft_consensus.cc:740] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:33.728938 15272 consensus_queue.cc:260] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.730126 15272 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.731325 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:33.731952 15198 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.739180 15198 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:33.740089 15123 leader_election.cc:290] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.740500 15124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
mode: GRACEFUL
new_leader_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:47354
I20260709 13:16:33.740664 15090 leader_election.cc:304] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.741210 15124 raft_consensus.cc:606] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Received request to transfer leadership to TS dc9ebec2cc424110b05846fe152c46e8
I20260709 13:16:33.741628 15328 raft_consensus.cc:2804] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.741778 15272 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:33.742157 15328 raft_consensus.cc:697] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:33.743037 15328 consensus_queue.cc:237] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.751386 15198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
mode: GRACEFUL
new_leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:44360
I20260709 13:16:33.751938 15198 raft_consensus.cc:606] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Received request to transfer leadership to TS d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:33.752182 15020 catalog_manager.cc:5697] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 1 to 2, leader changed from d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 2 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.756726 15328 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.764036 15373 raft_consensus.cc:993] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: : Instructing follower dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:33.764489 15373 raft_consensus.cc:1081] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Signalling peer dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:33.766357 15199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:16:33.770135 15199 raft_consensus.cc:493] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.770076 15328 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.770920 15199 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.779516 15199 raft_consensus.cc:515] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.783746 15199 leader_election.cc:290] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 2 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.784461 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:33.785135 15124 raft_consensus.cc:3055] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.785465 15124 raft_consensus.cc:740] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:33.786244 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.786244 15124 consensus_queue.cc:260] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.787634 15272 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.788044 15124 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.788015 15319 consensus_queue.cc:1048] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:33.794986 15272 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 2.
I20260709 13:16:33.796422 15124 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 2.
I20260709 13:16:33.796566 15164 leader_election.cc:304] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:33.798086 15351 raft_consensus.cc:2804] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.798678 15351 raft_consensus.cc:697] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:33.799594 15351 consensus_queue.cc:237] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.803102 15319 consensus_queue.cc:1048] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.809739 15020 catalog_manager.cc:5697] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 1 to 2, leader changed from 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65) to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.810942 15319 raft_consensus.cc:993] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:33.811421 15351 raft_consensus.cc:1081] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:33.812945 15124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47348
I20260709 13:16:33.813501 15124 raft_consensus.cc:493] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.813869 15124 raft_consensus.cc:3060] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.819559 15124 raft_consensus.cc:515] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.822196 15124 leader_election.cc:290] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.822665 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:33.822708 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5888b8d696f4407b901fe38539a1d91f" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:33.823323 15199 raft_consensus.cc:3055] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:33.823486 15272 raft_consensus.cc:3060] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.823729 15199 raft_consensus.cc:740] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:33.824728 15199 consensus_queue.cc:260] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.825649 15199 raft_consensus.cc:3060] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:33.829970 15272 raft_consensus.cc:2468] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:33.831063 15089 leader_election.cc:304] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:33.831290 15328 raft_consensus.cc:493] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:33.831995 15318 raft_consensus.cc:2804] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:33.831918 15199 raft_consensus.cc:2468] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:33.831724 15328 raft_consensus.cc:515] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.832644 15318 raft_consensus.cc:697] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:33.833483 15318 consensus_queue.cc:237] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:33.834203 15328 leader_election.cc:290] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:33.834851 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9ebec2cc424110b05846fe152c46e8" is_pre_election: true
I20260709 13:16:33.837144 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" is_pre_election: true
I20260709 13:16:33.837699 15272 raft_consensus.cc:2393] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in current term 1: Already voted for candidate dc9ebec2cc424110b05846fe152c46e8 in this term.
I20260709 13:16:33.838557 15089 leader_election.cc:304] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe; no voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8
I20260709 13:16:33.839227 15318 raft_consensus.cc:3060] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:33.840260 15020 catalog_manager.cc:5697] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 1 to 2, leader changed from dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 2 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.844826 15318 raft_consensus.cc:2749] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:33.947491 15319 consensus_queue.cc:1048] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.948632 15351 consensus_queue.cc:1048] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.949029 15319 consensus_queue.cc:1048] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.960615 15341 consensus_queue.cc:1048] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.981132 15393 consensus_queue.cc:1048] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:33.985546 15351 consensus_queue.cc:1048] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:34.002815 15393 raft_consensus.cc:993] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8: : Instructing follower d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:34.003309 15351 raft_consensus.cc:1081] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Signalling peer d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:34.005533 15272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:60366
I20260709 13:16:34.006186 15272 raft_consensus.cc:493] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.006652 15272 raft_consensus.cc:3060] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.013437 15319 raft_consensus.cc:993] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:34.013898 15393 raft_consensus.cc:1081] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:34.015413 15124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47348
I20260709 13:16:34.015898 15124 raft_consensus.cc:493] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.016215 15124 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.016266 15272 raft_consensus.cc:515] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.019345 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:34.019619 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2216c45c25474faeae0bc0e53f28eac9" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:34.020004 15123 raft_consensus.cc:3060] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.020159 15199 raft_consensus.cc:3055] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.020578 15199 raft_consensus.cc:740] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:34.021443 15199 consensus_queue.cc:260] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.022563 15199 raft_consensus.cc:3060] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.023717 15124 raft_consensus.cc:515] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.026557 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:34.026574 15124 leader_election.cc:290] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:34.026769 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:34.027210 15123 raft_consensus.cc:2468] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 2.
I20260709 13:16:34.027364 15273 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.027256 15198 raft_consensus.cc:3055] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.027874 15198 raft_consensus.cc:740] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:34.028760 15198 consensus_queue.cc:260] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.029336 15238 leader_election.cc:304] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:34.030048 15384 raft_consensus.cc:2804] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.030647 15384 raft_consensus.cc:697] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:34.030025 15198 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.031469 15384 consensus_queue.cc:237] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.034579 15273 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:34.035899 15089 leader_election.cc:304] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:34.036823 15373 raft_consensus.cc:2804] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.037288 15373 raft_consensus.cc:697] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:34.038455 15198 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:34.038985 15199 raft_consensus.cc:2468] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 2.
I20260709 13:16:34.038107 15373 consensus_queue.cc:237] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.039784 15272 leader_election.cc:290] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 2 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:34.039538 15020 catalog_manager.cc:5697] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 1 to 2, leader changed from dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66) to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.046011 15019 catalog_manager.cc:5697] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 1 to 2, leader changed from dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 2 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.205976 15350 raft_consensus.cc:993] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:34.206470 15384 raft_consensus.cc:1081] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:34.207446 15198 raft_consensus.cc:1275] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.208004 15123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47332
I20260709 13:16:34.208551 15123 raft_consensus.cc:493] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.209004 15123 raft_consensus.cc:3060] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.208820 15373 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.215687 15123 raft_consensus.cc:515] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.218463 15123 leader_election.cc:290] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:34.218053 15272 raft_consensus.cc:1275] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.220395 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:34.220867 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c57f1254f5cc4df38dd28f480e80a8d6" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:34.221120 15198 raft_consensus.cc:3060] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.221486 15273 raft_consensus.cc:3055] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.221841 15273 raft_consensus.cc:740] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:34.220427 15373 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:34.226145 15273 consensus_queue.cc:260] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.227536 15273 raft_consensus.cc:3060] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.228644 15198 raft_consensus.cc:2468] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:34.229853 15090 leader_election.cc:304] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:34.230681 15402 raft_consensus.cc:2804] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.231148 15402 raft_consensus.cc:697] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:34.231997 15402 consensus_queue.cc:237] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.234887 15273 raft_consensus.cc:2468] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:34.240460 15019 catalog_manager.cc:5697] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 1 to 2, leader changed from d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 2 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.246838 15350 raft_consensus.cc:993] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25: : Instructing follower dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:34.247319 15321 raft_consensus.cc:1081] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Signalling peer dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:34.249192 15198 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:44352
I20260709 13:16:34.249786 15198 raft_consensus.cc:493] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.250139 15198 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.255445 15198 raft_consensus.cc:515] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.257041 15198 leader_election.cc:290] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 2 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:34.257948 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:34.258126 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:34.258477 15123 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.258651 15273 raft_consensus.cc:3055] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:34.258997 15273 raft_consensus.cc:740] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:34.259651 15273 consensus_queue.cc:260] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.260532 15273 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:34.263824 15123 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 2.
I20260709 13:16:34.265038 15164 leader_election.cc:304] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:34.265686 15273 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 2.
I20260709 13:16:34.265825 15393 raft_consensus.cc:2804] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:34.266378 15393 raft_consensus.cc:697] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:34.267221 15393 consensus_queue.cc:237] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:34.273237 15020 catalog_manager.cc:5697] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 1 to 2, leader changed from d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67) to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.303524 15273 raft_consensus.cc:1275] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.304805 15393 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.307914 15123 raft_consensus.cc:1275] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.309212 15393 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.425323 15273 raft_consensus.cc:1275] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.426528 15373 consensus_queue.cc:1048] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.433576 15198 raft_consensus.cc:1275] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.435539 15328 consensus_queue.cc:1048] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.530994 15198 raft_consensus.cc:1275] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.532369 15321 consensus_queue.cc:1048] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.540634 15124 raft_consensus.cc:1275] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.544667 15350 consensus_queue.cc:1048] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:34.547343 15273 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.548759 15328 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.559450 15198 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.560952 15318 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.664919 15273 raft_consensus.cc:1275] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.666191 15393 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.674563 15124 raft_consensus.cc:1275] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.676095 15393 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.683382 15273 raft_consensus.cc:1275] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.684760 15318 consensus_queue.cc:1048] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:34.695734 15198 raft_consensus.cc:1275] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:34.697198 15318 consensus_queue.cc:1048] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.783658 14501 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:16:36.784482 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.799898 15123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
mode: GRACEFUL
new_leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:52862
I20260709 13:16:36.800451 15123 raft_consensus.cc:606] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Received request to transfer leadership to TS d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:36.803004 15123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
mode: GRACEFUL
new_leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:52862
I20260709 13:16:36.803476 15123 raft_consensus.cc:606] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Received request to transfer leadership to TS d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:36.804476 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:16:36.804946 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:37.080479 15373 raft_consensus.cc:993] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: : Instructing follower d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:37.080997 15410 raft_consensus.cc:1081] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Signalling peer d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:37.082612 15272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:60360
I20260709 13:16:37.083237 15272 raft_consensus.cc:493] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.083602 15272 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.089098 15272 raft_consensus.cc:515] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.090444 15272 leader_election.cc:290] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 3 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:37.091475 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:37.091437 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:37.092222 15198 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.092247 15123 raft_consensus.cc:3055] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.092815 15123 raft_consensus.cc:740] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:37.093631 15123 consensus_queue.cc:260] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.094882 15123 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.099361 15198 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 3.
I20260709 13:16:37.100716 15239 leader_election.cc:304] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:37.101472 15321 raft_consensus.cc:2804] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:37.101436 15123 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 3.
I20260709 13:16:37.102957 15321 raft_consensus.cc:697] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:37.103817 15321 consensus_queue.cc:237] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.111963 15019 catalog_manager.cc:5697] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 2 to 3, leader changed from 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65) to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.168277 15373 raft_consensus.cc:993] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: : Instructing follower d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:37.168840 15410 raft_consensus.cc:1081] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Signalling peer d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:37.170244 15272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:60360
I20260709 13:16:37.170686 15272 raft_consensus.cc:493] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.170957 15272 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.174933 15272 raft_consensus.cc:515] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.176472 15272 leader_election.cc:290] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 3 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:37.177361 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:37.177561 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:37.177893 15123 raft_consensus.cc:3055] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.177982 15198 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.178323 15123 raft_consensus.cc:740] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:37.179032 15123 consensus_queue.cc:260] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.179860 15123 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.182600 15198 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 3.
I20260709 13:16:37.183589 15239 leader_election.cc:304] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:37.184334 15321 raft_consensus.cc:2804] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:37.184686 15123 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 3.
I20260709 13:16:37.184891 15321 raft_consensus.cc:697] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:37.185675 15321 consensus_queue.cc:237] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.192046 15019 catalog_manager.cc:5697] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 2 to 3, leader changed from 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65) to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.589572 15123 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.590799 15321 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.600232 15198 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.601809 15321 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.671150 15198 raft_consensus.cc:1275] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.672578 15321 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.681087 15123 raft_consensus.cc:1275] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:37.684535 15321 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.805709 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.820632 15272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:60376
I20260709 13:16:37.821125 15272 raft_consensus.cc:606] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:37.825706 15272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:60376
I20260709 13:16:37.826218 15272 raft_consensus.cc:606] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:37.833104 15198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:44360
I20260709 13:16:37.833777 15198 raft_consensus.cc:606] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:37.838281 15198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:44360
I20260709 13:16:37.838836 15198 raft_consensus.cc:606] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:37.843251 15198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
mode: GRACEFUL
new_leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:44360
I20260709 13:16:37.843750 15198 raft_consensus.cc:606] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Received request to transfer leadership to TS 4ca70c2ed8b84015bd7db5aa52d3e1fe
I20260709 13:16:37.852018 15407 raft_consensus.cc:993] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:37.852413 15419 raft_consensus.cc:1081] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:37.853742 15123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47348
I20260709 13:16:37.854212 15123 raft_consensus.cc:493] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.854521 15123 raft_consensus.cc:3060] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.859351 15123 raft_consensus.cc:515] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.861174 15123 leader_election.cc:290] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:37.862293 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:37.862308 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46a09f1bea7442f8c88ea4cda3c092f" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:37.863104 15273 raft_consensus.cc:3060] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.863099 15198 raft_consensus.cc:3055] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:37.863670 15198 raft_consensus.cc:740] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:37.864523 15198 consensus_queue.cc:260] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.865753 15198 raft_consensus.cc:3060] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:37.868351 15273 raft_consensus.cc:2468] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:37.869582 15089 leader_election.cc:304] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:37.870335 15410 raft_consensus.cc:2804] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:37.870853 15410 raft_consensus.cc:697] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:37.871939 15198 raft_consensus.cc:2468] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 2.
I20260709 13:16:37.871788 15410 consensus_queue.cc:237] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.880225 15020 catalog_manager.cc:5697] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 1 to 2, leader changed from dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 2 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.895471 15407 raft_consensus.cc:993] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:37.895905 15419 raft_consensus.cc:1081] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:37.897287 15123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47348
I20260709 13:16:37.897770 15123 raft_consensus.cc:493] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.898066 15123 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.902595 15123 raft_consensus.cc:515] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.904265 15123 leader_election.cc:290] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 3 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:37.905251 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:37.905258 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:37.906320 15273 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.906342 15198 raft_consensus.cc:3055] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:37.906838 15198 raft_consensus.cc:740] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:37.907543 15198 consensus_queue.cc:260] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.908430 15198 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:37.912143 15273 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 3.
I20260709 13:16:37.913332 15089 leader_election.cc:304] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:37.913496 15198 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 3.
I20260709 13:16:37.914242 15428 raft_consensus.cc:2804] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:37.914666 15428 raft_consensus.cc:697] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:37.915373 15428 consensus_queue.cc:237] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:37.922209 15020 catalog_manager.cc:5697] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 2 to 3, leader changed from dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 3 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.064421 15407 raft_consensus.cc:993] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:38.064937 15419 raft_consensus.cc:1081] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:38.066443 15123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47348
I20260709 13:16:38.066936 15123 raft_consensus.cc:493] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.067283 15123 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.071910 15123 raft_consensus.cc:515] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.073535 15123 leader_election.cc:290] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 3 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:38.074394 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:38.074699 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:38.074970 15198 raft_consensus.cc:3055] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:38.075233 15273 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.075451 15198 raft_consensus.cc:740] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:38.076248 15198 consensus_queue.cc:260] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.077147 15198 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:38.080075 15273 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 3.
I20260709 13:16:38.081318 15198 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 3.
I20260709 13:16:38.081245 15089 leader_election.cc:304] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, d7ad0c5bd79b4deda1423b48b4bb4b25; no voters: 
I20260709 13:16:38.082150 15428 raft_consensus.cc:2804] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:38.082630 15428 raft_consensus.cc:697] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:38.083354 15428 consensus_queue.cc:237] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.090318 15020 catalog_manager.cc:5697] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 2 to 3, leader changed from dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 3 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.094720 15426 raft_consensus.cc:993] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:38.095261 15321 raft_consensus.cc:1081] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:38.096792 15123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47332
I20260709 13:16:38.097322 15123 raft_consensus.cc:493] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.097651 15123 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.101934 15123 raft_consensus.cc:515] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.103552 15123 leader_election.cc:290] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 4 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:38.104347 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:38.104688 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:38.104916 15198 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.105261 15273 raft_consensus.cc:3055] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:38.105537 15273 raft_consensus.cc:740] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:38.106209 15273 consensus_queue.cc:260] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.107132 15273 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.109246 15198 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 4.
I20260709 13:16:38.110244 15090 leader_election.cc:304] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:38.110881 15428 raft_consensus.cc:2804] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.111336 15428 raft_consensus.cc:697] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:38.112069 15273 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 4.
I20260709 13:16:38.112179 15428 consensus_queue.cc:237] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.118438 15020 catalog_manager.cc:5697] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 3 to 4, leader changed from d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 4 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.210616 15435 raft_consensus.cc:993] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: : Instructing follower 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:38.211123 15321 raft_consensus.cc:1081] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Signalling peer 4ca70c2ed8b84015bd7db5aa52d3e1fe to start an election
I20260709 13:16:38.212647 15123 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
 from {username='slave'} at 127.0.0.1:47332
I20260709 13:16:38.213115 15123 raft_consensus.cc:493] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.213457 15123 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.217419 15123 raft_consensus.cc:515] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.219097 15123 leader_election.cc:290] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 4 election: Requested vote from peers dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:38.220149 15273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:38.220191 15198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e128b3830c649818b474d995ca3f9b6" candidate_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:38.220791 15273 raft_consensus.cc:3055] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:38.220877 15198 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.221091 15273 raft_consensus.cc:740] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:38.221891 15273 consensus_queue.cc:260] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.222805 15273 raft_consensus.cc:3060] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.225319 15198 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 4.
I20260709 13:16:38.226431 15090 leader_election.cc:304] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ca70c2ed8b84015bd7db5aa52d3e1fe, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:38.227245 15428 raft_consensus.cc:2804] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.227716 15428 raft_consensus.cc:697] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 LEADER]: Becoming Leader. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:38.228078 15273 raft_consensus.cc:2468] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ca70c2ed8b84015bd7db5aa52d3e1fe in term 4.
I20260709 13:16:38.228570 15428 consensus_queue.cc:237] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:38.234730 15020 catalog_manager.cc:5697] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe reported cstate change: term changed from 3 to 4, leader changed from d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67) to 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65). New cstate: current_term: 4 leader_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.405256 15198 raft_consensus.cc:1275] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.406529 15428 consensus_queue.cc:1048] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.419590 15273 raft_consensus.cc:1275] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:38.420977 15410 consensus_queue.cc:1048] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:38.456843 15198 raft_consensus.cc:1275] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:38.458035 15410 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.469964 15273 raft_consensus.cc:1275] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:38.471493 15410 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.499696 15198 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:38.501004 15410 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:38.502951 15198 raft_consensus.cc:1275] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:38.504248 15410 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.508929 15273 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:38.510376 15428 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:38.522583 15273 raft_consensus.cc:1275] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:38.526796 15439 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.633561 15199 raft_consensus.cc:1275] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:38.635003 15428 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:38.642792 15273 raft_consensus.cc:1275] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Refusing update from remote peer 4ca70c2ed8b84015bd7db5aa52d3e1fe: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:38.645695 15439 consensus_queue.cc:1048] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.851863 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:40.860934 15123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
mode: GRACEFUL
new_leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:52862
I20260709 13:16:40.861851 15123 raft_consensus.cc:606] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Received request to transfer leadership to TS d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:40.864915 15123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
mode: GRACEFUL
new_leader_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:52862
I20260709 13:16:40.865408 15123 raft_consensus.cc:606] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 LEADER]: Received request to transfer leadership to TS dc9ebec2cc424110b05846fe152c46e8
I20260709 13:16:40.867755 15123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
mode: GRACEFUL
new_leader_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:52862
I20260709 13:16:40.868247 15123 raft_consensus.cc:606] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Received request to transfer leadership to TS dc9ebec2cc424110b05846fe152c46e8
I20260709 13:16:40.870642 15123 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b"
dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
mode: GRACEFUL
new_leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:52862
I20260709 13:16:40.871194 15123 raft_consensus.cc:606] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Received request to transfer leadership to TS d7ad0c5bd79b4deda1423b48b4bb4b25
I20260709 13:16:40.872354 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:40.872965 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:40.939415 15448 raft_consensus.cc:993] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe: : Instructing follower d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:40.939960 15410 raft_consensus.cc:1081] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Signalling peer d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:40.941639 15273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:60360
I20260709 13:16:40.942124 15273 raft_consensus.cc:493] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.942449 15273 raft_consensus.cc:3060] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.947438 15273 raft_consensus.cc:515] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:40.949160 15273 leader_election.cc:290] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 2 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:40.950222 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:40.950415 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18050e7c7a744e5d890bdaa4e8fa0a5c" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:40.950958 15123 raft_consensus.cc:3055] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:40.951035 15199 raft_consensus.cc:3060] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.951226 15123 raft_consensus.cc:740] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:40.951968 15123 consensus_queue.cc:260] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:40.952976 15123 raft_consensus.cc:3060] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:40.956116 15199 raft_consensus.cc:2468] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 2.
I20260709 13:16:40.957479 15239 leader_election.cc:304] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:40.958171 15123 raft_consensus.cc:2468] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 2.
I20260709 13:16:40.958307 15321 raft_consensus.cc:2804] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:40.959326 15321 raft_consensus.cc:697] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:40.960304 15321 consensus_queue.cc:237] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } }
I20260709 13:16:40.967554 15021 catalog_manager.cc:5697] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 1 to 2, leader changed from 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65) to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.974963 15410 raft_consensus.cc:993] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: : Instructing follower dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:40.975621 15452 raft_consensus.cc:1081] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Signalling peer dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:40.976316 15448 raft_consensus.cc:993] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe: : Instructing follower d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:40.976990 15452 raft_consensus.cc:1081] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Signalling peer d7ad0c5bd79b4deda1423b48b4bb4b25 to start an election
I20260709 13:16:40.977161 15199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:16:40.977699 15199 raft_consensus.cc:493] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.978072 15199 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.978892 15273 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b"
dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
 from {username='slave'} at 127.0.0.1:60360
I20260709 13:16:40.979501 15273 raft_consensus.cc:493] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.979882 15273 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.983837 15199 raft_consensus.cc:515] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:40.985852 15199 leader_election.cc:290] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 4 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:40.987046 15273 raft_consensus.cc:515] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:40.987794 15123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:40.988325 15123 raft_consensus.cc:3055] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:40.988632 15123 raft_consensus.cc:740] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:40.989354 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d2e5e8e52d494db194a885d75a9c86" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:40.989776 15273 leader_election.cc:290] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 4 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66:36351)
I20260709 13:16:40.989440 15123 consensus_queue.cc:260] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:40.989928 15272 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.990602 15123 raft_consensus.cc:3060] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.991649 15199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
I20260709 13:16:40.991894 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98f022702d97442d8602d3e82abb2f1b" candidate_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:40.992239 15199 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.992487 15124 raft_consensus.cc:3055] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:40.992841 15124 raft_consensus.cc:740] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:40.993621 15124 consensus_queue.cc:260] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:40.994822 15124 raft_consensus.cc:3060] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:40.997120 15272 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 4.
I20260709 13:16:40.998400 15199 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 4.
I20260709 13:16:40.998566 15123 raft_consensus.cc:2468] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 4.
I20260709 13:16:40.998656 15164 leader_election.cc:304] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:40.999645 15419 raft_consensus.cc:2804] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:41.000571 15239 leader_election.cc:304] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:41.001694 15321 raft_consensus.cc:2804] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:41.002167 15321 raft_consensus.cc:697] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 LEADER]: Becoming Leader. State: Replica: d7ad0c5bd79b4deda1423b48b4bb4b25, State: Running, Role: LEADER
I20260709 13:16:41.002278 15419 raft_consensus.cc:697] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 4 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:41.003513 15124 raft_consensus.cc:2468] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ad0c5bd79b4deda1423b48b4bb4b25 in term 4.
I20260709 13:16:41.003257 15321 consensus_queue.cc:237] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:41.003782 15419 consensus_queue.cc:237] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:41.012900 15021 catalog_manager.cc:5697] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 reported cstate change: term changed from 3 to 4, leader changed from 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65) to d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:41.014176 15020 catalog_manager.cc:5697] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 3 to 4, leader changed from 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65) to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 4 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.071815 15448 raft_consensus.cc:993] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: : Instructing follower dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:41.072274 15452 raft_consensus.cc:1081] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 LEADER]: Signalling peer dc9ebec2cc424110b05846fe152c46e8 to start an election
I20260709 13:16:41.074110 15199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a"
dest_uuid: "dc9ebec2cc424110b05846fe152c46e8"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:16:41.074536 15199 raft_consensus.cc:493] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:41.074772 15199 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.079026 15199 raft_consensus.cc:515] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:41.081037 15199 leader_election.cc:290] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 5 election: Requested vote from peers 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397), d7ad0c5bd79b4deda1423b48b4bb4b25 (127.14.41.67:35859)
I20260709 13:16:41.081840 15124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe"
I20260709 13:16:41.082226 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31d13ff3608946869c9f0c9d2dbb409a" candidate_uuid: "dc9ebec2cc424110b05846fe152c46e8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25"
I20260709 13:16:41.082531 15124 raft_consensus.cc:3055] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:41.082803 15272 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.082854 15124 raft_consensus.cc:740] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4ca70c2ed8b84015bd7db5aa52d3e1fe, State: Running, Role: LEADER
I20260709 13:16:41.083667 15124 consensus_queue.cc:260] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:41.084589 15124 raft_consensus.cc:3060] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:41.087663 15272 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 5.
I20260709 13:16:41.088802 15164 leader_election.cc:304] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7ad0c5bd79b4deda1423b48b4bb4b25, dc9ebec2cc424110b05846fe152c46e8; no voters: 
I20260709 13:16:41.089613 15419 raft_consensus.cc:2804] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:41.090031 15419 raft_consensus.cc:697] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 5 LEADER]: Becoming Leader. State: Replica: dc9ebec2cc424110b05846fe152c46e8, State: Running, Role: LEADER
I20260709 13:16:41.090099 15124 raft_consensus.cc:2468] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc9ebec2cc424110b05846fe152c46e8 in term 5.
I20260709 13:16:41.090905 15419 consensus_queue.cc:237] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } }
I20260709 13:16:41.098472 15020 catalog_manager.cc:5697] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 reported cstate change: term changed from 4 to 5, leader changed from 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65) to dc9ebec2cc424110b05846fe152c46e8 (127.14.41.66). New cstate: current_term: 5 leader_uuid: "dc9ebec2cc424110b05846fe152c46e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:41.427676 15124 raft_consensus.cc:1275] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:41.429008 15321 consensus_queue.cc:1048] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:41.434175 15199 raft_consensus.cc:1275] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:41.435766 15321 consensus_queue.cc:1048] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:41.444974 15123 raft_consensus.cc:1275] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:41.447512 15419 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:41.453547 15199 raft_consensus.cc:1275] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:41.455212 15461 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9ebec2cc424110b05846fe152c46e8" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 36351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:41.463575 15272 raft_consensus.cc:1275] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:41.465138 15456 consensus_queue.cc:1048] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:41.477093 15124 raft_consensus.cc:1275] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Refusing update from remote peer d7ad0c5bd79b4deda1423b48b4bb4b25: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:41.479393 15273 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 5 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:41.479578 15321 consensus_queue.cc:1048] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:41.482930 15456 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ad0c5bd79b4deda1423b48b4bb4b25" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 35859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:41.497469 15124 raft_consensus.cc:1275] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 5 FOLLOWER]: Refusing update from remote peer dc9ebec2cc424110b05846fe152c46e8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:41.499787 15467 consensus_queue.cc:1048] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ca70c2ed8b84015bd7db5aa52d3e1fe" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:41.874006 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:41.879779 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
I20260709 13:16:41.905361 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:41.906136 14501 tablet_replica.cc:333] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.906729 14501 raft_consensus.cc:2243] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.907169 14501 raft_consensus.cc:2272] T 2216c45c25474faeae0bc0e53f28eac9 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.909046 14501 tablet_replica.cc:333] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.909585 14501 raft_consensus.cc:2243] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.910005 14501 raft_consensus.cc:2272] T c7fe7f03e9574229876893f65655b92e P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.911648 14501 tablet_replica.cc:333] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.912194 14501 raft_consensus.cc:2243] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.912976 14501 raft_consensus.cc:2272] T b46a09f1bea7442f8c88ea4cda3c092f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.914669 14501 tablet_replica.cc:333] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.915161 14501 raft_consensus.cc:2243] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.915547 14501 raft_consensus.cc:2272] T 96d2e5e8e52d494db194a885d75a9c86 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.917683 14501 tablet_replica.cc:333] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.918170 14501 raft_consensus.cc:2243] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.918557 14501 raft_consensus.cc:2272] T 98f022702d97442d8602d3e82abb2f1b P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.920557 14501 tablet_replica.cc:333] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.921103 14501 raft_consensus.cc:2243] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.921844 14501 raft_consensus.cc:2272] T 5888b8d696f4407b901fe38539a1d91f P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.923990 14501 tablet_replica.cc:333] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.924659 14501 raft_consensus.cc:2243] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.925554 14501 raft_consensus.cc:2272] T c57f1254f5cc4df38dd28f480e80a8d6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.927556 14501 tablet_replica.cc:333] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.928016 14501 raft_consensus.cc:2243] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:41.928807 14501 raft_consensus.cc:2272] T 8e128b3830c649818b474d995ca3f9b6 P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.930552 14501 tablet_replica.cc:333] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.931015 14501 raft_consensus.cc:2243] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.931406 14501 raft_consensus.cc:2272] T 31d13ff3608946869c9f0c9d2dbb409a P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.933615 14501 tablet_replica.cc:333] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe: stopping tablet replica
I20260709 13:16:41.934063 14501 raft_consensus.cc:2243] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:41.934450 14501 raft_consensus.cc:2272] T 18050e7c7a744e5d890bdaa4e8fa0a5c P 4ca70c2ed8b84015bd7db5aa52d3e1fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:41.963308 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
I20260709 13:16:41.983377 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
W20260709 13:16:41.992974 15238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:38397: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 13:16:42.000159 15238 consensus_peers.cc:597] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 -> Peer 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397): Couldn't send request to peer 4ca70c2ed8b84015bd7db5aa52d3e1fe. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:38397: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.011680 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:42.012460 14501 tablet_replica.cc:333] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.013106 14501 raft_consensus.cc:2243] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.013604 14501 raft_consensus.cc:2272] T 2216c45c25474faeae0bc0e53f28eac9 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.015370 14501 tablet_replica.cc:333] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.015863 14501 raft_consensus.cc:2243] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.016700 14501 raft_consensus.cc:2272] T c7fe7f03e9574229876893f65655b92e P dc9ebec2cc424110b05846fe152c46e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.018339 14501 tablet_replica.cc:333] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.018868 14501 raft_consensus.cc:2243] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.019297 14501 raft_consensus.cc:2272] T b46a09f1bea7442f8c88ea4cda3c092f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.021050 14501 tablet_replica.cc:333] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.021584 14501 raft_consensus.cc:2243] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.022068 14501 raft_consensus.cc:2272] T 98f022702d97442d8602d3e82abb2f1b P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.024744 14501 tablet_replica.cc:333] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.025278 14501 raft_consensus.cc:2243] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.026013 14501 raft_consensus.cc:2272] T 96d2e5e8e52d494db194a885d75a9c86 P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.028069 14501 tablet_replica.cc:333] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.028653 14501 raft_consensus.cc:2243] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.029135 14501 raft_consensus.cc:2272] T 5888b8d696f4407b901fe38539a1d91f P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.030876 14501 tablet_replica.cc:333] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.031368 14501 raft_consensus.cc:2243] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.032085 14501 raft_consensus.cc:2272] T 31d13ff3608946869c9f0c9d2dbb409a P dc9ebec2cc424110b05846fe152c46e8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.034165 14501 tablet_replica.cc:333] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.034651 14501 raft_consensus.cc:2243] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.035060 14501 raft_consensus.cc:2272] T 18050e7c7a744e5d890bdaa4e8fa0a5c P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.037304 14501 tablet_replica.cc:333] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.037796 14501 raft_consensus.cc:2243] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.038249 14501 raft_consensus.cc:2272] T 8e128b3830c649818b474d995ca3f9b6 P dc9ebec2cc424110b05846fe152c46e8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.039868 14501 tablet_replica.cc:333] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8: stopping tablet replica
I20260709 13:16:42.040303 14501 raft_consensus.cc:2243] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.040776 14501 raft_consensus.cc:2272] T c57f1254f5cc4df38dd28f480e80a8d6 P dc9ebec2cc424110b05846fe152c46e8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.068538 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
W20260709 13:16:42.079494 15238 consensus_peers.cc:597] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 -> Peer 4ca70c2ed8b84015bd7db5aa52d3e1fe (127.14.41.65:38397): Couldn't send request to peer 4ca70c2ed8b84015bd7db5aa52d3e1fe. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:38397: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:42.088935 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
I20260709 13:16:42.112216 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:16:42.113019 14501 tablet_replica.cc:333] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.113922 14501 raft_consensus.cc:2243] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.114579 14501 raft_consensus.cc:2272] T 96d2e5e8e52d494db194a885d75a9c86 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.116807 14501 tablet_replica.cc:333] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.117306 14501 raft_consensus.cc:2243] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.118010 14501 raft_consensus.cc:2272] T 2216c45c25474faeae0bc0e53f28eac9 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.119622 14501 tablet_replica.cc:333] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.120083 14501 raft_consensus.cc:2243] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.120409 14501 raft_consensus.cc:2272] T c7fe7f03e9574229876893f65655b92e P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.122035 14501 tablet_replica.cc:333] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.122467 14501 raft_consensus.cc:2243] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.122812 14501 raft_consensus.cc:2272] T b46a09f1bea7442f8c88ea4cda3c092f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.124317 14501 tablet_replica.cc:333] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.124826 14501 raft_consensus.cc:2243] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.125428 14501 raft_consensus.cc:2272] T 98f022702d97442d8602d3e82abb2f1b P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.127329 14501 tablet_replica.cc:333] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.127769 14501 raft_consensus.cc:2243] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.128237 14501 raft_consensus.cc:2272] T 31d13ff3608946869c9f0c9d2dbb409a P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.130261 14501 tablet_replica.cc:333] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.130694 14501 raft_consensus.cc:2243] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.131282 14501 raft_consensus.cc:2272] T 18050e7c7a744e5d890bdaa4e8fa0a5c P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.133113 14501 tablet_replica.cc:333] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.133524 14501 raft_consensus.cc:2243] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.133860 14501 raft_consensus.cc:2272] T 5888b8d696f4407b901fe38539a1d91f P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.135355 14501 tablet_replica.cc:333] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.135735 14501 raft_consensus.cc:2243] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.136061 14501 raft_consensus.cc:2272] T 8e128b3830c649818b474d995ca3f9b6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.137642 14501 tablet_replica.cc:333] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25: stopping tablet replica
I20260709 13:16:42.138022 14501 raft_consensus.cc:2243] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:42.138337 14501 raft_consensus.cc:2272] T c57f1254f5cc4df38dd28f480e80a8d6 P d7ad0c5bd79b4deda1423b48b4bb4b25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.165938 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:16:42.185374 14501 master.cc:562] Master@127.14.41.126:35819 shutting down...
I20260709 13:16:42.206291 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:16:42.206796 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:42.207079 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P fcbc744defce404fb775333e2ef2742e: stopping tablet replica
I20260709 13:16:42.227087 14501 master.cc:584] Master@127.14.41.126:35819 shutdown complete.
4ca70c2ed8b84015bd7db5aa52d3e1fe  5
d7ad0c5bd79b4deda1423b48b4bb4b25  1
dc9ebec2cc424110b05846fe152c46e8  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10327 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:16:42.270315 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:40467
I20260709 13:16:42.271409 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.277469 15475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.277787 15476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.278177 15478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.278900 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:42.279716 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.279922 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.280077 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603002280057 us; error 0 us; skew 500 ppm
I20260709 13:16:42.280581 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.282949 14501 webserver.cc:533] Webserver started at http://127.14.41.126:44707/ using document root <none> and password file <none>
I20260709 13:16:42.283434 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.283628 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.283910 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.285101 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "c996756dd34f40be806bd3ad4744f303"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.289438 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:16:42.292757 15483 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.293607 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:16:42.293853 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "c996756dd34f40be806bd3ad4744f303"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.294098 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.308418 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.309684 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.348739 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:40467
I20260709 13:16:42.348897 15534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:40467 every 8 connection(s)
I20260709 13:16:42.352566 15535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:42.362803 15535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Bootstrap starting.
I20260709 13:16:42.367753 15535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:42.372148 15535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: No bootstrap required, opened a new log
I20260709 13:16:42.374426 15535 raft_consensus.cc:359] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c996756dd34f40be806bd3ad4744f303" member_type: VOTER }
I20260709 13:16:42.374827 15535 raft_consensus.cc:385] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:42.375098 15535 raft_consensus.cc:740] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c996756dd34f40be806bd3ad4744f303, State: Initialized, Role: FOLLOWER
I20260709 13:16:42.375782 15535 consensus_queue.cc:260] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c996756dd34f40be806bd3ad4744f303" member_type: VOTER }
I20260709 13:16:42.376277 15535 raft_consensus.cc:399] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:16:42.376510 15535 raft_consensus.cc:493] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:16:42.376848 15535 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:42.381201 15535 raft_consensus.cc:515] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c996756dd34f40be806bd3ad4744f303" member_type: VOTER }
I20260709 13:16:42.381758 15535 leader_election.cc:304] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c996756dd34f40be806bd3ad4744f303; no voters: 
I20260709 13:16:42.382886 15535 leader_election.cc:290] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:16:42.383314 15538 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:42.384661 15538 raft_consensus.cc:697] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 1 LEADER]: Becoming Leader. State: Replica: c996756dd34f40be806bd3ad4744f303, State: Running, Role: LEADER
I20260709 13:16:42.385363 15538 consensus_queue.cc:237] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c996756dd34f40be806bd3ad4744f303" member_type: VOTER }
I20260709 13:16:42.385963 15535 sys_catalog.cc:565] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:16:42.389891 15539 sys_catalog.cc:455] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c996756dd34f40be806bd3ad4744f303" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c996756dd34f40be806bd3ad4744f303" member_type: VOTER } }
I20260709 13:16:42.390512 15539 sys_catalog.cc:458] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:42.390323 15540 sys_catalog.cc:455] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c996756dd34f40be806bd3ad4744f303. Latest consensus state: current_term: 1 leader_uuid: "c996756dd34f40be806bd3ad4744f303" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c996756dd34f40be806bd3ad4744f303" member_type: VOTER } }
I20260709 13:16:42.390825 15540 sys_catalog.cc:458] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [sys.catalog]: This master's current role is: LEADER
I20260709 13:16:42.393860 15545 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:16:42.399216 15545 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:16:42.403039 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:16:42.408006 15545 catalog_manager.cc:1383] Generated new cluster ID: 15f50b12dda34bce87db5028cf6a3f20
I20260709 13:16:42.408311 15545 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:16:42.430934 15545 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:16:42.432205 15545 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:16:42.447284 15545 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Generated new TSK 0
I20260709 13:16:42.447964 15545 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:16:42.469794 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.475515 15556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.477174 15557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.478857 15559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.479839 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:42.480803 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.481034 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.481256 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603002481229 us; error 0 us; skew 500 ppm
I20260709 13:16:42.481799 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.484356 14501 webserver.cc:533] Webserver started at http://127.14.41.65:46287/ using document root <none> and password file <none>
I20260709 13:16:42.484913 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.485137 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.485404 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.486505 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "558532223b984cf796cb6b98ddd6c9f2"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.491279 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:16:42.494712 15564 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.495545 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:42.495904 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "558532223b984cf796cb6b98ddd6c9f2"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.496244 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.532775 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.534111 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.535740 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:42.538335 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:42.538609 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.538887 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:42.539088 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.580642 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:33667
I20260709 13:16:42.580806 15626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:33667 every 8 connection(s)
I20260709 13:16:42.585668 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.593037 15631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.593627 15632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.596866 14501 server_base.cc:1061] running on GCE node
W20260709 13:16:42.596952 15634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.598351 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.598564 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.598703 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603002598691 us; error 0 us; skew 500 ppm
I20260709 13:16:42.599176 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.601913 14501 webserver.cc:533] Webserver started at http://127.14.41.66:41229/ using document root <none> and password file <none>
I20260709 13:16:42.602566 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.602824 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.603148 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.603849 15627 heartbeater.cc:344] Connected to a master server at 127.14.41.126:40467
I20260709 13:16:42.604205 15627 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:42.604707 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "7019261981c6431baddd6812c15ac678"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.605059 15627 heartbeater.cc:507] Master 127.14.41.126:40467 requested a full tablet report, sending...
I20260709 13:16:42.607322 15500 ts_manager.cc:194] Registered new tserver with Master: 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:16:42.609771 15500 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46306
I20260709 13:16:42.610443 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:16:42.614037 15639 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.614807 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:16:42.615129 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "7019261981c6431baddd6812c15ac678"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.615453 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.637104 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.638341 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.639875 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:42.642268 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:42.642508 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.642771 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:42.642944 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.684237 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:33941
I20260709 13:16:42.684351 15701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:33941 every 8 connection(s)
I20260709 13:16:42.689087 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:42.697778 15705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.699188 15706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:42.702307 15708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:42.702682 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:42.703701 15702 heartbeater.cc:344] Connected to a master server at 127.14.41.126:40467
I20260709 13:16:42.704074 15702 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:42.704039 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:42.704411 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:42.704645 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603002704592 us; error 0 us; skew 500 ppm
I20260709 13:16:42.705031 15702 heartbeater.cc:507] Master 127.14.41.126:40467 requested a full tablet report, sending...
I20260709 13:16:42.705224 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:42.707531 15500 ts_manager.cc:194] Registered new tserver with Master: 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:42.708307 14501 webserver.cc:533] Webserver started at http://127.14.41.67:34797/ using document root <none> and password file <none>
I20260709 13:16:42.708973 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:42.709208 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:42.709510 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:42.709472 15500 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46310
I20260709 13:16:42.711131 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "5433f0c9863e427d88ba5916819e28e3"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.715590 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:16:42.719115 15713 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.719998 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:16:42.720343 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "5433f0c9863e427d88ba5916819e28e3"
format_stamp: "Formatted at 2026-07-09 13:16:42 on dist-test-slave-56lb"
I20260709 13:16:42.720715 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:42.770568 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:42.772105 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:42.773733 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:42.776376 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:42.776659 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.776933 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:42.777113 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:42.819667 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:40623
I20260709 13:16:42.819763 15775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:40623 every 8 connection(s)
I20260709 13:16:42.833710 15776 heartbeater.cc:344] Connected to a master server at 127.14.41.126:40467
I20260709 13:16:42.834223 15776 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:42.834959 15776 heartbeater.cc:507] Master 127.14.41.126:40467 requested a full tablet report, sending...
I20260709 13:16:42.836969 15500 ts_manager.cc:194] Registered new tserver with Master: 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:42.837692 14501 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014728746s
I20260709 13:16:42.838584 15500 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46324
I20260709 13:16:42.864768 15500 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46334:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:16:42.871003 15500 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:16:43.083758 15741 tablet_service.cc:1511] Processing CreateTablet for tablet 95f2c1f9b34a4914bc89224fb8100cd5 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:43.085304 15741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f2c1f9b34a4914bc89224fb8100cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.085021 15740 tablet_service.cc:1511] Processing CreateTablet for tablet 16817d3f588f45019ebd19d0c1915814 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:43.086539 15740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16817d3f588f45019ebd19d0c1915814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.087049 15589 tablet_service.cc:1511] Processing CreateTablet for tablet 889d20b228a74f7abdc0104e2529c28d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:43.088433 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 889d20b228a74f7abdc0104e2529c28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.099164 15735 tablet_service.cc:1511] Processing CreateTablet for tablet c248e8afdd4142d983c50c91087d8e01 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:43.100813 15735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c248e8afdd4142d983c50c91087d8e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.104833 15736 tablet_service.cc:1511] Processing CreateTablet for tablet 9b90fe6b2a274b68b50cf564b626c03e (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:43.106228 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b90fe6b2a274b68b50cf564b626c03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.110028 15737 tablet_service.cc:1511] Processing CreateTablet for tablet ea2d5bac8fb54783a1f420061d08067f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:43.111943 15737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2d5bac8fb54783a1f420061d08067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.088882 15666 tablet_service.cc:1511] Processing CreateTablet for tablet 16817d3f588f45019ebd19d0c1915814 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:43.089740 15592 tablet_service.cc:1511] Processing CreateTablet for tablet 95f2c1f9b34a4914bc89224fb8100cd5 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:43.090683 15590 tablet_service.cc:1511] Processing CreateTablet for tablet bea9d89f73eb4c36b8a8270cda937174 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:43.113812 15666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16817d3f588f45019ebd19d0c1915814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.114444 15592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f2c1f9b34a4914bc89224fb8100cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.116557 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea9d89f73eb4c36b8a8270cda937174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.091460 15591 tablet_service.cc:1511] Processing CreateTablet for tablet 16817d3f588f45019ebd19d0c1915814 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:16:43.092450 15739 tablet_service.cc:1511] Processing CreateTablet for tablet bea9d89f73eb4c36b8a8270cda937174 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:43.120785 15591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16817d3f588f45019ebd19d0c1915814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.120920 15739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea9d89f73eb4c36b8a8270cda937174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.093246 15664 tablet_service.cc:1511] Processing CreateTablet for tablet 889d20b228a74f7abdc0104e2529c28d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:43.094441 15667 tablet_service.cc:1511] Processing CreateTablet for tablet 95f2c1f9b34a4914bc89224fb8100cd5 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:16:43.123715 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 889d20b228a74f7abdc0104e2529c28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.094930 15663 tablet_service.cc:1511] Processing CreateTablet for tablet ea2d5bac8fb54783a1f420061d08067f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:43.124871 15663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2d5bac8fb54783a1f420061d08067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.096220 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 9b90fe6b2a274b68b50cf564b626c03e (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:43.129606 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b90fe6b2a274b68b50cf564b626c03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.096698 15662 tablet_service.cc:1511] Processing CreateTablet for tablet 9b90fe6b2a274b68b50cf564b626c03e (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:16:43.133502 15662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b90fe6b2a274b68b50cf564b626c03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.098090 15586 tablet_service.cc:1511] Processing CreateTablet for tablet c248e8afdd4142d983c50c91087d8e01 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:43.137570 15586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c248e8afdd4142d983c50c91087d8e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.098587 15661 tablet_service.cc:1511] Processing CreateTablet for tablet c248e8afdd4142d983c50c91087d8e01 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:16:43.141466 15661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c248e8afdd4142d983c50c91087d8e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.145825 15585 tablet_service.cc:1511] Processing CreateTablet for tablet 06c670aee4b042d2aa73b9c2ec68245f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:43.147223 15585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c670aee4b042d2aa73b9c2ec68245f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.091492 15665 tablet_service.cc:1511] Processing CreateTablet for tablet bea9d89f73eb4c36b8a8270cda937174 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:16:43.149559 15665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea9d89f73eb4c36b8a8270cda937174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.093254 15588 tablet_service.cc:1511] Processing CreateTablet for tablet ea2d5bac8fb54783a1f420061d08067f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:16:43.153424 15588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2d5bac8fb54783a1f420061d08067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.088716 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 889d20b228a74f7abdc0104e2529c28d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:16:43.157371 15660 tablet_service.cc:1511] Processing CreateTablet for tablet 06c670aee4b042d2aa73b9c2ec68245f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:43.160946 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 889d20b228a74f7abdc0104e2529c28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.162477 15739 tablet_service.cc:1511] Processing CreateTablet for tablet 06c670aee4b042d2aa73b9c2ec68245f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:16:43.163738 15739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c670aee4b042d2aa73b9c2ec68245f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.165940 15741 tablet_service.cc:1511] Processing CreateTablet for tablet dbde144556724eb39acadbe99d8a1de3 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:43.167207 15741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbde144556724eb39acadbe99d8a1de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.172504 15584 tablet_service.cc:1511] Processing CreateTablet for tablet dbde144556724eb39acadbe99d8a1de3 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:43.175733 15792 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:43.177531 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f2c1f9b34a4914bc89224fb8100cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.183070 15734 tablet_service.cc:1511] Processing CreateTablet for tablet f6a774e81f58442c90fd80ad59687b99 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:43.184671 15659 tablet_service.cc:1511] Processing CreateTablet for tablet dbde144556724eb39acadbe99d8a1de3 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:16:43.189720 15658 tablet_service.cc:1511] Processing CreateTablet for tablet f6a774e81f58442c90fd80ad59687b99 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:43.204846 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a774e81f58442c90fd80ad59687b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.205657 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a774e81f58442c90fd80ad59687b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.198195 15583 tablet_service.cc:1511] Processing CreateTablet for tablet f6a774e81f58442c90fd80ad59687b99 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:16:43.217101 15660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c670aee4b042d2aa73b9c2ec68245f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.199944 15590 tablet_service.cc:1511] Processing CreateTablet for tablet ffd4ffeb1af146f384319d74146b93f6 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:43.227036 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbde144556724eb39acadbe99d8a1de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.235589 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a774e81f58442c90fd80ad59687b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.235193 15666 tablet_service.cc:1511] Processing CreateTablet for tablet ffd4ffeb1af146f384319d74146b93f6 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:43.235235 15659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbde144556724eb39acadbe99d8a1de3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.242110 15666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd4ffeb1af146f384319d74146b93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.262681 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd4ffeb1af146f384319d74146b93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.270874 15736 tablet_service.cc:1511] Processing CreateTablet for tablet ffd4ffeb1af146f384319d74146b93f6 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:16:43.272279 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd4ffeb1af146f384319d74146b93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.273494 15791 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:43.275835 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 7b872b4d6b684a548289e080316a1b94 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:43.277419 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b872b4d6b684a548289e080316a1b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.273249 15737 tablet_service.cc:1511] Processing CreateTablet for tablet 7b872b4d6b684a548289e080316a1b94 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:43.285318 15737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b872b4d6b684a548289e080316a1b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.294268 15589 tablet_service.cc:1511] Processing CreateTablet for tablet 75de3a46207e4bcfb457cdc43ffba2e2 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:43.296206 15792 tablet_bootstrap.cc:654] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.296267 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75de3a46207e4bcfb457cdc43ffba2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.309630 15663 tablet_service.cc:1511] Processing CreateTablet for tablet 7b872b4d6b684a548289e080316a1b94 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:16:43.317052 15664 tablet_service.cc:1511] Processing CreateTablet for tablet 75de3a46207e4bcfb457cdc43ffba2e2 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:43.318650 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75de3a46207e4bcfb457cdc43ffba2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.320960 15791 tablet_bootstrap.cc:654] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.322163 15793 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:43.323565 15663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b872b4d6b684a548289e080316a1b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.332088 15792 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:43.332685 15792 ts_tablet_manager.cc:1403] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.009s
I20260709 13:16:43.334968 15590 tablet_service.cc:1511] Processing CreateTablet for tablet bda38eb6cdcc4738a2dc39a9bec091f0 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:43.335589 15792 raft_consensus.cc:359] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.336301 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda38eb6cdcc4738a2dc39a9bec091f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.336706 15734 tablet_service.cc:1511] Processing CreateTablet for tablet 75de3a46207e4bcfb457cdc43ffba2e2 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:16:43.345433 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75de3a46207e4bcfb457cdc43ffba2e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.346596 15667 tablet_service.cc:1511] Processing CreateTablet for tablet bda38eb6cdcc4738a2dc39a9bec091f0 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:43.347785 15792 raft_consensus.cc:385] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.348237 15792 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.349164 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda38eb6cdcc4738a2dc39a9bec091f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.348994 15792 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.352272 15736 tablet_service.cc:1511] Processing CreateTablet for tablet bda38eb6cdcc4738a2dc39a9bec091f0 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:16:43.358469 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda38eb6cdcc4738a2dc39a9bec091f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.361486 15583 tablet_service.cc:1511] Processing CreateTablet for tablet 81dbf9e63ec84d138474082a1d0293c0 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:43.363546 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dbf9e63ec84d138474082a1d0293c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.381356 15791 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:43.381906 15791 ts_tablet_manager.cc:1403] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.109s	user 0.020s	sys 0.021s
I20260709 13:16:43.381677 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 81dbf9e63ec84d138474082a1d0293c0 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:43.382963 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dbf9e63ec84d138474082a1d0293c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.384865 15791 raft_consensus.cc:359] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.385586 15791 raft_consensus.cc:385] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.385921 15791 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.386650 15791 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.393569 15793 tablet_bootstrap.cc:654] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.397882 15667 tablet_service.cc:1511] Processing CreateTablet for tablet 81dbf9e63ec84d138474082a1d0293c0 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:16:43.399781 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81dbf9e63ec84d138474082a1d0293c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:43.399655 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:43.414407 15627 heartbeater.cc:499] Master 127.14.41.126:40467 was elected leader, sending a full tablet report...
I20260709 13:16:43.422297 15583 tablet_service.cc:1511] Processing CreateTablet for tablet 97765616b2ca49eca1b5b2c90a10c9a3 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:43.423703 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97765616b2ca49eca1b5b2c90a10c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.433297 15776 heartbeater.cc:499] Master 127.14.41.126:40467 was elected leader, sending a full tablet report...
I20260709 13:16:43.437673 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 97765616b2ca49eca1b5b2c90a10c9a3 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:43.438297 15734 tablet_service.cc:1511] Processing CreateTablet for tablet f95117d3c05146d9a1c2b5c9158dc457 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:43.439298 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97765616b2ca49eca1b5b2c90a10c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.442476 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95117d3c05146d9a1c2b5c9158dc457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.443341 15660 tablet_service.cc:1511] Processing CreateTablet for tablet f95117d3c05146d9a1c2b5c9158dc457 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:43.444578 15791 ts_tablet_manager.cc:1434] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.062s	user 0.019s	sys 0.031s
I20260709 13:16:43.444621 15660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95117d3c05146d9a1c2b5c9158dc457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.447515 15589 tablet_service.cc:1511] Processing CreateTablet for tablet e1e65bafed7145eb85b802c6c68a9129 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:43.448768 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e65bafed7145eb85b802c6c68a9129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.449316 15667 tablet_service.cc:1511] Processing CreateTablet for tablet 97765616b2ca49eca1b5b2c90a10c9a3 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:16:43.449754 15737 tablet_service.cc:1511] Processing CreateTablet for tablet e1e65bafed7145eb85b802c6c68a9129 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:43.450546 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97765616b2ca49eca1b5b2c90a10c9a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.451020 15737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e65bafed7145eb85b802c6c68a9129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.453637 15792 ts_tablet_manager.cc:1434] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.121s	user 0.013s	sys 0.015s
I20260709 13:16:43.454206 15740 tablet_service.cc:1511] Processing CreateTablet for tablet eaaf7f7575314c29a12eedde1fe321a7 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:43.458969 15740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaf7f7575314c29a12eedde1fe321a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.455215 15664 tablet_service.cc:1511] Processing CreateTablet for tablet e1e65bafed7145eb85b802c6c68a9129 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:16:43.445688 15791 tablet_bootstrap.cc:492] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:43.461243 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e65bafed7145eb85b802c6c68a9129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.455653 15590 tablet_service.cc:1511] Processing CreateTablet for tablet eaaf7f7575314c29a12eedde1fe321a7 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:43.463709 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaf7f7575314c29a12eedde1fe321a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.459106 15792 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:43.473788 15793 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:43.474431 15793 ts_tablet_manager.cc:1403] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.010s
I20260709 13:16:43.477576 15793 raft_consensus.cc:359] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.457327 15666 tablet_service.cc:1511] Processing CreateTablet for tablet eaaf7f7575314c29a12eedde1fe321a7 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:16:43.478770 15791 tablet_bootstrap.cc:654] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.487926 15587 tablet_service.cc:1511] Processing CreateTablet for tablet f2d6a74c6b234911b02521773c4fdddf (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:43.489707 15666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaf7f7575314c29a12eedde1fe321a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.457227 15583 tablet_service.cc:1511] Processing CreateTablet for tablet f95117d3c05146d9a1c2b5c9158dc457 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:16:43.492578 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d6a74c6b234911b02521773c4fdddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.493371 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f95117d3c05146d9a1c2b5c9158dc457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.504733 15793 raft_consensus.cc:385] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.505153 15793 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.506177 15793 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.515575 15792 tablet_bootstrap.cc:654] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.522544 15791 tablet_bootstrap.cc:492] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:43.523257 15791 ts_tablet_manager.cc:1403] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.012s
I20260709 13:16:43.531370 15791 raft_consensus.cc:359] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:43.536767 15791 raft_consensus.cc:385] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.537230 15791 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.538177 15791 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:43.541574 15736 tablet_service.cc:1511] Processing CreateTablet for tablet f2d6a74c6b234911b02521773c4fdddf (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:43.544112 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d6a74c6b234911b02521773c4fdddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.547047 15702 heartbeater.cc:499] Master 127.14.41.126:40467 was elected leader, sending a full tablet report...
I20260709 13:16:43.550500 15793 ts_tablet_manager.cc:1434] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.076s	user 0.027s	sys 0.006s
I20260709 13:16:43.551582 15793 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:43.553819 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 1301eda70cfb4417abc2a2d90b4bf0e8 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:43.557400 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1301eda70cfb4417abc2a2d90b4bf0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.558466 15667 tablet_service.cc:1511] Processing CreateTablet for tablet f2d6a74c6b234911b02521773c4fdddf (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:16:43.559777 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d6a74c6b234911b02521773c4fdddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.556097 15793 tablet_bootstrap.cc:654] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.567938 15791 ts_tablet_manager.cc:1434] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:16:43.569061 15791 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:43.572373 15666 tablet_service.cc:1511] Processing CreateTablet for tablet 1301eda70cfb4417abc2a2d90b4bf0e8 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:43.575027 15666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1301eda70cfb4417abc2a2d90b4bf0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.576483 15800 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.577212 15800 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.591787 15791 tablet_bootstrap.cc:654] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.595433 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee7f36a2ae4477291b5b34ce26ac07c (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:43.597020 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee7f36a2ae4477291b5b34ce26ac07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.603613 15800 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:43.615180 15664 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee7f36a2ae4477291b5b34ce26ac07c (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:43.616981 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee7f36a2ae4477291b5b34ce26ac07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.618474 15797 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.619127 15797 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:43.622762 15797 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:43.642318 15583 tablet_service.cc:1511] Processing CreateTablet for tablet b42c9970a1a64670ba11510d9c0c1809 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:43.646723 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42c9970a1a64670ba11510d9c0c1809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.647526 15667 tablet_service.cc:1511] Processing CreateTablet for tablet b42c9970a1a64670ba11510d9c0c1809 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:43.648702 15792 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:43.648846 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42c9970a1a64670ba11510d9c0c1809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.649201 15792 ts_tablet_manager.cc:1403] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.190s	user 0.020s	sys 0.014s
I20260709 13:16:43.657709 15791 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:43.657579 15792 raft_consensus.cc:359] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.668478 15792 raft_consensus.cc:385] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.668872 15792 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.669657 15792 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.671547 15792 ts_tablet_manager.cc:1434] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:16:43.672386 15792 tablet_bootstrap.cc:492] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:43.675401 15793 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:43.675904 15793 ts_tablet_manager.cc:1403] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.052s
I20260709 13:16:43.679111 15793 raft_consensus.cc:359] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.679924 15793 raft_consensus.cc:385] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.680259 15793 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.658291 15791 ts_tablet_manager.cc:1403] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.021s
I20260709 13:16:43.658165 15590 tablet_service.cc:1511] Processing CreateTablet for tablet 32d6629b913f439393c69fd7e6b8a55d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:43.681540 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d6629b913f439393c69fd7e6b8a55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.683586 15791 raft_consensus.cc:359] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.684379 15791 raft_consensus.cc:385] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.659829 15660 tablet_service.cc:1511] Processing CreateTablet for tablet 32d6629b913f439393c69fd7e6b8a55d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:43.684711 15791 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.685441 15660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d6629b913f439393c69fd7e6b8a55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.685518 15791 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.687891 15791 ts_tablet_manager.cc:1434] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 13:16:43.688977 15791 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:43.689904 15667 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc37ba667f048359988247ddb2d7f5b (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:43.691303 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc37ba667f048359988247ddb2d7f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.695504 15791 tablet_bootstrap.cc:654] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.711360 15792 tablet_bootstrap.cc:654] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.711596 15663 tablet_service.cc:1511] Processing CreateTablet for tablet 86c5f054f586412fbd8a416245340d63 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:43.713397 15663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c5f054f586412fbd8a416245340d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.713048 15793 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.715355 15793 ts_tablet_manager.cc:1434] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:16:43.716325 15793 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:43.719462 15589 tablet_service.cc:1511] Processing CreateTablet for tablet 86c5f054f586412fbd8a416245340d63 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:43.720793 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c5f054f586412fbd8a416245340d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.721621 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc37ba667f048359988247ddb2d7f5b (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:43.722927 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc37ba667f048359988247ddb2d7f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.724990 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:43.725721 15602 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:43.729429 15640 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:43.730512 15800 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.730880 15800 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.731189 15800 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.734459 15736 tablet_service.cc:1511] Processing CreateTablet for tablet 1301eda70cfb4417abc2a2d90b4bf0e8 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:16:43.735824 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1301eda70cfb4417abc2a2d90b4bf0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.738634 15800 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.746145 15740 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee7f36a2ae4477291b5b34ce26ac07c (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:16:43.747498 15740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee7f36a2ae4477291b5b34ce26ac07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.753710 15793 tablet_bootstrap.cc:654] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.754175 15737 tablet_service.cc:1511] Processing CreateTablet for tablet b42c9970a1a64670ba11510d9c0c1809 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:16:43.755570 15737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b42c9970a1a64670ba11510d9c0c1809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.757004 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:43.757635 15602 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.762146 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 32d6629b913f439393c69fd7e6b8a55d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:16:43.762388 15734 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc37ba667f048359988247ddb2d7f5b (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:16:43.763602 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32d6629b913f439393c69fd7e6b8a55d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.763396 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:43.764173 15739 tablet_service.cc:1511] Processing CreateTablet for tablet 86c5f054f586412fbd8a416245340d63 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:16:43.764989 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:43.765659 15739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c5f054f586412fbd8a416245340d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.769160 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc37ba667f048359988247ddb2d7f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.769572 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:43.772392 15602 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:43.773882 15640 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:43.778239 15800 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:43.778878 15800 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:43.779347 15800 raft_consensus.cc:697] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:43.781947 15797 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.782441 15797 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.784471 15797 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:43.780400 15800 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.788762 15589 tablet_service.cc:1511] Processing CreateTablet for tablet f900b71a39b14f0e92515320b011e9a1 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:43.790215 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f900b71a39b14f0e92515320b011e9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.792065 15796 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.792567 15796 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:43.797326 15642 leader_election.cc:343] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.798018 15796 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:16:43.798571 15642 leader_election.cc:343] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.800829 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:43.801530 15677 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:43.792589 15664 tablet_service.cc:1511] Processing CreateTablet for tablet f900b71a39b14f0e92515320b011e9a1 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:43.805365 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f900b71a39b14f0e92515320b011e9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.808732 15791 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:43.809324 15791 ts_tablet_manager.cc:1403] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.024s
I20260709 13:16:43.812366 15791 raft_consensus.cc:359] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.806387 15793 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
W20260709 13:16:43.803653 15714 leader_election.cc:343] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.823459 15793 ts_tablet_manager.cc:1403] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.002s
I20260709 13:16:43.825277 15666 tablet_service.cc:1511] Processing CreateTablet for tablet 6388e92df0fa4fac9a75573887c28fd9 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:43.826713 15666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6388e92df0fa4fac9a75573887c28fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.827076 15793 raft_consensus.cc:359] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.816442 15791 raft_consensus.cc:385] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.830158 15667 tablet_service.cc:1511] Processing CreateTablet for tablet e80fb58800714a47b47ac1e701a9400f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:43.830407 15590 tablet_service.cc:1511] Processing CreateTablet for tablet e80fb58800714a47b47ac1e701a9400f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:43.830724 15583 tablet_service.cc:1511] Processing CreateTablet for tablet 6388e92df0fa4fac9a75573887c28fd9 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:43.831918 15791 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.837126 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:43.833606 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80fb58800714a47b47ac1e701a9400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.837615 15791 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.840315 15791 ts_tablet_manager.cc:1434] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:16:43.840969 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:43.830542 15498 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.840971 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6388e92df0fa4fac9a75573887c28fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.832157 15793 raft_consensus.cc:385] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.851363 15793 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.870682 15736 tablet_service.cc:1511] Processing CreateTablet for tablet f900b71a39b14f0e92515320b011e9a1 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:16:43.872176 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f900b71a39b14f0e92515320b011e9a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.874122 15792 tablet_bootstrap.cc:492] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:43.874737 15792 ts_tablet_manager.cc:1403] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.202s	user 0.030s	sys 0.008s
I20260709 13:16:43.877885 15791 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:43.878695 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:43.880546 15565 leader_election.cc:343] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.887043 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:43.887820 15750 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:43.887970 15734 tablet_service.cc:1511] Processing CreateTablet for tablet e80fb58800714a47b47ac1e701a9400f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:16:43.889424 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80fb58800714a47b47ac1e701a9400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.889161 15589 tablet_service.cc:1511] Processing CreateTablet for tablet e105ea6267284f22bdfda14678176b49 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:43.889490 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:43.890542 15796 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.890902 15796 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.891006 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e105ea6267284f22bdfda14678176b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.891357 15796 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.876504 15793 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.898224 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 6388e92df0fa4fac9a75573887c28fd9 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:16:43.898869 15800 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.899649 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6388e92df0fa4fac9a75573887c28fd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.899329 15800 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.900784 15793 ts_tablet_manager.cc:1434] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.076s	user 0.013s	sys 0.000s
I20260709 13:16:43.902271 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e80fb58800714a47b47ac1e701a9400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.904271 15739 tablet_service.cc:1511] Processing CreateTablet for tablet e105ea6267284f22bdfda14678176b49 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:43.908084 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:43.909402 15739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e105ea6267284f22bdfda14678176b49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:43.909672 15640 leader_election.cc:343] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.911347 15800 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:43.912907 15714 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:43.914214 15797 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:43.914577 15797 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:43.914908 15797 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:43.916400 15714 leader_election.cc:343] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.916887 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:43.919950 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:43.880374 15792 raft_consensus.cc:359] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.921074 15792 raft_consensus.cc:385] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:43.921468 15792 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:43.922397 15792 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.927129 15797 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.930795 15587 tablet_service.cc:1511] Processing CreateTablet for tablet ee9f9791071f42759780d6353d07808d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:43.932170 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9f9791071f42759780d6353d07808d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.935612 15796 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:43.938567 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:16:43.940176 15565 leader_election.cc:343] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.941742 15793 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:43.942533 15791 tablet_bootstrap.cc:654] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.951032 15660 tablet_service.cc:1511] Processing CreateTablet for tablet ee9f9791071f42759780d6353d07808d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:43.954988 15793 tablet_bootstrap.cc:654] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:43.955045 15660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9f9791071f42759780d6353d07808d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.951980 15663 tablet_service.cc:1511] Processing CreateTablet for tablet e105ea6267284f22bdfda14678176b49 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:16:43.958652 15663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e105ea6267284f22bdfda14678176b49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:43.959331 15714 leader_election.cc:343] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.960937 15820 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:43.961735 15642 leader_election.cc:343] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:43.962183 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:43.963696 15800 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:43.968672 15588 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa9cf9412ae412a8756d1fc1138ddce (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:43.969574 15658 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa9cf9412ae412a8756d1fc1138ddce (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:43.970016 15588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9cf9412ae412a8756d1fc1138ddce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.970810 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9cf9412ae412a8756d1fc1138ddce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.974627 15584 tablet_service.cc:1511] Processing CreateTablet for tablet 473662f2d754459c9d26a0322ab3531a (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:43.975907 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 473662f2d754459c9d26a0322ab3531a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.980939 15797 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:43.982748 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:43.983368 15750 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:43.983582 15665 tablet_service.cc:1511] Processing CreateTablet for tablet 473662f2d754459c9d26a0322ab3531a (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:43.985498 15665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 473662f2d754459c9d26a0322ab3531a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:43.995445 15750 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:43.996829 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:43.997701 15796 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:44.001372 15590 tablet_service.cc:1511] Processing CreateTablet for tablet 90bff7f9147743b39de29e593c7a83b1 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:44.002743 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bff7f9147743b39de29e593c7a83b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.011209 15796 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.011741 15796 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:44.012629 15796 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.030733 15667 tablet_service.cc:1511] Processing CreateTablet for tablet 90bff7f9147743b39de29e593c7a83b1 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:44.031704 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bff7f9147743b39de29e593c7a83b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.033221 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:44.039566 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 9fa9cf9412ae412a8756d1fc1138ddce (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:16:44.040880 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9cf9412ae412a8756d1fc1138ddce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.041574 15734 tablet_service.cc:1511] Processing CreateTablet for tablet ee9f9791071f42759780d6353d07808d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:16:44.042855 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9f9791071f42759780d6353d07808d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.042646 15797 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.051337 15797 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.051630 15736 tablet_service.cc:1511] Processing CreateTablet for tablet 473662f2d754459c9d26a0322ab3531a (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:16:44.053021 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 473662f2d754459c9d26a0322ab3531a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.053435 15797 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:44.054953 15592 tablet_service.cc:1511] Processing CreateTablet for tablet 693cb838c6224bb88e8195042cafa653 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:44.056236 15592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693cb838c6224bb88e8195042cafa653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.059008 15667 tablet_service.cc:1511] Processing CreateTablet for tablet 693cb838c6224bb88e8195042cafa653 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:44.059839 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693cb838c6224bb88e8195042cafa653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.064416 15740 tablet_service.cc:1511] Processing CreateTablet for tablet 693cb838c6224bb88e8195042cafa653 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:16:44.065914 15740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 693cb838c6224bb88e8195042cafa653. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.070196 15586 tablet_service.cc:1511] Processing CreateTablet for tablet 958e81841a784ee79fccc9f488562c59 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:44.071552 15586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958e81841a784ee79fccc9f488562c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.064416 15737 tablet_service.cc:1511] Processing CreateTablet for tablet 90bff7f9147743b39de29e593c7a83b1 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:16:44.075263 15737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bff7f9147743b39de29e593c7a83b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.078117 15792 ts_tablet_manager.cc:1434] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.203s	user 0.026s	sys 0.033s
I20260709 13:16:44.079725 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:44.080390 15677 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.080546 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:44.085039 15591 tablet_service.cc:1511] Processing CreateTablet for tablet fc4ccb73a2c14aa7864a676c25f3a2fc (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:44.086364 15591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4ccb73a2c14aa7864a676c25f3a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.086758 15585 tablet_service.cc:1511] Processing CreateTablet for tablet 534cd68adf1a448ba243ff66d1dcd5da (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:44.088091 15585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534cd68adf1a448ba243ff66d1dcd5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.091675 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:44.093657 15666 tablet_service.cc:1511] Processing CreateTablet for tablet fc4ccb73a2c14aa7864a676c25f3a2fc (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:44.095072 15666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4ccb73a2c14aa7864a676c25f3a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.101936 15664 tablet_service.cc:1511] Processing CreateTablet for tablet 534cd68adf1a448ba243ff66d1dcd5da (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:44.103804 15658 tablet_service.cc:1511] Processing CreateTablet for tablet 958e81841a784ee79fccc9f488562c59 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:16:44.098060 15714 leader_election.cc:343] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.105743 15792 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:44.114940 15791 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:44.115464 15791 ts_tablet_manager.cc:1403] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.249s	user 0.016s	sys 0.000s
I20260709 13:16:44.116370 15587 tablet_service.cc:1511] Processing CreateTablet for tablet b798e44b35ab41d0943297db40d7407f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:16:44.117089 15714 leader_election.cc:343] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.118589 15791 raft_consensus.cc:359] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.119325 15791 raft_consensus.cc:385] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.119650 15791 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
W20260709 13:16:44.073762 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 77005.6us
I20260709 13:16:44.120471 15791 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:44.121640 15714 leader_election.cc:343] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.125905 15791 ts_tablet_manager.cc:1434] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:44.126772 15793 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:44.126932 15791 tablet_bootstrap.cc:492] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:44.127260 15793 ts_tablet_manager.cc:1403] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.225s	user 0.014s	sys 0.005s
I20260709 13:16:44.122136 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:44.133607 15797 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.128580 15665 tablet_service.cc:1511] Processing CreateTablet for tablet b798e44b35ab41d0943297db40d7407f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:44.136909 15792 tablet_bootstrap.cc:654] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.119928 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b798e44b35ab41d0943297db40d7407f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.137253 15665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b798e44b35ab41d0943297db40d7407f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.142858 15663 tablet_service.cc:1511] Processing CreateTablet for tablet b171707a6f8e44b7a4f81ef5fbf30230 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:44.138842 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 958e81841a784ee79fccc9f488562c59 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:16:44.145457 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958e81841a784ee79fccc9f488562c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.138120 15677 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:44.143206 15735 tablet_service.cc:1511] Processing CreateTablet for tablet 534cd68adf1a448ba243ff66d1dcd5da (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:16:44.143797 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534cd68adf1a448ba243ff66d1dcd5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.140991 15741 tablet_service.cc:1511] Processing CreateTablet for tablet fc4ccb73a2c14aa7864a676c25f3a2fc (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:16:44.130429 15793 raft_consensus.cc:359] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.149780 15735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534cd68adf1a448ba243ff66d1dcd5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.149892 15733 tablet_service.cc:1511] Processing CreateTablet for tablet b798e44b35ab41d0943297db40d7407f (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:16:44.161024 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958e81841a784ee79fccc9f488562c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.151870 15793 raft_consensus.cc:385] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.169556 15741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4ccb73a2c14aa7864a676c25f3a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.171252 15714 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:44.171943 15732 tablet_service.cc:1511] Processing CreateTablet for tablet b171707a6f8e44b7a4f81ef5fbf30230 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:44.172380 15797 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.173964 15733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b798e44b35ab41d0943297db40d7407f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.169476 15592 tablet_service.cc:1511] Processing CreateTablet for tablet bbc6f003381b434b92d3b262155935c7 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:44.172925 15797 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:44.178419 15797 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.165019 15793 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.180953 15591 tablet_service.cc:1511] Processing CreateTablet for tablet 2e56a58686fa47d397c114454143e4c6 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:44.181314 15793 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.181543 15734 tablet_service.cc:1511] Processing CreateTablet for tablet bbc6f003381b434b92d3b262155935c7 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:44.182327 15591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e56a58686fa47d397c114454143e4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.184273 15663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b171707a6f8e44b7a4f81ef5fbf30230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.193225 15590 tablet_service.cc:1511] Processing CreateTablet for tablet b171707a6f8e44b7a4f81ef5fbf30230 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:16:44.196442 15667 tablet_service.cc:1511] Processing CreateTablet for tablet bbc6f003381b434b92d3b262155935c7 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:16:44.200779 15592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc6f003381b434b92d3b262155935c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.202754 15732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b171707a6f8e44b7a4f81ef5fbf30230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.205103 15791 tablet_bootstrap.cc:654] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.208632 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b171707a6f8e44b7a4f81ef5fbf30230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.212424 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc6f003381b434b92d3b262155935c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.198292 15497 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.215273 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc6f003381b434b92d3b262155935c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.224869 15793 ts_tablet_manager.cc:1434] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.097s	user 0.004s	sys 0.006s
I20260709 13:16:44.226212 15793 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:44.227213 15660 tablet_service.cc:1511] Processing CreateTablet for tablet 2e56a58686fa47d397c114454143e4c6 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:44.228575 15660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e56a58686fa47d397c114454143e4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.252518 15740 tablet_service.cc:1511] Processing CreateTablet for tablet 2e56a58686fa47d397c114454143e4c6 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:16:44.253914 15740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e56a58686fa47d397c114454143e4c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.280153 15796 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.280893 15796 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.232486 15793 tablet_bootstrap.cc:654] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.354039 15800 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.358834 15800 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:44.361006 15642 consensus_peers.cc:597] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.362046 15800 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:44.363754 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:44.364352 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:44.364748 15750 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:44.377686 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:44.385634 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:44.386567 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:16:44.393632 15567 leader_election.cc:343] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.388762 15800 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:16:44.388496 15796 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:44.399618 15813 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:16:44.405429 15565 leader_election.cc:343] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:44.405764 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:44.435271 15658 tablet_service.cc:1511] Processing CreateTablet for tablet efe3434ebb0f4f6f9578442969e933e5 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:44.436748 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe3434ebb0f4f6f9578442969e933e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.409659 15667 tablet_service.cc:1511] Processing CreateTablet for tablet ac51ecd2367a45e8a32a6a911f34a9c2 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:44.411194 15792 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:44.437449 15737 tablet_service.cc:1511] Processing CreateTablet for tablet 651bfd4950ab4835b117f7364ee51b09 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:44.437976 15792 ts_tablet_manager.cc:1403] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.332s	user 0.010s	sys 0.027s
I20260709 13:16:44.438627 15666 tablet_service.cc:1511] Processing CreateTablet for tablet 651bfd4950ab4835b117f7364ee51b09 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:44.439612 15737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651bfd4950ab4835b117f7364ee51b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.411042 15813 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.440811 15813 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:44.399050 15640 leader_election.cc:343] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.412463 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 43658563a58a42e3b9a3da86a87a9c02 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:16:44.441752 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 43908.3us
I20260709 13:16:44.442121 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43658563a58a42e3b9a3da86a87a9c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.443162 15665 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd98191b2d04d05b9a41afba67ac044 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:44.413195 15660 tablet_service.cc:1511] Processing CreateTablet for tablet 43658563a58a42e3b9a3da86a87a9c02 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:44.413911 15565 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:44.443950 15792 raft_consensus.cc:359] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.445464 15792 raft_consensus.cc:385] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.445678 15796 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.446095 15792 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.446823 15792 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.448668 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac51ecd2367a45e8a32a6a911f34a9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.449059 15585 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd98191b2d04d05b9a41afba67ac044 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:44.449594 15665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd98191b2d04d05b9a41afba67ac044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.450495 15660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43658563a58a42e3b9a3da86a87a9c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.448017 15586 tablet_service.cc:1511] Processing CreateTablet for tablet 651bfd4950ab4835b117f7364ee51b09 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:16:44.413620 15497 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:44.425278 15791 tablet_bootstrap.cc:492] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:44.434026 15740 tablet_service.cc:1511] Processing CreateTablet for tablet efe3434ebb0f4f6f9578442969e933e5 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:44.407749 15736 tablet_service.cc:1511] Processing CreateTablet for tablet ac51ecd2367a45e8a32a6a911f34a9c2 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:44.453696 15791 ts_tablet_manager.cc:1403] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.327s	user 0.036s	sys 0.073s
I20260709 13:16:44.409330 15590 tablet_service.cc:1511] Processing CreateTablet for tablet ac51ecd2367a45e8a32a6a911f34a9c2 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:16:44.468017 15666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651bfd4950ab4835b117f7364ee51b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.472493 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac51ecd2367a45e8a32a6a911f34a9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.475153 15791 raft_consensus.cc:359] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.475883 15791 raft_consensus.cc:385] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.476188 15791 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.480715 15740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe3434ebb0f4f6f9578442969e933e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.481673 15792 ts_tablet_manager.cc:1434] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.012s
I20260709 13:16:44.485265 15586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651bfd4950ab4835b117f7364ee51b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.485594 15792 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:44.490499 15741 tablet_service.cc:1511] Processing CreateTablet for tablet 181e7ee5f1ce4aa3bf93c66197002509 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:44.491900 15741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181e7ee5f1ce4aa3bf93c66197002509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.493083 15590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac51ecd2367a45e8a32a6a911f34a9c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.493636 15585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd98191b2d04d05b9a41afba67ac044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.494490 15588 tablet_service.cc:1511] Processing CreateTablet for tablet 581e4945d85a47ba97ce48f4027aeade (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:44.495821 15588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581e4945d85a47ba97ce48f4027aeade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.499476 15792 tablet_bootstrap.cc:654] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.509233 15587 tablet_service.cc:1511] Processing CreateTablet for tablet efe3434ebb0f4f6f9578442969e933e5 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:16:44.510535 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe3434ebb0f4f6f9578442969e933e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.512586 15732 tablet_service.cc:1511] Processing CreateTablet for tablet 29bae97aafa2447892a23984cd26cd90 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:44.514132 15732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bae97aafa2447892a23984cd26cd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.514653 15664 tablet_service.cc:1511] Processing CreateTablet for tablet 581e4945d85a47ba97ce48f4027aeade (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:44.519928 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581e4945d85a47ba97ce48f4027aeade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.516819 15663 tablet_service.cc:1511] Processing CreateTablet for tablet 181e7ee5f1ce4aa3bf93c66197002509 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:44.513777 15591 tablet_service.cc:1511] Processing CreateTablet for tablet 43658563a58a42e3b9a3da86a87a9c02 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:16:44.523780 15663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181e7ee5f1ce4aa3bf93c66197002509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.516386 15733 tablet_service.cc:1511] Processing CreateTablet for tablet 581e4945d85a47ba97ce48f4027aeade (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:16:44.517771 15589 tablet_service.cc:1511] Processing CreateTablet for tablet 181e7ee5f1ce4aa3bf93c66197002509 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:16:44.518360 15662 tablet_service.cc:1511] Processing CreateTablet for tablet 29bae97aafa2447892a23984cd26cd90 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:44.528096 15662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bae97aafa2447892a23984cd26cd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.520033 15583 tablet_service.cc:1511] Processing CreateTablet for tablet 29bae97aafa2447892a23984cd26cd90 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:16:44.521312 15584 tablet_service.cc:1511] Processing CreateTablet for tablet c9e5693d3c474948b687ba64b0b31215 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:44.536785 15735 tablet_service.cc:1511] Processing CreateTablet for tablet c9e5693d3c474948b687ba64b0b31215 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:44.538197 15735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e5693d3c474948b687ba64b0b31215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.538317 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181e7ee5f1ce4aa3bf93c66197002509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.541186 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bae97aafa2447892a23984cd26cd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.543483 15733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581e4945d85a47ba97ce48f4027aeade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.545159 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e5693d3c474948b687ba64b0b31215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.546319 15813 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.517617 15734 tablet_service.cc:1511] Processing CreateTablet for tablet 5fd98191b2d04d05b9a41afba67ac044 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:16:44.557488 15813 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:44.557758 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:44.560954 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:44.561764 15591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43658563a58a42e3b9a3da86a87a9c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.568873 15791 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.574627 15736 tablet_service.cc:1511] Processing CreateTablet for tablet 6556ac1ec52640c3bad0bf13607c8d19 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:44.587328 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6556ac1ec52640c3bad0bf13607c8d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.592350 15741 tablet_service.cc:1511] Processing CreateTablet for tablet 6cee88791b35487fb5b26c8d3d7ee6c8 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:44.593851 15741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cee88791b35487fb5b26c8d3d7ee6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.598554 15739 tablet_service.cc:1511] Processing CreateTablet for tablet 522c09add06b4e6c8c43c06c082d1e17 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:44.605195 15734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd98191b2d04d05b9a41afba67ac044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.610322 15739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c09add06b4e6c8c43c06c082d1e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.610410 15791 ts_tablet_manager.cc:1434] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.156s	user 0.008s	sys 0.003s
I20260709 13:16:44.611830 15791 tablet_bootstrap.cc:492] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:44.573931 15750 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.622336 15664 tablet_service.cc:1511] Processing CreateTablet for tablet c9e5693d3c474948b687ba64b0b31215 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:16:44.623675 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e5693d3c474948b687ba64b0b31215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.578274 15602 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:44.631995 15738 tablet_service.cc:1511] Processing CreateTablet for tablet e303011bed72412ab6f5eebf5a6de748 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:44.633973 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e303011bed72412ab6f5eebf5a6de748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.637409 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 6556ac1ec52640c3bad0bf13607c8d19 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:44.638782 15736 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0bf08b91c244659abe8cb87e64f8cd (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:44.639811 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6556ac1ec52640c3bad0bf13607c8d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.640173 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0bf08b91c244659abe8cb87e64f8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.644940 15733 tablet_service.cc:1511] Processing CreateTablet for tablet 3862488109f64226a32f4b77b567c1dc (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:44.647987 15733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3862488109f64226a32f4b77b567c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.683552 15736 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc66402c5e04df38b56e6d8d4d7731d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:44.685002 15736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc66402c5e04df38b56e6d8d4d7731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.686249 15587 tablet_service.cc:1511] Processing CreateTablet for tablet e303011bed72412ab6f5eebf5a6de748 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:44.686646 15797 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.689580 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e303011bed72412ab6f5eebf5a6de748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.686290 15738 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:44.691960 15796 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:44.692724 15662 tablet_service.cc:1511] Processing CreateTablet for tablet 6556ac1ec52640c3bad0bf13607c8d19 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:16:44.694085 15662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6556ac1ec52640c3bad0bf13607c8d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.696827 15792 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:44.697341 15792 ts_tablet_manager.cc:1403] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.212s	user 0.018s	sys 0.028s
I20260709 13:16:44.701129 15738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.702621 15793 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:44.703135 15793 ts_tablet_manager.cc:1403] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.477s	user 0.012s	sys 0.015s
I20260709 13:16:44.706156 15793 raft_consensus.cc:359] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.706883 15793 raft_consensus.cc:385] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.707984 15793 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.708063 15750 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:44.709020 15793 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.712811 15667 tablet_service.cc:1511] Processing CreateTablet for tablet e303011bed72412ab6f5eebf5a6de748 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:16:44.736490 15667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e303011bed72412ab6f5eebf5a6de748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.715829 15602 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:44.719782 15791 tablet_bootstrap.cc:654] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:44.731025 15565 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.746853 15792 raft_consensus.cc:359] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.755537 15792 raft_consensus.cc:385] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.732461 15797 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.755874 15792 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.756201 15797 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.756718 15792 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.758203 15797 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:44.759492 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 6cee88791b35487fb5b26c8d3d7ee6c8 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:44.760648 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cee88791b35487fb5b26c8d3d7ee6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.763044 15658 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0bf08b91c244659abe8cb87e64f8cd (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:44.764382 15658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0bf08b91c244659abe8cb87e64f8cd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:44.732645 15714 consensus_peers.cc:597] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.765592 15661 tablet_service.cc:1511] Processing CreateTablet for tablet 3862488109f64226a32f4b77b567c1dc (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:44.766903 15661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3862488109f64226a32f4b77b567c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.763970 15663 tablet_service.cc:1511] Processing CreateTablet for tablet 6cee88791b35487fb5b26c8d3d7ee6c8 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:16:44.769359 15663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cee88791b35487fb5b26c8d3d7ee6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.770007 15793 ts_tablet_manager.cc:1434] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:16:44.769668 15659 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc66402c5e04df38b56e6d8d4d7731d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:44.778249 15664 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:44.790233 15664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.790279 15587 tablet_service.cc:1511] Processing CreateTablet for tablet 8c0bf08b91c244659abe8cb87e64f8cd (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:16:44.793537 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:44.794531 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:44.795150 15813 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:44.795661 15813 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:44.787304 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:44.796458 15813 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.799682 15587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0bf08b91c244659abe8cb87e64f8cd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:44.802546 15714 leader_election.cc:343] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.771474 15660 tablet_service.cc:1511] Processing CreateTablet for tablet 522c09add06b4e6c8c43c06c082d1e17 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:44.804919 15793 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:44.806690 15585 tablet_service.cc:1511] Processing CreateTablet for tablet 3862488109f64226a32f4b77b567c1dc (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:16:44.807281 15589 tablet_service.cc:1511] Processing CreateTablet for tablet 6fc66402c5e04df38b56e6d8d4d7731d (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:16:44.808018 15585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3862488109f64226a32f4b77b567c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.808583 15589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc66402c5e04df38b56e6d8d4d7731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.809620 15588 tablet_service.cc:1511] Processing CreateTablet for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:16:44.765615 15583 tablet_service.cc:1511] Processing CreateTablet for tablet 522c09add06b4e6c8c43c06c082d1e17 (DEFAULT_TABLE table=test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:16:44.824841 15659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc66402c5e04df38b56e6d8d4d7731d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:16:44.828539 15714 leader_election.cc:343] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:44.829061 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:44.829852 15797 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.830459 15660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c09add06b4e6c8c43c06c082d1e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.853111 15793 tablet_bootstrap.cc:654] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.853159 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522c09add06b4e6c8c43c06c082d1e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.860977 15588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:44.848810 15792 ts_tablet_manager.cc:1434] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.151s	user 0.019s	sys 0.007s
I20260709 13:16:44.884126 15792 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:44.892117 15833 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.892691 15833 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.901487 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:44.898430 15833 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:44.901628 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:44.907616 15640 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:44.908716 15833 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:44.915797 15497 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.918843 15792 tablet_bootstrap.cc:654] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.975212 15791 tablet_bootstrap.cc:492] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:44.975589 15791 ts_tablet_manager.cc:1403] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.364s	user 0.018s	sys 0.018s
I20260709 13:16:44.977957 15791 raft_consensus.cc:359] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.978533 15791 raft_consensus.cc:385] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.978796 15791 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.978878 15793 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:44.979543 15793 ts_tablet_manager.cc:1403] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.179s	user 0.020s	sys 0.032s
I20260709 13:16:44.979472 15791 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.981395 15791 ts_tablet_manager.cc:1434] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:44.982405 15791 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:44.982290 15793 raft_consensus.cc:359] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.983042 15793 raft_consensus.cc:385] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:44.983346 15793 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:44.984073 15793 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:44.986320 15793 ts_tablet_manager.cc:1434] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:44.978878 15792 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:44.986907 15792 ts_tablet_manager.cc:1403] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.012s
I20260709 13:16:44.987902 15791 tablet_bootstrap.cc:654] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.988464 15793 tablet_bootstrap.cc:492] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:44.995343 15793 tablet_bootstrap.cc:654] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:44.999116 15791 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:44.999614 15791 ts_tablet_manager.cc:1403] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:16:45.001965 15791 raft_consensus.cc:359] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.002210 15792 raft_consensus.cc:359] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.002748 15791 raft_consensus.cc:385] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.003218 15791 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.003219 15792 raft_consensus.cc:385] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.004748 15792 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.005553 15792 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.006752 15793 tablet_bootstrap.cc:492] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.007115 15793 ts_tablet_manager.cc:1403] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 13:16:45.007483 15792 ts_tablet_manager.cc:1434] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:16:45.004091 15791 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.009419 15791 ts_tablet_manager.cc:1434] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:16:45.009446 15793 raft_consensus.cc:359] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.010325 15793 raft_consensus.cc:385] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.010641 15793 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.011395 15793 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.012356 15791 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:45.013953 15792 tablet_bootstrap.cc:492] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:45.016471 15793 ts_tablet_manager.cc:1434] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:16:45.017704 15793 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:45.020812 15792 tablet_bootstrap.cc:654] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.024149 15793 tablet_bootstrap.cc:654] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.024209 15791 tablet_bootstrap.cc:654] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.032752 15792 tablet_bootstrap.cc:492] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:45.033437 15792 ts_tablet_manager.cc:1403] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.007s
I20260709 13:16:45.037072 15792 raft_consensus.cc:359] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:45.037693 15792 raft_consensus.cc:385] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.037992 15792 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.038969 15793 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.038666 15792 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:45.039198 15791 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:45.039412 15793 ts_tablet_manager.cc:1403] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.009s
I20260709 13:16:45.039724 15791 ts_tablet_manager.cc:1403] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.005s
I20260709 13:16:45.040877 15792 ts_tablet_manager.cc:1434] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:16:45.042346 15843 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.042110 15793 raft_consensus.cc:359] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.042833 15793 raft_consensus.cc:385] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.042820 15843 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.043292 15793 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.044034 15793 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.045084 15843 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.045735 15793 ts_tablet_manager.cc:1434] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:16:45.046254 15792 tablet_bootstrap.cc:492] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:45.042125 15791 raft_consensus.cc:359] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.046145 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.046663 15791 raft_consensus.cc:385] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.046972 15791 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
W20260709 13:16:45.047603 15714 leader_election.cc:343] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.047626 15791 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.048444 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.049054 15677 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:45.050778 15793 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:45.052464 15791 ts_tablet_manager.cc:1434] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:16:45.053258 15792 tablet_bootstrap.cc:654] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.054677 15791 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:45.056756 15793 tablet_bootstrap.cc:654] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.058568 15714 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:45.059727 15843 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.060204 15843 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.060664 15843 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.068332 15793 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.068936 15793 ts_tablet_manager.cc:1403] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 13:16:45.071734 15793 raft_consensus.cc:359] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.072543 15793 raft_consensus.cc:385] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.072891 15793 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.073583 15793 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.073786 15843 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.075999 15793 ts_tablet_manager.cc:1434] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:45.076774 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:45.078500 15793 tablet_bootstrap.cc:492] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:45.080061 15792 tablet_bootstrap.cc:492] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:45.078312 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:45.077230 15843 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.077116 15791 tablet_bootstrap.cc:654] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.097347 15792 ts_tablet_manager.cc:1403] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.027s
W20260709 13:16:45.099018 15714 leader_election.cc:343] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.097312 15677 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.101150 15792 raft_consensus.cc:359] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.101867 15792 raft_consensus.cc:385] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.102069 15793 tablet_bootstrap.cc:654] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.102133 15792 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.102981 15792 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.104923 15792 ts_tablet_manager.cc:1434] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:16:45.105820 15792 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:45.107304 15838 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.107976 15838 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.109426 15791 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:45.109881 15791 ts_tablet_manager.cc:1403] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:16:45.111411 15792 tablet_bootstrap.cc:654] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.114212 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.116295 15838 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.116513 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.107300 15677 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:45.119002 15565 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:45.120234 15714 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:45.121124 15843 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.121424 15838 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.121590 15843 raft_consensus.cc:697] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:45.122521 15843 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.124625 15793 tablet_bootstrap.cc:492] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.125326 15793 ts_tablet_manager.cc:1403] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.047s	user 0.028s	sys 0.009s
I20260709 13:16:45.128955 15793 raft_consensus.cc:359] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:45.129976 15793 raft_consensus.cc:385] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.130393 15793 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.131402 15793 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:45.132421 15791 raft_consensus.cc:359] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.133173 15791 raft_consensus.cc:385] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.133452 15791 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.134510 15793 ts_tablet_manager.cc:1434] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:16:45.134209 15791 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.135900 15793 tablet_bootstrap.cc:492] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:45.136672 15791 ts_tablet_manager.cc:1434] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:16:45.137544 15791 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:45.144249 15600 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.145008 15793 tablet_bootstrap.cc:654] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.155124 15792 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:45.155409 15793 tablet_bootstrap.cc:492] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.155797 15793 ts_tablet_manager.cc:1403] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.013s
I20260709 13:16:45.155735 15792 ts_tablet_manager.cc:1403] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.035s
I20260709 13:16:45.158818 15791 tablet_bootstrap.cc:654] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.158679 15793 raft_consensus.cc:359] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.159422 15793 raft_consensus.cc:385] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.159698 15793 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.160039 15792 raft_consensus.cc:359] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.160779 15792 raft_consensus.cc:385] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.160452 15793 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.160279 15500 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.161088 15792 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.162022 15792 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.164283 15792 ts_tablet_manager.cc:1434] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:16:45.165264 15792 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:45.165416 15793 ts_tablet_manager.cc:1434] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:45.166303 15793 tablet_bootstrap.cc:492] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:45.170452 15791 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:45.170941 15791 ts_tablet_manager.cc:1403] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.005s
I20260709 13:16:45.171794 15792 tablet_bootstrap.cc:654] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.171794 15793 tablet_bootstrap.cc:654] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.180948 15838 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.181641 15838 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.185887 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.186321 15796 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.186582 15751 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:45.186797 15796 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.187862 15791 raft_consensus.cc:359] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.188566 15791 raft_consensus.cc:385] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.188881 15796 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.188868 15791 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.189280 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.190147 15791 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.190511 15677 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:45.192185 15791 ts_tablet_manager.cc:1434] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.006s
I20260709 13:16:45.192466 15838 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.193112 15791 tablet_bootstrap.cc:492] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:45.193491 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.194159 15751 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:45.192286 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:45.199573 15791 tablet_bootstrap.cc:654] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.200155 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.200732 15843 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.200929 15677 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:45.201287 15843 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.202804 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:45.203423 15838 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.204391 15838 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.204823 15838 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.209828 15796 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.210366 15796 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.210805 15796 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.212105 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.213040 15677 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:45.214561 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:45.203612 15843 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.215822 15844 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.216347 15844 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.216802 15844 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.228422 15844 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.233282 15796 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.234742 15792 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:45.238870 15792 ts_tablet_manager.cc:1403] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.045s
I20260709 13:16:45.237195 15793 tablet_bootstrap.cc:492] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.237093 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.239488 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:45.239722 15677 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.237915 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:45.240127 15676 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:45.241714 15714 leader_election.cc:343] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:45.243376 15714 leader_election.cc:343] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.243548 15843 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.244009 15843 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.239501 15793 ts_tablet_manager.cc:1403] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.000s
I20260709 13:16:45.246125 15843 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.242720 15792 raft_consensus.cc:359] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.247056 15792 raft_consensus.cc:385] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.247423 15793 raft_consensus.cc:359] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.248172 15792 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.248235 15793 raft_consensus.cc:385] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.248740 15793 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.245244 15838 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.247656 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.249084 15792 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.248121 15844 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.251336 15792 ts_tablet_manager.cc:1434] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:16:45.252648 15792 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:45.254858 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:45.255219 15793 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.256287 15751 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.256773 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.258670 15793 ts_tablet_manager.cc:1434] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.006s
I20260709 13:16:45.259961 15793 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:45.254908 15676 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:45.256021 15796 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.263980 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:45.265770 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:45.266417 15674 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.266932 15844 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.267316 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:45.268224 15844 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.278249 15674 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:45.269039 15844 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:45.279532 15565 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:45.279842 15844 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.280458 15796 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.281764 15796 raft_consensus.cc:697] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:45.282641 15796 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.285115 15751 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:45.286926 15838 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.290252 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:45.290742 15833 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.291445 15751 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.291404 15833 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.292536 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:45.292413 15813 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.293612 15833 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.293918 15674 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.296497 15792 tablet_bootstrap.cc:654] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.299569 15793 tablet_bootstrap.cc:654] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.298496 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.306064 15791 tablet_bootstrap.cc:492] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:45.306082 15751 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:45.306696 15838 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.309638 15791 ts_tablet_manager.cc:1403] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.059s
I20260709 13:16:45.309572 15838 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:45.311427 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:45.311820 15838 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.312404 15750 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:45.312763 15864 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.313342 15864 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:45.314579 15864 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.313787 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.317202 15601 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:45.317642 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:45.317760 15674 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:45.318650 15833 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.315713 15500 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.320545 15833 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.321502 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.321396 15791 raft_consensus.cc:359] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.322620 15750 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:45.322724 15791 raft_consensus.cc:385] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.323149 15791 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.323843 15567 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:45.324081 15791 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.321584 15833 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.331806 15791 ts_tablet_manager.cc:1434] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:16:45.332584 15791 tablet_bootstrap.cc:492] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:45.330488 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.337981 15800 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.339454 15674 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:45.332990 15838 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.352835 15838 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.353263 15838 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.386636 15791 tablet_bootstrap.cc:654] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.391417 15500 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.404654 15833 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.409718 15792 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:45.410287 15792 ts_tablet_manager.cc:1403] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.158s	user 0.030s	sys 0.020s
I20260709 13:16:45.410840 15838 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:45.413400 15844 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.414857 15844 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.416900 15844 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.418982 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.419814 15792 raft_consensus.cc:359] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.419915 15677 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:45.420048 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.420954 15600 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:45.420562 15792 raft_consensus.cc:385] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.422045 15792 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.424996 15792 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.428829 15792 ts_tablet_manager.cc:1434] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:16:45.428934 15750 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.429847 15792 tablet_bootstrap.cc:492] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:45.432900 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:45.436779 15844 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.437155 15844 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.437470 15844 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:45.437810 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:45.443663 15838 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.444095 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:45.444729 15751 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.444541 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:45.445434 15677 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.453054 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:45.453893 15600 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.467085 15677 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:45.477509 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:45.492175 15838 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.492904 15838 raft_consensus.cc:697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:45.493247 15833 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.493778 15838 consensus_queue.cc:237] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:16:45.494531 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:45.497489 15793 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.497948 15793 ts_tablet_manager.cc:1403] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.238s	user 0.016s	sys 0.017s
I20260709 13:16:45.498174 15749 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.512913 15600 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:45.518260 15791 tablet_bootstrap.cc:492] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:45.518779 15791 ts_tablet_manager.cc:1403] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.186s	user 0.028s	sys 0.048s
I20260709 13:16:45.520138 15793 raft_consensus.cc:359] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.520722 15793 raft_consensus.cc:385] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.520962 15793 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.522564 15640 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:45.524991 15791 raft_consensus.cc:359] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.526410 15793 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.528347 15791 raft_consensus.cc:385] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.528702 15791 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.529340 15793 ts_tablet_manager.cc:1434] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:16:45.530210 15793 tablet_bootstrap.cc:492] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:45.531035 15792 tablet_bootstrap.cc:654] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.531426 15751 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:45.535552 15749 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:45.526113 15833 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.545287 15791 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.548941 15838 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.549477 15838 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.552861 15833 raft_consensus.cc:697] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:45.552956 15500 catalog_manager.cc:5697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.553936 15833 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.587966 15873 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.588532 15873 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.591516 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.591491 15844 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.620298 15602 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.721469 15872 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.652541 15813 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.652140 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:45.634363 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:45.618803 15843 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.619498 15844 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:16:45.727092 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 179876us
I20260709 13:16:45.740146 15791 ts_tablet_manager.cc:1434] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.221s	user 0.020s	sys 0.048s
I20260709 13:16:45.747020 15791 tablet_bootstrap.cc:492] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:45.745275 15843 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.746285 15677 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:45.740638 15640 leader_election.cc:343] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.753212 15873 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.760136 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.761628 15674 raft_consensus.cc:2393] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:16:45.752386 15599 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.738761 15813 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.757766 15838 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.767316 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.750429 15872 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.772408 15881 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:16:45.773175 15714 leader_election.cc:343] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.775342 15792 tablet_bootstrap.cc:492] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:45.775954 15792 ts_tablet_manager.cc:1403] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.346s	user 0.025s	sys 0.023s
I20260709 13:16:45.777640 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:45.780908 15843 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:45.781721 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.786505 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:16:45.788275 15714 leader_election.cc:343] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.789067 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:45.793103 15843 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:45.795253 15640 leader_election.cc:343] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:45.796895 15642 leader_election.cc:343] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:45.797564 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:45.798063 15872 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.798905 15675 raft_consensus.cc:2393] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:16:45.797621 15642 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:45.800266 15833 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.807541 15843 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.808727 15791 tablet_bootstrap.cc:654] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.823378 15793 tablet_bootstrap.cc:654] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.832753 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.833468 15750 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:45.824702 15813 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:45.838742 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:16:45.839967 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 303084us
I20260709 13:16:45.822513 15872 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:16:45.843619 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.844429 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:45.851753 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:45.852764 15838 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.858044 15500 catalog_manager.cc:5697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.849710 15873 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:45.865041 15873 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.865470 15873 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:45.870273 15792 raft_consensus.cc:359] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.871264 15792 raft_consensus.cc:385] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.871591 15792 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.872459 15792 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.874902 15567 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:45.876437 15871 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.878545 15792 ts_tablet_manager.cc:1434] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.102s	user 0.004s	sys 0.004s
I20260709 13:16:45.881166 15792 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:45.883196 15677 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:45.884878 15872 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.883630 15497 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.890532 15838 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:45.891618 15886 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:16:45.912457 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:45.913405 15843 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:45.913888 15843 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:45.914654 15843 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.917534 15872 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.923928 15792 tablet_bootstrap.cc:654] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:45.929689 15791 tablet_bootstrap.cc:492] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:45.930205 15791 ts_tablet_manager.cc:1403] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.183s	user 0.022s	sys 0.025s
I20260709 13:16:45.943034 15793 tablet_bootstrap.cc:492] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:45.943709 15793 ts_tablet_manager.cc:1403] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.414s	user 0.012s	sys 0.003s
I20260709 13:16:45.940121 15873 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.961688 15872 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.972695 15886 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:45.975365 15791 raft_consensus.cc:359] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.976226 15791 raft_consensus.cc:385] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.976518 15791 raft_consensus.cc:740] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.977196 15791 consensus_queue.cc:260] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.958834 15599 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:45.985019 15838 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:45.986622 15791 ts_tablet_manager.cc:1434] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:16:45.993120 15791 tablet_bootstrap.cc:492] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:45.987574 15793 raft_consensus.cc:359] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:45.994342 15793 raft_consensus.cc:385] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:45.994722 15793 raft_consensus.cc:740] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:45.997227 15793 consensus_queue.cc:260] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.004065 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.008638 15793 ts_tablet_manager.cc:1434] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:16:46.010196 15793 tablet_bootstrap.cc:492] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:46.011492 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:46.012712 15750 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.013880 15498 catalog_manager.cc:5697] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.007197 15873 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:16:46.028198 15640 leader_election.cc:343] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.032657 15791 tablet_bootstrap.cc:654] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.033538 15750 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:46.040724 15792 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.042129 15792 ts_tablet_manager.cc:1403] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.011s
I20260709 13:16:46.041611 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:46.045550 15873 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.046025 15873 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:46.046913 15873 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.053699 15793 tablet_bootstrap.cc:654] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.055070 15882 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.058478 15792 raft_consensus.cc:359] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.059214 15792 raft_consensus.cc:385] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.059478 15792 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.060523 15792 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.061520 15882 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.066792 15882 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.077069 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.079668 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:46.080125 15714 leader_election.cc:343] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.080376 15676 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:46.080444 15871 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.081656 15792 ts_tablet_manager.cc:1434] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:16:46.082706 15792 tablet_bootstrap.cc:492] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.085323 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:46.086177 15843 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.086961 15843 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.088171 15843 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.090045 15791 tablet_bootstrap.cc:492] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.090674 15791 ts_tablet_manager.cc:1403] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.014s
I20260709 13:16:46.094571 15791 raft_consensus.cc:359] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.095268 15791 raft_consensus.cc:385] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.095538 15791 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.097343 15497 catalog_manager.cc:5697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.103858 15791 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.106496 15791 ts_tablet_manager.cc:1434] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:16:46.107259 15791 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.108248 15792 tablet_bootstrap.cc:654] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.102945 15843 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.116169 15791 tablet_bootstrap.cc:654] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.119144 15843 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.125767 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:46.126416 15674 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.129396 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.132655 15873 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.135674 15674 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:46.146461 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.147933 15843 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.148428 15843 raft_consensus.cc:697] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:46.151080 15792 tablet_bootstrap.cc:492] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.150804 15843 consensus_queue.cc:237] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.151507 15792 ts_tablet_manager.cc:1403] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.013s
I20260709 13:16:46.154196 15792 raft_consensus.cc:359] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.154985 15792 raft_consensus.cc:385] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.155297 15792 raft_consensus.cc:740] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
W20260709 13:16:46.148128 15714 leader_election.cc:343] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.156087 15792 consensus_queue.cc:260] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.159142 15791 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.159602 15791 ts_tablet_manager.cc:1403] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.005s
I20260709 13:16:46.149911 15793 tablet_bootstrap.cc:492] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.161820 15793 ts_tablet_manager.cc:1403] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.152s	user 0.010s	sys 0.012s
I20260709 13:16:46.162519 15791 raft_consensus.cc:359] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.160703 15873 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.163221 15791 raft_consensus.cc:385] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.163615 15791 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.164378 15791 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.166857 15792 ts_tablet_manager.cc:1434] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:16:46.168550 15792 tablet_bootstrap.cc:492] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.166829 15793 raft_consensus.cc:359] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.171537 15791 ts_tablet_manager.cc:1434] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:46.171540 15793 raft_consensus.cc:385] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.172017 15793 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.172559 15791 tablet_bootstrap.cc:492] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.189713 15793 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.191957 15793 ts_tablet_manager.cc:1434] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.000s
I20260709 13:16:46.193645 15793 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:46.195248 15498 catalog_manager.cc:5697] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.199668 15792 tablet_bootstrap.cc:654] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.206871 15791 tablet_bootstrap.cc:654] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.218529 15793 tablet_bootstrap.cc:654] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.221344 15791 tablet_bootstrap.cc:492] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.221933 15791 ts_tablet_manager.cc:1403] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.009s
I20260709 13:16:46.226280 15791 raft_consensus.cc:359] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.227032 15791 raft_consensus.cc:385] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.227367 15791 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.228175 15792 tablet_bootstrap.cc:492] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.229312 15792 ts_tablet_manager.cc:1403] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.005s
I20260709 13:16:46.228188 15791 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.231030 15793 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.231487 15793 ts_tablet_manager.cc:1403] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.011s
I20260709 13:16:46.232164 15792 raft_consensus.cc:359] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.232939 15792 raft_consensus.cc:385] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.233259 15792 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.234002 15792 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.234211 15793 raft_consensus.cc:359] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.234918 15793 raft_consensus.cc:385] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.235200 15793 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.235908 15793 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.239667 15791 ts_tablet_manager.cc:1434] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 13:16:46.240756 15791 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.242854 15838 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.243386 15838 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.245700 15838 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.250066 15792 ts_tablet_manager.cc:1434] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:16:46.247103 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.247956 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.250710 15750 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:46.250981 15674 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:46.252202 15567 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:46.246241 15793 ts_tablet_manager.cc:1434] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:46.253572 15793 tablet_bootstrap.cc:492] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:46.253499 15838 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.254221 15838 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.254585 15838 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.257890 15792 tablet_bootstrap.cc:492] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.250713 15791 tablet_bootstrap.cc:654] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.265498 15793 tablet_bootstrap.cc:654] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.265111 15838 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.270010 15792 tablet_bootstrap.cc:654] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.270715 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:46.271931 15838 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.272181 15791 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.272121 15750 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.270721 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:46.272746 15791 ts_tablet_manager.cc:1403] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 13:16:46.273383 15674 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.285403 15750 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:46.287461 15567 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:46.288352 15838 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.288849 15838 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:46.289429 15674 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:46.289690 15838 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.292243 15791 raft_consensus.cc:359] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.292972 15791 raft_consensus.cc:385] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.293246 15791 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.294102 15791 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.291479 15792 tablet_bootstrap.cc:492] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.295356 15792 ts_tablet_manager.cc:1403] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.012s
I20260709 13:16:46.296962 15791 ts_tablet_manager.cc:1434] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:16:46.298293 15791 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.299134 15793 tablet_bootstrap.cc:492] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.299576 15793 ts_tablet_manager.cc:1403] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.013s
I20260709 13:16:46.305737 15793 raft_consensus.cc:359] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.306491 15793 raft_consensus.cc:385] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.306696 15792 raft_consensus.cc:359] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.307603 15792 raft_consensus.cc:385] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.308113 15791 tablet_bootstrap.cc:654] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.307940 15792 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.309367 15792 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.323482 15792 ts_tablet_manager.cc:1434] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:16:46.324491 15792 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.324404 15500 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.330987 15792 tablet_bootstrap.cc:654] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.306769 15793 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.333259 15793 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.340637 15793 ts_tablet_manager.cc:1434] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:16:46.341607 15793 tablet_bootstrap.cc:492] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:46.353858 15886 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.354367 15886 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.356499 15886 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.358067 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.358220 15886 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.358783 15674 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:46.359529 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.360143 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.360174 15600 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:46.364584 15886 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.365202 15886 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.365648 15886 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.369166 15793 tablet_bootstrap.cc:654] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.374063 15886 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.377345 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.378108 15600 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.382961 15791 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.383560 15791 ts_tablet_manager.cc:1403] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.018s
I20260709 13:16:46.385950 15791 raft_consensus.cc:359] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.386487 15791 raft_consensus.cc:385] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.386734 15791 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.387415 15791 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.389436 15791 ts_tablet_manager.cc:1434] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:46.389750 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:46.390343 15674 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.393239 15791 tablet_bootstrap.cc:492] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.398008 15792 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.398559 15792 ts_tablet_manager.cc:1403] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.006s
I20260709 13:16:46.399464 15674 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:46.400832 15791 tablet_bootstrap.cc:654] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.400977 15838 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.401552 15838 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.403339 15793 tablet_bootstrap.cc:492] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.403723 15838 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.403872 15793 ts_tablet_manager.cc:1403] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.001s
I20260709 13:16:46.405478 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.407711 15793 raft_consensus.cc:359] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.408617 15793 raft_consensus.cc:385] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.408957 15793 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.409615 15880 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.409863 15793 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.411468 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.411775 15792 raft_consensus.cc:359] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.412328 15880 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.412927 15880 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:46.414078 15880 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.417582 15792 raft_consensus.cc:385] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.417879 15792 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.418679 15792 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.419502 15791 tablet_bootstrap.cc:492] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.420152 15791 ts_tablet_manager.cc:1403] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.016s
I20260709 13:16:46.423206 15791 raft_consensus.cc:359] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.423305 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.419485 15886 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.424314 15791 raft_consensus.cc:385] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.424618 15676 raft_consensus.cc:2393] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:16:46.424691 15791 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.425673 15791 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.428043 15791 ts_tablet_manager.cc:1434] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:16:46.429010 15791 tablet_bootstrap.cc:492] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.429373 15793 ts_tablet_manager.cc:1434] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.004s
I20260709 13:16:46.430301 15793 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:46.432586 15565 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:46.435655 15791 tablet_bootstrap.cc:654] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.436975 15872 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.440124 15792 ts_tablet_manager.cc:1434] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:16:46.441370 15792 tablet_bootstrap.cc:492] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.449087 15793 tablet_bootstrap.cc:654] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.455983 15791 tablet_bootstrap.cc:492] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.456508 15791 ts_tablet_manager.cc:1403] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.010s
I20260709 13:16:46.456931 15792 tablet_bootstrap.cc:654] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.457046 15498 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.459347 15791 raft_consensus.cc:359] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.460280 15791 raft_consensus.cc:385] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.461143 15873 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.461583 15873 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.462174 15793 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.462613 15793 ts_tablet_manager.cc:1403] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:16:46.463757 15873 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.460646 15791 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.465258 15793 raft_consensus.cc:359] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.465304 15791 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.465989 15793 raft_consensus.cc:385] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.466287 15793 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.466912 15793 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.467448 15791 ts_tablet_manager.cc:1434] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:16:46.468406 15791 tablet_bootstrap.cc:492] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.470490 15792 tablet_bootstrap.cc:492] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.470938 15792 ts_tablet_manager.cc:1403] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:16:46.474092 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.474756 15750 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:46.475041 15792 raft_consensus.cc:359] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.475692 15792 raft_consensus.cc:385] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.475986 15791 tablet_bootstrap.cc:654] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.475970 15792 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.476547 15873 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.476720 15792 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.477034 15873 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.479193 15873 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.479202 15793 ts_tablet_manager.cc:1434] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:16:46.480433 15872 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.480729 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.481608 15873 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.482045 15873 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.482446 15873 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.482875 15792 ts_tablet_manager.cc:1434] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:16:46.484313 15792 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.487509 15791 tablet_bootstrap.cc:492] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
W20260709 13:16:46.487872 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:46.488106 15791 ts_tablet_manager.cc:1403] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:16:46.489259 15813 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.490072 15793 tablet_bootstrap.cc:492] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:46.491310 15600 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:46.492156 15872 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.492662 15872 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.494684 15872 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.495947 15793 tablet_bootstrap.cc:654] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.496063 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.496789 15749 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:46.497483 15792 tablet_bootstrap.cc:654] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.498157 15567 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:46.499043 15838 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.499400 15838 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.499749 15838 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.501297 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.501611 15791 raft_consensus.cc:359] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.502792 15791 raft_consensus.cc:385] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.503208 15791 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.503845 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.504531 15599 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:46.504186 15791 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.506543 15873 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.508108 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.508783 15749 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:46.509462 15791 ts_tablet_manager.cc:1434] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:16:46.510987 15791 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.511204 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.511878 15674 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:46.514022 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.515362 15833 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.515763 15833 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.516108 15833 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.516892 15792 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.517390 15792 ts_tablet_manager.cc:1403] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
W20260709 13:16:46.521024 15640 leader_election.cc:343] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.528249 15791 tablet_bootstrap.cc:654] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.529006 15873 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.534803 15833 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.537469 15792 raft_consensus.cc:359] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.541319 15792 raft_consensus.cc:385] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.534304 15843 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.546048 15843 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.548152 15843 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.543109 15792 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.549625 15792 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.552060 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.552794 15599 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.554107 15792 ts_tablet_manager.cc:1434] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:16:46.555087 15792 tablet_bootstrap.cc:492] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.560631 15843 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.561813 15843 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.569571 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:46.570425 15750 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.588812 15843 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.563829 15838 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.605182 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.605940 15674 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:46.605182 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.613926 15873 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.617419 15838 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.619696 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:46.620344 15674 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.614616 15873 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.623356 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.622404 15833 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.622360 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:46.624289 15749 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.624948 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.625204 15600 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:46.625548 15602 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.625679 15873 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.629074 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.630512 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.632195 15599 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:46.632386 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:46.632709 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.633280 15751 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.633621 15748 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
W20260709 13:16:46.634544 15640 leader_election.cc:343] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.636121 15750 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:46.637871 15793 tablet_bootstrap.cc:492] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.638367 15793 ts_tablet_manager.cc:1403] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.049s
I20260709 13:16:46.641348 15793 raft_consensus.cc:359] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.642125 15793 raft_consensus.cc:385] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.642500 15793 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.641345 15792 tablet_bootstrap.cc:654] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.644506 15793 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.653717 15642 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:46.655776 15833 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.656173 15833 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.656505 15833 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.657382 15602 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:46.657620 15749 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:46.649887 15751 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:46.659700 15567 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:46.663286 15838 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.663910 15833 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.664108 15838 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:46.666275 15793 ts_tablet_manager.cc:1434] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 13:16:46.667189 15793 tablet_bootstrap.cc:492] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:46.668028 15933 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.670531 15714 leader_election.cc:343] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.671247 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:46.671339 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.672089 15873 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.672266 15843 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:46.672179 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:46.672763 15843 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.672866 15873 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:46.673146 15843 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.673085 15880 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:16:46.674114 15714 leader_election.cc:343] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.674196 15880 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.673893 15873 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.674711 15880 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.675068 15871 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.669896 15838 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.676301 15881 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:46.668519 15933 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.682888 15833 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.690095 15933 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.699110 15674 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:46.702973 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.708214 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.709543 15791 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.686048 15640 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.709899 15791 ts_tablet_manager.cc:1403] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.199s	user 0.026s	sys 0.022s
I20260709 13:16:46.711549 15567 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:46.712159 15792 tablet_bootstrap.cc:492] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.712651 15792 ts_tablet_manager.cc:1403] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.003s
I20260709 13:16:46.713414 15791 raft_consensus.cc:359] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.713889 15791 raft_consensus.cc:385] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.714095 15791 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.713056 15871 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.716032 15873 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.716727 15873 raft_consensus.cc:697] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:46.718433 15936 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.717726 15873 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.721231 15791 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.718957 15936 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.725651 15793 tablet_bootstrap.cc:654] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.704737 15880 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.729450 15791 ts_tablet_manager.cc:1434] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:16:46.731619 15791 tablet_bootstrap.cc:492] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.729043 15936 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.734722 15882 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.735198 15882 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.737123 15882 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.720255 15843 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.741436 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.742261 15750 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:16:46.742465 15843 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.745216 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.736984 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:46.746232 15749 raft_consensus.cc:2393] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:16:46.749342 15880 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:46.752120 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:46.754261 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.764642 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:46.767582 15677 raft_consensus.cc:2393] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:46.768532 15791 tablet_bootstrap.cc:654] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.774026 15602 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.778362 15880 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:46.778980 15714 leader_election.cc:343] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.778934 15880 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.780280 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.781029 15599 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:46.781450 15880 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:16:46.783165 15640 leader_election.cc:343] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.783682 15640 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:46.771349 15675 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.789561 15792 raft_consensus.cc:359] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.790138 15792 raft_consensus.cc:385] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.790374 15792 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.790901 15792 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.787840 15936 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.789016 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:16:46.794329 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:46.799008 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.799660 15599 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.799935 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.801898 15792 ts_tablet_manager.cc:1434] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.005s
I20260709 13:16:46.803172 15675 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:46.803376 15792 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.807412 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.809899 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:46.805359 15936 raft_consensus.cc:2764] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:16:46.810732 15602 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:46.808948 15880 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 13:16:46.813292 15714 leader_election.cc:343] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.814445 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:46.821113 15497 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.824375 15792 tablet_bootstrap.cc:654] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.828953 15599 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:46.849386 15791 tablet_bootstrap.cc:492] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.850227 15793 tablet_bootstrap.cc:492] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.851065 15793 ts_tablet_manager.cc:1403] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.184s	user 0.012s	sys 0.010s
I20260709 13:16:46.851862 15791 ts_tablet_manager.cc:1403] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.121s	user 0.031s	sys 0.015s
I20260709 13:16:46.845173 15936 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:16:46.854537 15714 leader_election.cc:343] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.855166 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:46.856150 15843 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.847266 15880 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.861405 15880 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:46.862605 15880 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.864786 15933 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.838397 15602 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
W20260709 13:16:46.870755 15941 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:46.873945 15791 raft_consensus.cc:359] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.874722 15791 raft_consensus.cc:385] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.875000 15791 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.875682 15791 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.877933 15791 ts_tablet_manager.cc:1434] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:16:46.878903 15791 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.881131 15793 raft_consensus.cc:359] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.884398 15793 raft_consensus.cc:385] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.885656 15793 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.886431 15793 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.888056 15793 ts_tablet_manager.cc:1434] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.003s
I20260709 13:16:46.889793 15793 tablet_bootstrap.cc:492] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
W20260709 13:16:46.895009 15714 leader_election.cc:343] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.895668 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:46.895076 15497 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.897563 15497 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.900848 15844 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:46.905026 15792 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.905501 15792 ts_tablet_manager.cc:1403] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.018s
I20260709 13:16:46.909624 15792 raft_consensus.cc:359] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.910308 15792 raft_consensus.cc:385] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.910576 15792 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.911564 15792 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.913048 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:46.914269 15792 ts_tablet_manager.cc:1434] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:46.916747 15880 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:46.918373 15792 tablet_bootstrap.cc:492] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:46.924727 15498 catalog_manager.cc:5697] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.922459 15793 tablet_bootstrap.cc:654] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.917259 15880 raft_consensus.cc:697] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:46.933086 15880 consensus_queue.cc:237] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.943339 15791 tablet_bootstrap.cc:654] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.961040 15873 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.961594 15873 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.963711 15873 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:46.963833 15792 tablet_bootstrap.cc:654] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.974184 15844 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.974735 15791 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:46.975484 15791 ts_tablet_manager.cc:1403] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.009s
I20260709 13:16:46.979147 15791 raft_consensus.cc:359] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.979274 15498 catalog_manager.cc:5697] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:46.983278 15791 raft_consensus.cc:385] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.982934 15844 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:46.980659 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:46.982088 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:46.982811 15792 tablet_bootstrap.cc:492] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:46.984272 15792 ts_tablet_manager.cc:1403] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.005s
I20260709 13:16:46.984153 15751 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:46.987694 15792 raft_consensus.cc:359] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.988400 15792 raft_consensus.cc:385] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:46.988694 15792 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
W20260709 13:16:46.989044 15640 leader_election.cc:343] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:46.989326 15792 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.983568 15791 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:46.990599 15791 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.992744 15791 ts_tablet_manager.cc:1434] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:16:46.993574 15791 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:46.995914 15793 tablet_bootstrap.cc:492] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:46.996543 15793 ts_tablet_manager.cc:1403] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.013s
I20260709 13:16:46.999245 15793 raft_consensus.cc:359] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:46.999984 15793 raft_consensus.cc:385] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.000296 15793 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.000924 15792 ts_tablet_manager.cc:1434] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:16:47.001191 15793 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.001859 15792 tablet_bootstrap.cc:492] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.003616 15793 ts_tablet_manager.cc:1434] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:16:47.004698 15793 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.008952 15792 tablet_bootstrap.cc:654] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:46.999194 15791 tablet_bootstrap.cc:654] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.013854 15642 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:47.015300 15934 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.015718 15934 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.016072 15934 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.016690 15793 tablet_bootstrap.cc:654] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.030762 15791 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.031293 15791 ts_tablet_manager.cc:1403] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 13:16:47.024550 15844 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.031767 15844 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.034799 15791 raft_consensus.cc:359] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.035535 15791 raft_consensus.cc:385] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.035841 15791 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.036535 15791 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.027357 15934 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.042719 15844 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:47.044551 15792 tablet_bootstrap.cc:492] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.044811 15934 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.045042 15792 ts_tablet_manager.cc:1403] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.014s
I20260709 13:16:47.042330 15791 ts_tablet_manager.cc:1434] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:16:47.046250 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:47.047627 15791 tablet_bootstrap.cc:492] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:47.048187 15792 raft_consensus.cc:359] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.048892 15792 raft_consensus.cc:385] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.049165 15792 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.049821 15792 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:47.050340 15640 leader_election.cc:343] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.052066 15792 ts_tablet_manager.cc:1434] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:16:47.052980 15792 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.053918 15791 tablet_bootstrap.cc:654] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.054371 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:47.055008 15601 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:47.057447 15793 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:47.057493 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.058058 15793 ts_tablet_manager.cc:1403] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.015s
I20260709 13:16:47.060670 15792 tablet_bootstrap.cc:654] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.061442 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:47.062258 15751 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.063184 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:47.069456 15886 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.069882 15886 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.070254 15886 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.071893 15792 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.072413 15792 ts_tablet_manager.cc:1403] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.011s
I20260709 13:16:47.075093 15792 raft_consensus.cc:359] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.075799 15792 raft_consensus.cc:385] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.076082 15792 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.076978 15792 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.078737 15886 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.080240 15792 ts_tablet_manager.cc:1434] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:16:47.080860 15886 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:47.081288 15792 tablet_bootstrap.cc:492] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.088047 15792 tablet_bootstrap.cc:654] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.098459 15873 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.106230 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:47.107936 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:47.108665 15599 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:47.108911 15714 leader_election.cc:343] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:47.110364 15714 leader_election.cc:343] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.067096 15793 raft_consensus.cc:359] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.121014 15933 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.113523 15793 raft_consensus.cc:385] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.125032 15793 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.125250 15599 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:47.126032 15793 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.128541 15751 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:47.133494 15642 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:47.138993 15791 tablet_bootstrap.cc:492] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.139161 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.139501 15791 ts_tablet_manager.cc:1403] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.092s	user 0.037s	sys 0.036s
I20260709 13:16:47.140921 15792 tablet_bootstrap.cc:492] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.141383 15792 ts_tablet_manager.cc:1403] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.030s
I20260709 13:16:47.141600 15936 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.142625 15936 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:47.143455 15936 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.144116 15792 raft_consensus.cc:359] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.144784 15792 raft_consensus.cc:385] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.145040 15792 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.145673 15792 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.147763 15792 ts_tablet_manager.cc:1434] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:16:47.148926 15792 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.156260 15792 tablet_bootstrap.cc:654] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.161008 15793 ts_tablet_manager.cc:1434] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.002s
I20260709 13:16:47.161419 15844 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.161950 15844 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:47.162122 15793 tablet_bootstrap.cc:492] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.162451 15791 raft_consensus.cc:359] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.163110 15791 raft_consensus.cc:385] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.162775 15844 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.163388 15791 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.164098 15791 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.165863 15873 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.166550 15791 ts_tablet_manager.cc:1434] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:16:47.167501 15791 tablet_bootstrap.cc:492] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:47.172914 15793 tablet_bootstrap.cc:654] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.173846 15791 tablet_bootstrap.cc:654] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.176030 15792 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.176671 15792 ts_tablet_manager.cc:1403] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:16:47.179841 15792 raft_consensus.cc:359] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.180516 15792 raft_consensus.cc:385] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.181136 15792 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.185004 15833 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:47.187319 15792 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.198462 15792 ts_tablet_manager.cc:1434] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:16:47.203205 15497 catalog_manager.cc:5697] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.205363 15792 tablet_bootstrap.cc:492] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.216837 15872 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.221122 15793 tablet_bootstrap.cc:492] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:47.221587 15793 ts_tablet_manager.cc:1403] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.009s
I20260709 13:16:47.228338 15792 tablet_bootstrap.cc:654] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.230554 15498 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.231447 15936 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.233384 15933 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.233893 15933 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.235495 15872 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.235930 15933 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.237156 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.236060 15872 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.238472 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.239089 15675 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:47.240181 15872 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.238092 15750 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:47.241281 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.241689 15567 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:47.244391 15933 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.244782 15933 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.245123 15933 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.245620 15751 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:47.248453 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:47.249483 15872 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.249856 15872 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.250722 15872 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.252956 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.252458 15933 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.255628 15791 tablet_bootstrap.cc:492] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.256103 15791 ts_tablet_manager.cc:1403] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.089s	user 0.006s	sys 0.017s
I20260709 13:16:47.257326 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:47.257611 15793 raft_consensus.cc:359] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.258332 15751 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.259941 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:47.258327 15793 raft_consensus.cc:385] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.260531 15675 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:47.260582 15565 leader_election.cc:343] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.260825 15793 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.264286 15933 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.264585 15793 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.273322 15791 raft_consensus.cc:359] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.274260 15791 raft_consensus.cc:385] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.274600 15791 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.274791 15675 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:47.276021 15565 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:47.277527 15933 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.278172 15933 raft_consensus.cc:697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:47.279271 15933 consensus_queue.cc:237] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.280650 15871 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.281224 15793 ts_tablet_manager.cc:1434] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:16:47.281137 15871 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.282166 15793 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.283154 15871 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.286054 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.286888 15750 raft_consensus.cc:2393] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:47.275607 15791 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.290676 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.293730 15565 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.294814 15871 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.309113 15882 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.272053 15872 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.312942 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:47.313632 15750 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.324268 15792 tablet_bootstrap.cc:492] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.324936 15792 ts_tablet_manager.cc:1403] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.120s	user 0.014s	sys 0.002s
I20260709 13:16:47.326100 15751 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:47.329700 15791 ts_tablet_manager.cc:1434] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.073s	user 0.000s	sys 0.009s
I20260709 13:16:47.330803 15791 tablet_bootstrap.cc:492] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:47.332713 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:47.333539 15750 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:47.334393 15872 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.334829 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:47.328034 15792 raft_consensus.cc:359] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.336771 15792 raft_consensus.cc:385] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:47.336840 15565 leader_election.cc:343] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.337122 15792 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.337805 15792 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.339300 15872 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.340530 15793 tablet_bootstrap.cc:654] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.343241 15838 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.351329 15792 ts_tablet_manager.cc:1434] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:16:47.351212 15838 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.352310 15792 tablet_bootstrap.cc:492] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.343581 15872 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:47.354576 15872 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.343343 15871 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.363873 15793 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:47.364430 15793 ts_tablet_manager.cc:1403] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.003s
I20260709 13:16:47.366430 15793 raft_consensus.cc:359] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.366906 15793 raft_consensus.cc:385] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.367118 15793 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.367789 15793 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.368283 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.368887 15676 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:47.373674 15793 ts_tablet_manager.cc:1434] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:16:47.373898 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.377436 15565 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:47.378146 15750 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:47.379905 15981 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.380191 15791 tablet_bootstrap.cc:654] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.380486 15981 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.381014 15981 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.390472 15793 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.377264 15792 tablet_bootstrap.cc:654] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.397861 15882 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.401752 15843 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.373497 15838 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.421401 15886 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.421025 15497 catalog_manager.cc:5697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.423163 15497 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.426196 15791 tablet_bootstrap.cc:492] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.426710 15791 ts_tablet_manager.cc:1403] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.006s
I20260709 13:16:47.445822 15791 raft_consensus.cc:359] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.446537 15791 raft_consensus.cc:385] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.450748 15833 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.451638 15792 tablet_bootstrap.cc:492] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.451611 15833 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.452207 15792 ts_tablet_manager.cc:1403] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.002s
I20260709 13:16:47.453159 15791 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.457405 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.459136 15791 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.456514 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:47.455343 15792 raft_consensus.cc:359] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.457159 15833 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.460069 15750 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:47.460642 15602 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:47.462349 15640 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:47.463189 15833 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.463567 15833 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.463915 15833 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.465072 15791 ts_tablet_manager.cc:1434] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.002s
I20260709 13:16:47.466336 15791 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:47.472259 15791 tablet_bootstrap.cc:654] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.472259 15793 tablet_bootstrap.cc:654] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.476512 15833 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.460922 15792 raft_consensus.cc:385] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.479027 15792 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.479662 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:47.480417 15602 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.480077 15792 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.487708 15981 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.482939 15792 ts_tablet_manager.cc:1434] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.001s
I20260709 13:16:47.499575 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:47.500360 15676 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.503685 15602 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:47.506170 15792 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.513060 15640 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:47.514222 15936 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.514783 15936 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:47.515691 15936 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.519166 15981 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.520211 15833 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.521160 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:47.521309 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:47.521898 15750 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.522212 15751 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.526341 15676 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:47.530148 15981 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.530490 15565 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:47.530846 15981 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.531584 15872 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.532152 15872 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:47.533141 15872 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.539121 15751 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:47.540411 15981 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.542392 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.542392 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:47.556311 15565 leader_election.cc:343] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.557281 15791 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.557108 15749 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:47.557762 15791 ts_tablet_manager.cc:1403] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.021s
I20260709 13:16:47.560091 15567 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.560992 15838 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.560824 15791 raft_consensus.cc:359] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.561373 15838 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.561563 15791 raft_consensus.cc:385] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.561718 15838 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.561852 15791 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.562527 15791 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.565014 15791 ts_tablet_manager.cc:1434] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:16:47.566291 15791 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:47.574571 15750 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:47.575506 15500 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.580355 15497 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.585999 15793 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:47.586552 15793 ts_tablet_manager.cc:1403] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.036s
W20260709 13:16:47.588492 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:47.589615 15793 raft_consensus.cc:359] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.590215 15793 raft_consensus.cc:385] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.590512 15793 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.591172 15793 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.593194 15793 ts_tablet_manager.cc:1434] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:16:47.594238 15793 tablet_bootstrap.cc:492] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.597151 15880 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.598079 15880 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.601271 15880 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:47.603991 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:16:47.605861 15714 leader_election.cc:343] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.606115 15793 tablet_bootstrap.cc:654] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.606024 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.606330 15792 tablet_bootstrap.cc:654] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:47.607287 15714 leader_election.cc:343] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.607790 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.608744 15880 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.607086 15838 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.611377 15838 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.611480 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:47.612149 15793 tablet_bootstrap.cc:492] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:47.611959 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:47.612592 15793 ts_tablet_manager.cc:1403] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.004s
I20260709 13:16:47.612619 15750 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:47.613171 15565 leader_election.cc:343] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.613869 15791 tablet_bootstrap.cc:654] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.615710 15793 raft_consensus.cc:359] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.616410 15793 raft_consensus.cc:385] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.616752 15793 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.617484 15793 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.618347 15792 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.618796 15792 ts_tablet_manager.cc:1403] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.128s	user 0.008s	sys 0.004s
I20260709 13:16:47.619676 15793 ts_tablet_manager.cc:1434] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:16:47.620726 15793 tablet_bootstrap.cc:492] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.620800 15750 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:47.622138 15567 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.622952 15838 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.621325 15792 raft_consensus.cc:359] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.623718 15792 raft_consensus.cc:385] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.624047 15792 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.625735 15792 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.627540 15838 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:47.627908 15793 tablet_bootstrap.cc:654] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.628552 15838 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.631839 15791 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.632295 15791 ts_tablet_manager.cc:1403] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.066s	user 0.007s	sys 0.005s
I20260709 13:16:47.634815 15791 raft_consensus.cc:359] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.635486 15791 raft_consensus.cc:385] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.635782 15791 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.627790 15792 ts_tablet_manager.cc:1434] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:16:47.637542 15792 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.636442 15791 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.641287 15791 ts_tablet_manager.cc:1434] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:16:47.643872 15791 tablet_bootstrap.cc:492] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:47.647867 15792 tablet_bootstrap.cc:654] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.649700 15793 tablet_bootstrap.cc:492] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:47.650316 15793 ts_tablet_manager.cc:1403] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.011s
I20260709 13:16:47.652976 15793 raft_consensus.cc:359] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.653846 15793 raft_consensus.cc:385] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.654173 15793 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.654742 15880 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.654942 15793 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.655220 15880 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.657195 15880 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:47.658382 15791 tablet_bootstrap.cc:654] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.660972 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:47.661701 15601 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:47.662767 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.663408 15676 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:47.667523 15791 tablet_bootstrap.cc:492] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.668004 15791 ts_tablet_manager.cc:1403] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:16:47.667873 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:47.668774 15793 ts_tablet_manager.cc:1434] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:16:47.668141 15500 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.669523 15882 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.669924 15882 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.670280 15882 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.672037 15792 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.672477 15792 ts_tablet_manager.cc:1403] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 13:16:47.677867 15791 raft_consensus.cc:359] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.675578 15792 raft_consensus.cc:359] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.678455 15793 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.681483 15882 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.682058 15936 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.684139 15882 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:47.679177 15792 raft_consensus.cc:385] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.687908 15792 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.688277 15793 tablet_bootstrap.cc:654] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.688055 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:47.688789 15601 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.688666 15792 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.690816 15792 ts_tablet_manager.cc:1434] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:16:47.691646 15792 tablet_bootstrap.cc:492] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:47.678566 15791 raft_consensus.cc:385] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.700404 15791 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.701488 15791 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.711431 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:47.712105 15676 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.734524 15838 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.757989 15880 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.760179 15880 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.773809 15980 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.774492 15980 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.784976 15873 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.760838 15880 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.785804 15792 tablet_bootstrap.cc:654] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.785560 15873 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.790810 15601 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:47.793228 15675 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.793735 15873 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.796146 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:47.796341 15833 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.796674 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.797863 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:47.798705 15882 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:47.799177 15882 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:47.799978 15882 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.802829 15980 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.803505 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.804574 15791 ts_tablet_manager.cc:1434] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.136s	user 0.013s	sys 0.000s
I20260709 13:16:47.805445 15791 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
W20260709 13:16:47.810117 15565 leader_election.cc:343] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.815343 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:47.819856 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:47.820223 15880 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:47.820639 15749 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:47.841797 15793 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:47.842254 15793 ts_tablet_manager.cc:1403] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.055s
I20260709 13:16:47.845773 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.847223 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:47.847416 15933 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:47.836202 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:47.852329 15933 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.857296 15933 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.857640 15793 raft_consensus.cc:359] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.858327 15793 raft_consensus.cc:385] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.858583 15793 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.859153 15793 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:47.861179 15714 leader_election.cc:343] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.864460 15793 ts_tablet_manager.cc:1434] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 13:16:47.866271 15793 tablet_bootstrap.cc:492] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:47.861935 15882 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.874648 15882 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.877467 15872 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.879799 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:47.880156 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:47.881556 15714 leader_election.cc:343] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.884258 15673 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.880028 15933 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:47.886596 15714 leader_election.cc:343] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.887033 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.890146 15791 tablet_bootstrap.cc:654] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.890578 15880 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.890765 15601 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:47.890769 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:16:47.894052 15565 leader_election.cc:343] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:47.887874 15882 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:47.906922 15873 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:47.897146 15933 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:47.915678 15936 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.918983 15676 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:47.918993 15882 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.903827 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:47.923593 15793 tablet_bootstrap.cc:654] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:47.925560 15750 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:47.936017 15933 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:47.966461 15873 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.971024 15792 tablet_bootstrap.cc:492] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:47.971515 15792 ts_tablet_manager.cc:1403] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.280s	user 0.010s	sys 0.007s
I20260709 13:16:47.971248 15714 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:47.981220 15791 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:47.981714 15791 ts_tablet_manager.cc:1403] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.016s
I20260709 13:16:47.988907 15791 raft_consensus.cc:359] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.989192 15838 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:47.989636 15791 raft_consensus.cc:385] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:47.989935 15791 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:47.990592 15791 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:47.994690 15791 ts_tablet_manager.cc:1434] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:16:48.002009 15791 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.005043 15500 catalog_manager.cc:5697] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.010727 15873 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.012552 15873 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.017982 15873 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.019173 15793 tablet_bootstrap.cc:492] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:48.019119 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.019380 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.015100 15750 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:48.015027 15792 raft_consensus.cc:359] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.026968 15792 raft_consensus.cc:385] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.027263 15792 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.024978 15793 ts_tablet_manager.cc:1403] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.159s	user 0.037s	sys 0.000s
W20260709 13:16:48.028631 15642 leader_election.cc:343] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.030301 15882 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.030701 15793 raft_consensus.cc:359] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.031407 15793 raft_consensus.cc:385] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:16:48.031541 15640 leader_election.cc:343] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.031718 15793 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.032021 15640 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:48.032420 15793 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.032887 15833 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.036320 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.037508 15981 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.038007 15981 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:48.038331 15791 tablet_bootstrap.cc:654] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.038842 15981 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.038103 15792 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.042042 15793 ts_tablet_manager.cc:1434] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:16:48.043218 15793 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:48.044888 15792 ts_tablet_manager.cc:1434] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 13:16:48.046126 15792 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.050406 15882 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.053224 15882 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.054617 15793 tablet_bootstrap.cc:654] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.055366 15882 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:48.056664 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.056775 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.050623 15872 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.059342 15714 leader_election.cc:343] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:48.074252 15714 leader_election.cc:343] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.074715 15714 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.062661 15872 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.077143 15872 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.078688 15872 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.079067 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.080497 15873 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:48.080617 15565 leader_election.cc:343] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.081357 15843 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.081071 15873 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.085466 15792 tablet_bootstrap.cc:654] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.084265 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.087327 15873 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.101342 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.101018 15498 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.102139 15750 raft_consensus.cc:2393] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:48.105718 15676 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.106796 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.107426 15791 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.107920 15791 ts_tablet_manager.cc:1403] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.023s
I20260709 13:16:48.111021 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:16:48.111254 15567 leader_election.cc:343] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.111656 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.112789 15872 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.124063 15791 raft_consensus.cc:359] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.124851 15791 raft_consensus.cc:385] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.125137 15791 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.125923 15791 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.127553 15838 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:48.130959 15793 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:48.131428 15793 ts_tablet_manager.cc:1403] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.007s
I20260709 13:16:48.134338 15791 ts_tablet_manager.cc:1434] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:16:48.135303 15791 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.142916 15793 raft_consensus.cc:359] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.143813 15793 raft_consensus.cc:385] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.144191 15793 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.145058 15793 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.147794 15793 ts_tablet_manager.cc:1434] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:16:48.148150 15792 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.148665 15792 ts_tablet_manager.cc:1403] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.011s
I20260709 13:16:48.151373 15793 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:48.152514 15873 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.155321 15791 tablet_bootstrap.cc:654] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.155499 15838 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.157352 15838 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.159659 15793 tablet_bootstrap.cc:654] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.172232 15791 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.179751 15791 ts_tablet_manager.cc:1403] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.006s
I20260709 13:16:48.179935 15792 raft_consensus.cc:359] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.181819 15792 raft_consensus.cc:385] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.182126 15792 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.182808 15792 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.184695 15791 raft_consensus.cc:359] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.185567 15791 raft_consensus.cc:385] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.185880 15791 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.186587 15792 ts_tablet_manager.cc:1434] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:16:48.186720 15791 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.189668 15791 ts_tablet_manager.cc:1434] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:48.189760 15792 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.191061 15791 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.198959 15791 tablet_bootstrap.cc:654] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.208179 15793 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:48.208227 15882 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.208796 15793 ts_tablet_manager.cc:1403] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.020s
I20260709 13:16:48.211246 15793 raft_consensus.cc:359] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.211937 15793 raft_consensus.cc:385] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.212203 15793 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.212841 15793 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.215135 15793 ts_tablet_manager.cc:1434] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:48.216004 15793 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:48.208796 15882 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.220579 15882 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:48.223050 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.223716 15601 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:48.222645 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.222196 15793 tablet_bootstrap.cc:654] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:48.225800 15714 leader_election.cc:343] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.227418 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.229389 15843 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.229802 15843 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.230261 15843 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.239104 15792 tablet_bootstrap.cc:654] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.239127 15791 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.239815 15791 ts_tablet_manager.cc:1403] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.018s
I20260709 13:16:48.243001 15791 raft_consensus.cc:359] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.244083 15791 raft_consensus.cc:385] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.244519 15791 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.245710 15791 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.248231 15791 ts_tablet_manager.cc:1434] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:16:48.249459 15791 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.258365 15792 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.258873 15792 ts_tablet_manager.cc:1403] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.009s
I20260709 13:16:48.260391 15882 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:48.262069 15792 raft_consensus.cc:359] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.262760 15792 raft_consensus.cc:385] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.263108 15792 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.263746 15792 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.266501 15792 ts_tablet_manager.cc:1434] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:16:48.269848 15791 tablet_bootstrap.cc:654] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.275493 15792 tablet_bootstrap.cc:492] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.284283 15792 tablet_bootstrap.cc:654] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.293253 15873 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.293788 15873 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.297777 15873 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.299468 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.300390 15601 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:48.300725 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.301548 15751 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:48.303256 15640 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:48.306020 15873 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.306535 15873 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.306981 15873 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.313928 15882 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.314495 15882 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.316226 15936 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.316542 15882 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:48.316963 15936 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.319739 15936 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.322260 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.322898 15751 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:48.323192 15792 tablet_bootstrap.cc:492] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.324112 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.324954 15792 ts_tablet_manager.cc:1403] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.004s
I20260709 13:16:48.325526 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:48.329247 15833 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.329733 15833 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.330174 15833 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.332716 15792 raft_consensus.cc:359] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:48.333425 15714 leader_election.cc:343] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.333714 15792 raft_consensus.cc:385] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.334223 15792 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.335103 15792 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.338469 15792 ts_tablet_manager.cc:1434] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:16:48.339977 15792 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.349170 15792 tablet_bootstrap.cc:654] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.361739 15792 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.362723 15792 ts_tablet_manager.cc:1403] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 13:16:48.365641 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.366719 15792 raft_consensus.cc:359] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.367729 15792 raft_consensus.cc:385] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.368137 15792 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.369064 15792 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.371505 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.372056 15792 ts_tablet_manager.cc:1434] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:48.373500 15792 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.377462 15843 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.381381 15792 tablet_bootstrap.cc:654] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.386201 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:16:48.389900 15714 leader_election.cc:343] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:48.392940 15640 leader_election.cc:343] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.376024 15833 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.417893 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:48.418784 15751 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:48.429347 15714 leader_election.cc:343] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.430007 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.430966 15886 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.442304 15843 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:48.451509 15833 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.455428 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:48.466352 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:48.469919 15872 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.485446 15599 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.508889 15751 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:48.509208 15843 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.511010 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:48.511876 16033 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.511606 15873 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.512375 16033 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:48.513310 16033 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.509902 15843 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.516426 15843 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:48.518579 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:48.520862 15714 leader_election.cc:343] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.525308 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.530735 15499 catalog_manager.cc:5697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.549608 15791 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.550125 15791 ts_tablet_manager.cc:1403] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.301s	user 0.053s	sys 0.104s
W20260709 13:16:48.553526 15640 leader_election.cc:343] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.565651 15873 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.565510 15880 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.567184 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:48.567783 15748 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.568751 15791 raft_consensus.cc:359] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.569410 15791 raft_consensus.cc:385] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.569674 15791 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.570307 15791 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.572363 15791 ts_tablet_manager.cc:1434] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.000s
I20260709 13:16:48.572999 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:48.573613 15601 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.575102 15748 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:48.575974 15791 tablet_bootstrap.cc:492] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.578828 15792 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.579839 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:48.580345 15599 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:48.580701 15601 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:48.580842 15873 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.582026 15873 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:48.582868 15873 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:48.583243 15714 leader_election.cc:343] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.583779 15714 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.584453 15880 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.584586 15791 tablet_bootstrap.cc:654] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.580103 15792 ts_tablet_manager.cc:1403] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.207s	user 0.084s	sys 0.068s
I20260709 13:16:48.592825 15793 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:48.597998 15793 ts_tablet_manager.cc:1403] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.382s	user 0.135s	sys 0.146s
I20260709 13:16:48.601953 15793 raft_consensus.cc:359] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.602669 15793 raft_consensus.cc:385] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.602950 15793 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
W20260709 13:16:48.603010 15565 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:48.603368 15792 raft_consensus.cc:359] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.604352 15792 raft_consensus.cc:385] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.604754 15792 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.608026 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.608870 15880 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.609361 15880 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:48.610140 15880 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.614609 15936 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.615294 15936 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.617388 15936 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.620126 15843 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.620675 15843 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.621284 15793 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.622753 15843 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:48.624571 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.625435 15676 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:48.613610 15498 catalog_manager.cc:5697] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.616947 15792 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.629416 15793 ts_tablet_manager.cc:1434] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:16:48.630424 15793 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:48.631400 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.632005 15599 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:48.632546 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.633188 15748 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:48.635201 15642 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:48.635983 15792 ts_tablet_manager.cc:1434] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:16:48.636053 15873 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.636533 15873 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.636927 15873 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.637209 15792 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.645134 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:48.646045 15843 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.646560 15843 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.646986 15843 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.647497 15933 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.647938 15933 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.649935 15933 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.644171 15873 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.651108 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.651753 15748 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:48.652938 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:48.653875 15933 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.654263 15933 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.654639 15933 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.654394 15843 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.655802 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:48.656412 15599 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:48.656733 15843 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:48.658452 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.662400 15873 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.666141 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:48.666982 15673 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:48.667086 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:48.667829 15748 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:16:48.670876 15793 tablet_bootstrap.cc:654] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.671186 15933 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.678598 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:48.679467 15600 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:48.684455 15565 leader_election.cc:343] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.687306 15791 tablet_bootstrap.cc:492] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.687824 15791 ts_tablet_manager.cc:1403] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.112s	user 0.028s	sys 0.050s
I20260709 13:16:48.688562 15600 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:48.689983 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:48.690366 15933 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.684507 15792 tablet_bootstrap.cc:654] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.690541 15791 raft_consensus.cc:359] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.691368 15791 raft_consensus.cc:385] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.691654 15791 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.690603 15748 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.671725 15498 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.701184 15748 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:48.702329 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:48.703243 15933 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.703730 15933 raft_consensus.cc:697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:48.704566 15933 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.709545 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:48.709828 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:48.710378 15601 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:16:48.715363 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.716816 15880 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.717324 15880 raft_consensus.cc:697] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:48.718140 15880 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.692301 15791 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:48.721587 15565 leader_election.cc:343] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.729038 15640 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:48.730496 15873 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.731868 15791 ts_tablet_manager.cc:1434] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:16:48.732890 15791 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.736958 15792 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.737540 15792 ts_tablet_manager.cc:1403] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.013s
I20260709 13:16:48.741904 15791 tablet_bootstrap.cc:654] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:48.744746 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:48.749454 15792 raft_consensus.cc:359] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.750015 15791 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.750216 15792 raft_consensus.cc:385] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.750510 15791 ts_tablet_manager.cc:1403] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:16:48.750485 15792 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.751291 15792 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.753458 15791 raft_consensus.cc:359] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.754153 15791 raft_consensus.cc:385] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.754422 15791 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.755048 15791 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.756480 15792 ts_tablet_manager.cc:1434] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:16:48.756963 15793 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:48.756292 15497 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.757488 15793 ts_tablet_manager.cc:1403] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.009s
I20260709 13:16:48.757659 15791 ts_tablet_manager.cc:1434] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:48.757812 15792 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.758600 15791 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.760879 15793 raft_consensus.cc:359] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.761564 15793 raft_consensus.cc:385] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.761837 15793 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.762480 15793 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.765100 15791 tablet_bootstrap.cc:654] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.766171 15498 catalog_manager.cc:5697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.768756 15980 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.769263 15980 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.772399 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.773088 15751 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:48.773587 15792 tablet_bootstrap.cc:654] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.774008 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.775873 15567 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:48.776450 15791 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.777009 15791 ts_tablet_manager.cc:1403] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:16:48.777328 15838 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.777763 15838 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.777730 15793 ts_tablet_manager.cc:1434] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:16:48.778997 15838 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.780169 15791 raft_consensus.cc:359] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.781005 15791 raft_consensus.cc:385] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.781283 15791 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.781982 15791 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.784315 15791 ts_tablet_manager.cc:1434] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
W20260709 13:16:48.778291 15565 leader_election.cc:343] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.785194 15872 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.785724 15872 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.785326 15791 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.789630 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.792097 15793 tablet_bootstrap.cc:492] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:48.792084 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:48.793001 15751 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:48.788136 15872 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.795008 15791 tablet_bootstrap.cc:654] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.798246 15980 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.800348 15933 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.803980 15933 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.797158 15792 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.805935 15793 tablet_bootstrap.cc:654] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.806471 15792 ts_tablet_manager.cc:1403] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.002s
I20260709 13:16:48.809514 15792 raft_consensus.cc:359] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.810325 15792 raft_consensus.cc:385] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.807497 15838 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.810636 15792 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.811444 15792 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.813720 15792 ts_tablet_manager.cc:1434] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:48.814543 15933 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.795202 15565 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.816879 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.817533 15673 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:48.819125 15933 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.821841 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:48.822925 15872 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:48.823307 15872 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:48.823645 15872 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.819547 15880 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.824848 15880 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.814695 15792 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.819617 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:48.821987 15838 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.832881 15880 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:16:48.834966 15565 leader_election.cc:343] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.837263 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:16:48.847523 15714 leader_election.cc:343] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.825901 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:16:48.855798 15567 leader_election.cc:343] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.861006 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:48.856428 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:16:48.866336 15714 leader_election.cc:343] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:48.866997 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.868337 15751 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.869025 15880 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.872591 15792 tablet_bootstrap.cc:654] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.878804 15791 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.879303 15791 ts_tablet_manager.cc:1403] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.094s	user 0.036s	sys 0.023s
I20260709 13:16:48.883890 15933 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:48.884372 15872 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.889065 15751 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:48.890085 15567 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:48.890285 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:48.891039 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:48.891186 15980 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.891625 15872 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:48.891777 15673 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.891857 15980 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:48.887034 15791 raft_consensus.cc:359] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.892658 15791 raft_consensus.cc:385] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.892943 15791 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.893242 15980 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.893802 15791 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.894631 15750 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.895974 15791 ts_tablet_manager.cc:1434] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:16:48.897050 15791 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.902642 15793 tablet_bootstrap.cc:492] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:48.903337 15793 ts_tablet_manager.cc:1403] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.111s	user 0.024s	sys 0.006s
I20260709 13:16:48.904908 15750 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:48.904253 15673 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:48.913918 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:48.916442 15793 raft_consensus.cc:359] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.917210 15791 tablet_bootstrap.cc:654] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.920951 15793 raft_consensus.cc:385] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.921903 15933 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:48.922430 15933 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:48.923358 15933 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.925566 15792 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:48.926055 15792 ts_tablet_manager.cc:1403] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.002s
I20260709 13:16:48.921341 15793 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.929590 15792 raft_consensus.cc:359] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.929797 15793 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.933995 15792 raft_consensus.cc:385] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.934345 15792 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.935060 15792 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.937366 15792 ts_tablet_manager.cc:1434] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:16:48.938261 15792 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:48.948228 15873 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.951681 15792 tablet_bootstrap.cc:654] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:48.961294 15873 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:48.964872 15791 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:48.965379 15791 ts_tablet_manager.cc:1403] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.004s
I20260709 13:16:48.967479 15498 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.968240 15791 raft_consensus.cc:359] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.972195 15791 raft_consensus.cc:385] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:48.972519 15791 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:48.972914 15498 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:48.973197 15791 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:48.974471 15676 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:48.984735 15791 ts_tablet_manager.cc:1434] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:16:48.985749 15791 tablet_bootstrap.cc:492] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:48.988565 15793 ts_tablet_manager.cc:1434] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.001s
I20260709 13:16:48.989622 15793 tablet_bootstrap.cc:492] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:48.998759 15791 tablet_bootstrap.cc:654] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.009853 15791 tablet_bootstrap.cc:492] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:49.010416 15791 ts_tablet_manager.cc:1403] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:16:49.011452 15882 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.011941 15882 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.014447 15882 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:49.017087 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:49.018008 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:49.018555 15714 leader_election.cc:343] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.020319 15980 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.019129 15791 raft_consensus.cc:359] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.020857 15791 raft_consensus.cc:385] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.020812 15980 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.021212 15791 raft_consensus.cc:740] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.021998 15791 consensus_queue.cc:260] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.023607 15980 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.023713 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.024154 15791 ts_tablet_manager.cc:1434] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:16:49.024384 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.025012 15748 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
W20260709 13:16:49.025447 15565 leader_election.cc:343] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:49.021169 15714 leader_election.cc:343] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.026132 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.026644 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.026976 15980 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.027479 15980 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.027576 15880 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.027916 15980 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.028899 15791 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:49.031805 16033 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.033082 15880 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.033568 15880 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.035718 15880 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:49.038371 15880 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.039379 15791 tablet_bootstrap.cc:654] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.042073 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.042508 15980 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.040704 15880 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.044942 15880 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:49.046757 15980 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.047814 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:49.048202 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:49.048739 15750 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.049531 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:16:49.050455 15714 leader_election.cc:343] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.053256 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.055141 15792 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:49.055454 15791 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:49.055608 15792 ts_tablet_manager.cc:1403] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.118s	user 0.032s	sys 0.014s
I20260709 13:16:49.056007 15791 ts_tablet_manager.cc:1403] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:16:49.056371 15793 tablet_bootstrap.cc:654] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.058638 15792 raft_consensus.cc:359] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.058974 15791 raft_consensus.cc:359] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.059590 15792 raft_consensus.cc:385] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.059847 15791 raft_consensus.cc:385] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.059983 15792 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.060400 15791 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
W20260709 13:16:49.060911 15565 leader_election.cc:343] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.060803 15792 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.061391 15791 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:49.062676 15714 leader_election.cc:343] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.063024 15792 ts_tablet_manager.cc:1434] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:16:49.063102 15714 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.063849 15882 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.064016 15792 tablet_bootstrap.cc:492] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
W20260709 13:16:49.064764 15714 leader_election.cc:343] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.067402 15750 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:49.068528 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.068933 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:49.070704 15980 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.071128 15792 tablet_bootstrap.cc:654] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.071209 15980 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:16:49.072317 15714 leader_election.cc:343] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.072212 15980 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.072799 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.073530 15880 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.076089 15793 tablet_bootstrap.cc:492] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:49.077343 15793 ts_tablet_manager.cc:1403] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.000s
I20260709 13:16:49.078526 15791 ts_tablet_manager.cc:1434] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:16:49.080289 15791 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:49.082391 15792 tablet_bootstrap.cc:492] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:49.082854 15792 ts_tablet_manager.cc:1403] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:16:49.080153 15793 raft_consensus.cc:359] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.084646 15793 raft_consensus.cc:385] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.085024 15793 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.089392 15793 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.097312 15833 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.097437 15792 raft_consensus.cc:359] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.099702 15980 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.100184 15980 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.101372 15676 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.102226 15980 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.103240 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.103685 15750 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:49.104630 15793 ts_tablet_manager.cc:1434] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:16:49.104678 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:49.105355 15791 tablet_bootstrap.cc:654] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.106119 15980 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.106485 15980 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.106837 15980 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.109562 15833 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.110056 15833 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.098188 15792 raft_consensus.cc:385] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.112874 15792 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.113034 15833 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.113407 15793 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:49.113493 15792 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.115567 15792 ts_tablet_manager.cc:1434] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:16:49.116503 15792 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:49.119688 15793 tablet_bootstrap.cc:654] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.122370 15792 tablet_bootstrap.cc:654] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.129803 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.130251 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.130995 15751 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:49.129794 15497 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.123960 15980 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.139397 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:49.140071 15751 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.150331 15980 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.151345 15751 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:49.152516 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:49.154240 15980 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.155051 15980 raft_consensus.cc:697] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:49.155900 15980 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.159251 15792 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:49.159843 15792 ts_tablet_manager.cc:1403] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.007s
I20260709 13:16:49.160694 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:49.163655 15792 raft_consensus.cc:359] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.164572 15792 raft_consensus.cc:385] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.157400 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:49.164927 15792 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.167308 15792 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.170341 15833 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.170892 15833 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.175395 15833 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.170423 15792 ts_tablet_manager.cc:1434] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 13:16:49.177867 15792 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:49.186468 15791 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:49.187091 15793 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:49.186946 15792 tablet_bootstrap.cc:654] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
W20260709 13:16:49.190496 15565 leader_election.cc:343] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.197703 15793 ts_tablet_manager.cc:1403] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.035s
I20260709 13:16:49.186996 15791 ts_tablet_manager.cc:1403] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.022s
I20260709 13:16:49.195699 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.201192 15793 raft_consensus.cc:359] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.201985 15793 raft_consensus.cc:385] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.201712 15791 raft_consensus.cc:359] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.202339 15793 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
W20260709 13:16:49.202631 15565 leader_election.cc:343] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.202481 15791 raft_consensus.cc:385] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.203255 15791 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.203312 15793 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.203855 15880 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.203996 15791 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.205809 15793 ts_tablet_manager.cc:1434] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:16:49.206348 15791 ts_tablet_manager.cc:1434] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:16:49.206907 15793 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:49.207245 15791 tablet_bootstrap.cc:492] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:49.209367 15792 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:49.209820 15792 ts_tablet_manager.cc:1403] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.001s
I20260709 13:16:49.213608 15791 tablet_bootstrap.cc:654] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.219362 15640 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:49.219686 15792 raft_consensus.cc:359] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.220709 15792 raft_consensus.cc:385] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.220790 15936 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.221014 15792 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.221805 15792 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.225073 15792 ts_tablet_manager.cc:1434] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.005s
I20260709 13:16:49.225606 15793 tablet_bootstrap.cc:654] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.226047 15792 tablet_bootstrap.cc:492] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:49.226752 15791 tablet_bootstrap.cc:492] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:49.227212 15791 ts_tablet_manager.cc:1403] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:16:49.229943 15936 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.230001 15791 raft_consensus.cc:359] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.231077 15791 raft_consensus.cc:385] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.231379 15791 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.232177 15791 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.233014 15792 tablet_bootstrap.cc:654] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.235401 15791 ts_tablet_manager.cc:1434] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:16:49.236843 15791 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:49.236977 15882 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.241840 15882 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.243862 15791 tablet_bootstrap.cc:654] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.243031 15500 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.253610 15791 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:49.254091 15791 ts_tablet_manager.cc:1403] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 13:16:49.254918 15792 tablet_bootstrap.cc:492] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:49.255367 15792 ts_tablet_manager.cc:1403] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:16:49.257208 15791 raft_consensus.cc:359] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.257927 15791 raft_consensus.cc:385] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.258294 15791 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.257989 15792 raft_consensus.cc:359] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.258705 15792 raft_consensus.cc:385] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.259236 15792 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.259933 15792 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.260823 15880 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.261377 15880 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.262125 15792 ts_tablet_manager.cc:1434] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:49.262524 15791 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.263033 15792 tablet_bootstrap.cc:492] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:49.264160 15791 ts_tablet_manager.cc:1434] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:16:49.265265 15791 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:49.265588 15933 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.266132 15933 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.264071 15880 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:49.269349 15933 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.271373 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.271920 15791 tablet_bootstrap.cc:654] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.272152 15750 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:49.278306 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.279716 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.273595 15933 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:49.281507 15714 leader_election.cc:343] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.281188 15933 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.282264 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:49.282493 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:49.283133 15601 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:49.283418 15933 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.285601 15792 tablet_bootstrap.cc:654] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.287742 15936 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.288928 15981 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.288266 15880 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:49.289363 15981 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.289108 15936 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.289788 15981 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.287748 15872 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.291028 15872 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.291575 15936 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.287351 15882 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.295403 15882 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.297397 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.299520 15882 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:16:49.300005 15567 leader_election.cc:343] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.303550 15981 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.308820 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.309787 15750 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:49.303838 15872 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.312465 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.314857 15750 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:49.317852 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:49.319360 15833 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.319768 15833 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.320030 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:49.324405 15714 leader_election.cc:343] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.330850 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:16:49.331535 15565 leader_election.cc:343] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.320117 15833 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.328336 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:49.346483 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:49.371119 15793 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:49.371881 15793 ts_tablet_manager.cc:1403] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.165s	user 0.021s	sys 0.008s
I20260709 13:16:49.375636 15980 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.376224 15980 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.381628 15602 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:49.382790 15981 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:16:49.380573 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 63760.1us
W20260709 13:16:49.392789 15714 leader_election.cc:343] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.393436 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.387028 15980 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.397964 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:49.398903 15750 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.400954 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.403335 15792 tablet_bootstrap.cc:492] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:49.403848 15792 ts_tablet_manager.cc:1403] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.141s	user 0.023s	sys 0.010s
I20260709 13:16:49.405359 15640 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:16:49.406298 15936 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:49.406690 15936 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:16:49.406667 15750 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:49.407228 15936 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.407050 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:49.423804 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:49.427878 15886 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.429386 15838 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.434312 15793 raft_consensus.cc:359] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.435370 15793 raft_consensus.cc:385] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.435722 15793 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.436946 15793 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:49.441154 15565 leader_election.cc:343] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.450028 15792 raft_consensus.cc:359] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.450222 15936 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.450822 15792 raft_consensus.cc:385] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.451098 15792 raft_consensus.cc:740] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.452221 15936 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.451676 15792 consensus_queue.cc:260] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:49.469365 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 44259.5us
I20260709 13:16:49.471123 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:16:49.475875 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 80184.8us
I20260709 13:16:49.476851 15792 ts_tablet_manager.cc:1434] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.001s
I20260709 13:16:49.473413 15936 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.480723 15714 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.476019 15872 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.484858 15872 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:49.479996 15936 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.485775 15872 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.487993 15936 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.500555 16081 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.502079 15833 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.534948 15791 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:49.535686 15791 ts_tablet_manager.cc:1403] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.271s	user 0.016s	sys 0.024s
I20260709 13:16:49.542388 15792 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:49.547324 15793 ts_tablet_manager.cc:1434] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.175s	user 0.017s	sys 0.020s
I20260709 13:16:49.548556 15793 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:49.547076 15675 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:49.560411 15838 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.561254 15672 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:49.558840 15882 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.561971 15882 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.563805 15833 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.564437 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.564282 15882 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:49.581822 15980 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.584336 15602 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:49.603055 15791 raft_consensus.cc:359] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.604072 15791 raft_consensus.cc:385] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.604400 15791 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.609090 15791 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:49.620966 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 79171.9us
W20260709 13:16:49.623672 15565 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:16:49.661396 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 155029us
I20260709 13:16:49.664309 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.652009 15981 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.692871 15981 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.721712 15791 ts_tablet_manager.cc:1434] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.186s	user 0.014s	sys 0.009s
I20260709 13:16:49.723001 16083 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.723539 16083 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.724184 15793 tablet_bootstrap.cc:654] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.725354 15791 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:49.725677 16083 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:49.726853 16083 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.727474 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:49.728026 15750 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:49.728215 15714 leader_election.cc:343] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.728966 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.729176 15886 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:49.729554 15749 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:49.730722 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:49.733094 15980 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.734751 16082 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:49.735131 16082 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:49.735965 16082 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.736400 15981 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.737190 16082 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:49.738284 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.727270 16083 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:49.739887 15714 leader_election.cc:343] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.741888 16083 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:49.742748 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.743000 15750 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
W20260709 13:16:49.744349 15714 leader_election.cc:343] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.748358 15791 tablet_bootstrap.cc:654] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.754540 15792 tablet_bootstrap.cc:654] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:49.762789 15793 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:49.763406 15793 ts_tablet_manager.cc:1403] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.215s	user 0.013s	sys 0.021s
I20260709 13:16:49.767396 15792 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:49.767987 15792 ts_tablet_manager.cc:1403] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.226s	user 0.007s	sys 0.004s
I20260709 13:16:49.767554 15793 raft_consensus.cc:359] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.768422 15793 raft_consensus.cc:385] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.768774 15793 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.769423 15793 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.769826 15791 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:49.770421 15791 ts_tablet_manager.cc:1403] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.002s
I20260709 13:16:49.770751 15792 raft_consensus.cc:359] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.771217 15793 ts_tablet_manager.cc:1434] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:49.771456 15792 raft_consensus.cc:385] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.771910 15792 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.772509 15792 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.773464 15791 raft_consensus.cc:359] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.774124 15791 raft_consensus.cc:385] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:49.774374 15791 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:49.821549 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:49.821910 15872 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:49.823760 15750 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:49.774938 15792 ts_tablet_manager.cc:1434] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 13:16:49.828641 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.829985 15748 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:49.835759 15793 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:49.837874 15873 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.839283 15873 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.844295 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:49.853772 15872 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.855338 15872 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.858489 15872 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:16:49.813340 15565 leader_election.cc:343] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:49.868023 15791 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.869275 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:49.873850 15873 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:16:49.879688 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 66651us
I20260709 13:16:49.881364 16085 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:49.885628 15792 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:49.880795 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:49.894899 16086 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:49.895823 16086 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:49.897876 16086 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.901351 15873 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.901854 15873 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.902281 15873 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.905490 15567 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:49.908524 16097 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:49.909204 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:49.910907 16085 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.911362 16085 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.911749 16085 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.917516 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.921181 15751 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:49.931553 15672 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.935667 15567 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:49.943799 16097 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:49.944258 16097 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.944671 16097 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:49.945232 15873 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.963732 15873 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.954496 15791 ts_tablet_manager.cc:1434] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.184s	user 0.009s	sys 0.000s
I20260709 13:16:49.978415 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.993494 15981 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.994134 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:49.995091 15981 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:49.995818 15746 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:49.997047 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:49.998193 15981 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:49.998981 15791 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:49.999549 15793 tablet_bootstrap.cc:654] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.000574 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:50.002575 15792 tablet_bootstrap.cc:654] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.003240 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:50.011998 16105 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:16:50.013345 15751 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.017449 16096 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.010054 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:49.987022 16097 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.018118 16096 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.023468 16091 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.024012 16091 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.021910 16105 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.024502 16091 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.031734 16096 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:50.033893 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:50.035365 15751 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:50.020277 15746 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:50.028046 16105 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:50.051031 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:50.053256 16105 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.058369 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:50.059442 15746 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:50.063190 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:50.065172 15980 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.065630 15980 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.065973 15980 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.066804 16097 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.073573 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.074851 15873 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.075930 15600 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
W20260709 13:16:50.077034 15714 leader_election.cc:343] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.076186 15873 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.081458 16091 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.095701 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:50.097194 15833 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.097867 15833 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:50.099062 15833 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.105250 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:50.106401 15600 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:50.107363 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:16:50.108712 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.114279 16092 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.119474 15873 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.126726 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:50.115144 16092 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.132385 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:50.135758 15600 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.132828 15792 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:50.138867 15792 ts_tablet_manager.cc:1403] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.266s	user 0.014s	sys 0.014s
I20260709 13:16:50.141306 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.144924 16092 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.129268 15497 catalog_manager.cc:5697] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.149883 15980 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.152839 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.155428 16091 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.165256 16081 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.123109 16085 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.158864 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:50.161299 15792 raft_consensus.cc:359] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.168155 15792 raft_consensus.cc:385] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.168807 15792 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.169075 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:50.169821 15750 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.171952 15599 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:50.171326 15746 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.172820 15791 tablet_bootstrap.cc:654] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.173830 15792 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.179144 15793 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:50.179884 15793 ts_tablet_manager.cc:1403] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.345s	user 0.031s	sys 0.021s
I20260709 13:16:50.183113 15980 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.182096 15598 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:50.187155 15600 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:50.192834 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.194059 15599 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:50.189378 16081 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.208787 16081 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:50.211480 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:50.219089 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:16:50.220542 15567 leader_election.cc:343] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.225915 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:50.228756 15714 leader_election.cc:343] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.225916 16104 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:16:50.229841 15793 raft_consensus.cc:359] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.232328 15793 raft_consensus.cc:385] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.232589 15793 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.233287 15793 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.239068 15792 ts_tablet_manager.cc:1434] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.100s	user 0.006s	sys 0.003s
I20260709 13:16:50.238540 15750 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:50.233450 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.236888 16085 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.250684 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:50.251226 15750 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.253861 15793 ts_tablet_manager.cc:1434] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.000s
I20260709 13:16:50.258682 15792 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:50.256793 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.267915 15793 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:50.259857 15567 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:50.272416 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.282634 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:50.287914 15640 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:50.288765 15873 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.289287 15791 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:50.289809 15791 ts_tablet_manager.cc:1403] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.292s	user 0.009s	sys 0.014s
I20260709 13:16:50.280108 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:50.290545 15675 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:50.295343 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:50.280982 16085 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.299340 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:50.302055 15933 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.304380 15565 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.305606 16085 raft_consensus.cc:697] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:50.305966 15933 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.305661 15793 tablet_bootstrap.cc:654] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.307340 16085 consensus_queue.cc:237] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.308341 15933 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:50.308838 15565 leader_election.cc:343] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.312554 15565 leader_election.cc:343] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.313658 16104 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:50.317485 15565 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.319916 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:50.320778 15565 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.321187 15676 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:50.322409 16104 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.322925 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:50.328629 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:16:50.329366 15565 leader_election.cc:343] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:50.330979 15565 leader_election.cc:343] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.331455 15565 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.333461 15746 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:50.339036 16081 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.339752 16081 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.340157 16081 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.343087 15750 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:50.345980 15791 raft_consensus.cc:359] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.346791 15791 raft_consensus.cc:385] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.347076 15791 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.347281 15567 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:50.347836 15791 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.354981 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.367985 15792 tablet_bootstrap.cc:654] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.369582 15933 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.371218 16105 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.377920 16105 raft_consensus.cc:697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:50.369719 15498 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.378947 16105 consensus_queue.cc:237] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.385586 15793 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:50.386083 15793 ts_tablet_manager.cc:1403] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.124s	user 0.012s	sys 0.002s
I20260709 13:16:50.386745 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.387562 15933 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.388911 15793 raft_consensus.cc:359] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.390203 15791 ts_tablet_manager.cc:1434] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.100s	user 0.000s	sys 0.008s
I20260709 13:16:50.389634 15793 raft_consensus.cc:385] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.391076 15791 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:50.391023 15793 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.391954 15793 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:50.392405 15565 leader_election.cc:343] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.394645 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.394279 15793 ts_tablet_manager.cc:1434] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:16:50.397377 15791 tablet_bootstrap.cc:654] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.396662 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:50.403527 15640 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:50.412318 15599 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 1: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:16:50.410993 16081 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.412994 16086 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.413545 15676 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.414083 16081 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:50.398474 16096 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:16:50.418056 15714 leader_election.cc:343] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.418550 15714 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.425127 16081 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.408931 15833 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:50.438316 15793 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
W20260709 13:16:50.464286 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 46273.2us
W20260709 13:16:50.465669 15714 leader_election.cc:343] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.466114 15714 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:16:50.468348 15714 leader_election.cc:343] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.469863 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.468626 16096 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.468020 16105 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:16:50.485015 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:50.487360 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:50.487730 15598 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.485373 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:50.491737 15873 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.523984 16130 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:50.528012 15793 tablet_bootstrap.cc:654] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.528769 15598 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:50.496690 15833 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:16:50.539494 15791 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:50.541679 15791 ts_tablet_manager.cc:1403] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.151s	user 0.009s	sys 0.005s
I20260709 13:16:50.555645 15873 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:50.562712 15792 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:50.563226 15792 ts_tablet_manager.cc:1403] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.310s	user 0.019s	sys 0.022s
I20260709 13:16:50.565991 15792 raft_consensus.cc:359] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.567373 15792 raft_consensus.cc:385] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.567747 15792 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.569711 15791 raft_consensus.cc:359] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.570672 15791 raft_consensus.cc:385] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.570955 15791 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
W20260709 13:16:50.574923 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 95268.2us
I20260709 13:16:50.577124 15792 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:50.580648 16132 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:50.575666 15873 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.596802 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:50.598223 16082 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.599006 16082 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:50.600272 16082 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:50.601347 15714 leader_election.cc:343] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.607985 15792 ts_tablet_manager.cc:1434] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:16:50.617815 16105 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.618362 16105 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.621994 15791 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.629020 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:50.629781 15748 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:50.631100 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:50.631886 15981 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.632266 15981 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.632633 15981 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.633153 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:50.634575 15792 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:50.647782 15791 ts_tablet_manager.cc:1434] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.002s
I20260709 13:16:50.620525 16105 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.650774 15833 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:50.652778 15793 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:50.655275 15793 ts_tablet_manager.cc:1403] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.227s	user 0.024s	sys 0.008s
W20260709 13:16:50.655355 15565 leader_election.cc:343] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.658550 15673 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.659926 15793 raft_consensus.cc:359] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.660689 15793 raft_consensus.cc:385] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.660969 15793 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.662811 15793 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.665019 15793 ts_tablet_manager.cc:1434] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:16:50.667040 15791 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:50.680866 15793 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:50.703904 16140 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.704207 15981 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.704545 16140 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.717159 15674 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.737588 15792 tablet_bootstrap.cc:654] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.745090 15498 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.750160 16140 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:50.750057 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:50.799022 15936 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.802598 16085 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:16:50.811359 15565 leader_election.cc:343] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.762969 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:50.829301 15714 leader_election.cc:343] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:50.795732 15497 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:50.815111 15565 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.832862 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.833561 15600 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:50.835897 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.836851 16129 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:50.837211 16129 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.837597 16129 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.836400 15497 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.854938 15981 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:50.861536 15793 tablet_bootstrap.cc:654] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.865075 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:50.866010 15745 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.895499 15981 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:50.898870 15791 tablet_bootstrap.cc:654] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.902094 15500 catalog_manager.cc:5697] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.912904 16129 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.928875 16129 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:50.915201 15745 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:50.917073 15793 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:50.930073 15793 ts_tablet_manager.cc:1403] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.256s	user 0.032s	sys 0.039s
I20260709 13:16:50.930562 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:50.909044 15792 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:50.931589 15792 ts_tablet_manager.cc:1403] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.299s	user 0.021s	sys 0.024s
I20260709 13:16:50.931797 16105 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.932269 16105 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:50.932724 15793 raft_consensus.cc:359] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:50.922956 15565 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.933351 16105 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.924844 16148 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.935499 16148 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.936715 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:50.934429 15792 raft_consensus.cc:359] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.917723 15500 catalog_manager.cc:5697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.935024 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:50.940852 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:50.941188 16148 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:50.941274 15600 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.942875 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:50.943522 15673 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:16:50.933470 15793 raft_consensus.cc:385] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.945113 15793 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.945751 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:50.945778 15793 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.947855 15674 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:50.948256 15793 ts_tablet_manager.cc:1434] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:16:50.949244 15793 tablet_bootstrap.cc:492] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:50.951907 16148 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:50.952308 16148 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.952666 16148 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:50.957199 15793 tablet_bootstrap.cc:654] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:50.926044 15791 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:50.960078 15791 ts_tablet_manager.cc:1403] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.305s	user 0.013s	sys 0.007s
I20260709 13:16:50.962836 15791 raft_consensus.cc:359] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.948657 15600 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:50.982689 15791 raft_consensus.cc:385] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.983453 15791 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.984586 15791 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.985889 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:50.986295 15791 ts_tablet_manager.cc:1434] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.002s
I20260709 13:16:50.986680 16129 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:50.987226 16129 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:50.987426 15791 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:50.988058 16129 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.937775 15792 raft_consensus.cc:385] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.989248 15792 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.989948 15792 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.992202 15792 ts_tablet_manager.cc:1434] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.000s
I20260709 13:16:50.993371 15792 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:50.988478 15674 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:50.968673 15793 tablet_bootstrap.cc:492] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:50.994556 15793 ts_tablet_manager.cc:1403] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.003s
I20260709 13:16:50.997470 15793 raft_consensus.cc:359] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.998212 15793 raft_consensus.cc:385] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:50.998499 15793 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:50.999197 15793 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:50.999692 15792 tablet_bootstrap.cc:654] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.001353 15936 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.001575 15793 ts_tablet_manager.cc:1434] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:51.001849 15936 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.002628 15793 tablet_bootstrap.cc:492] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:51.004139 15936 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.005898 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:51.006318 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:51.008512 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:51.010161 16091 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.012019 15500 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.013274 15793 tablet_bootstrap.cc:654] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.008512 16148 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.021067 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:51.021505 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:51.021694 15674 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:51.027005 15791 tablet_bootstrap.cc:654] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.028659 15674 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:16:51.028023 15498 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.039459 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:51.040299 16129 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:51.040762 16129 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:51.041584 16129 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.046391 16148 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:51.047124 15791 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:51.047678 15791 ts_tablet_manager.cc:1403] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.005s
I20260709 13:16:51.059060 15793 tablet_bootstrap.cc:492] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:51.056453 15791 raft_consensus.cc:359] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.060786 15791 raft_consensus.cc:385] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.061103 15791 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.061877 15791 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.064097 15791 ts_tablet_manager.cc:1434] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:16:51.059657 15793 ts_tablet_manager.cc:1403] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.017s
I20260709 13:16:51.067354 15793 raft_consensus.cc:359] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.067998 15793 raft_consensus.cc:385] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.068260 15793 raft_consensus.cc:740] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.068858 15793 consensus_queue.cc:260] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.074661 15791 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:51.077302 15793 ts_tablet_manager.cc:1434] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:16:51.078410 15793 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:51.080242 15936 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.081099 15500 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.086777 16148 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.087865 16148 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.089095 15791 tablet_bootstrap.cc:654] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.092530 16148 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:51.096125 15793 tablet_bootstrap.cc:654] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.096202 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:51.100319 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:16:51.100636 15714 leader_election.cc:343] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.103269 15714 leader_election.cc:343] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.103719 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:51.104470 16129 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.109946 15792 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:51.113600 15792 ts_tablet_manager.cc:1403] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.121s	user 0.012s	sys 0.003s
I20260709 13:16:51.116714 15792 raft_consensus.cc:359] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.117375 15792 raft_consensus.cc:385] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.117626 15792 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.145236 15873 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.165797 15793 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:51.166220 15793 ts_tablet_manager.cc:1403] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.009s
I20260709 13:16:51.169353 15791 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:51.168880 15792 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.169798 15791 ts_tablet_manager.cc:1403] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.095s	user 0.014s	sys 0.019s
I20260709 13:16:51.170907 15793 raft_consensus.cc:359] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.175989 15793 raft_consensus.cc:385] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.176286 15793 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.176916 15793 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.177148 15791 raft_consensus.cc:359] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.177807 15791 raft_consensus.cc:385] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.178074 15791 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.179044 15793 ts_tablet_manager.cc:1434] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:16:51.178776 15791 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.180032 15793 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:51.182255 15791 ts_tablet_manager.cc:1434] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:16:51.183842 15791 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:51.171833 15792 ts_tablet_manager.cc:1434] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.002s
I20260709 13:16:51.185563 15792 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:51.190886 16129 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.191576 16129 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.193240 15873 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.193712 15873 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:51.199991 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:51.200241 16129 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:51.231259 15793 tablet_bootstrap.cc:654] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.218560 15873 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.231688 15791 tablet_bootstrap.cc:654] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.230581 15792 tablet_bootstrap.cc:654] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.221204 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:51.236089 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:51.236750 15600 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:51.236966 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:51.237800 15640 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:51.242487 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:51.243695 15748 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:51.244129 15833 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.244696 15833 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.245141 15833 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.254701 15833 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:51.261080 15714 leader_election.cc:343] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.261669 15793 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:51.263826 15793 ts_tablet_manager.cc:1403] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.007s
I20260709 13:16:51.265704 15674 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:51.269448 15714 leader_election.cc:343] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.270165 15714 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:51.271202 16129 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.271508 15793 raft_consensus.cc:359] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.272156 15793 raft_consensus.cc:385] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.272441 15793 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
W20260709 13:16:51.272956 15714 consensus_peers.cc:597] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:51.275650 15792 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:51.276114 15792 ts_tablet_manager.cc:1403] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.009s
I20260709 13:16:51.278564 15792 raft_consensus.cc:359] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.279294 15792 raft_consensus.cc:385] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.279553 15792 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.273797 15793 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.281541 16105 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.282027 15791 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:51.282027 16105 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.282639 15791 ts_tablet_manager.cc:1403] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.040s
I20260709 13:16:51.282689 15793 ts_tablet_manager.cc:1434] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:16:51.283885 15793 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:51.280148 15792 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.285126 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:16:51.286451 15567 leader_election.cc:343] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.286926 16105 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.287149 15792 ts_tablet_manager.cc:1434] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:16:51.288010 15791 raft_consensus.cc:359] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.289026 15791 raft_consensus.cc:385] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.289812 15793 tablet_bootstrap.cc:654] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.298568 15833 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.298663 15791 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.289906 15792 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:51.290791 16129 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:16:51.300788 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:51.303687 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:51.304301 15745 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.305477 15791 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.309139 15791 ts_tablet_manager.cc:1434] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.005s
I20260709 13:16:51.311810 15791 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
W20260709 13:16:51.311873 15565 leader_election.cc:343] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.312351 15565 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:51.312880 15792 tablet_bootstrap.cc:654] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.313663 16129 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.315192 16129 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.314378 15933 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.325037 16129 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:51.325987 16138 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.332872 16138 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.328572 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:51.338539 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:16:51.342545 15714 leader_election.cc:343] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.347711 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:51.348690 15602 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.352850 15872 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:51.363639 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:51.364964 15745 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:51.366590 16138 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.372407 16138 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.372920 16138 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.374920 16138 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.375306 15793 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:51.375749 15793 ts_tablet_manager.cc:1403] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.092s	user 0.034s	sys 0.018s
I20260709 13:16:51.375840 15791 tablet_bootstrap.cc:654] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.368743 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:16:51.379662 15714 leader_election.cc:343] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.380115 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:51.386641 16140 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.388247 15793 raft_consensus.cc:359] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.389007 15793 raft_consensus.cc:385] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.389285 15793 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.379347 16138 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.403043 16138 raft_consensus.cc:697] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:51.409293 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:16:51.411764 16174 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:51.404256 16138 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.415091 15872 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.415668 15872 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.420146 15872 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.404228 15602 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:51.417449 15793 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.424866 15793 ts_tablet_manager.cc:1434] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 13:16:51.427774 15792 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:51.428449 15792 ts_tablet_manager.cc:1403] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.014s
I20260709 13:16:51.433691 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:51.434376 15747 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:51.436582 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:51.437676 15872 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.438105 15872 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.438484 15872 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.427595 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:51.449990 15792 raft_consensus.cc:359] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.451045 15792 raft_consensus.cc:385] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.451403 15792 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.452230 15792 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.470490 15792 ts_tablet_manager.cc:1434] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
W20260709 13:16:51.471413 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 91774.5us
I20260709 13:16:51.473644 15791 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:51.474143 15791 ts_tablet_manager.cc:1403] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.007s
I20260709 13:16:51.477291 15793 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:51.478931 15792 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:51.481431 16148 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:51.482705 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:51.485482 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:51.486057 15673 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.497171 15872 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:51.499236 15565 leader_election.cc:343] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.507114 15791 raft_consensus.cc:359] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.507886 15791 raft_consensus.cc:385] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.508169 15791 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.508477 15674 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:51.509065 15872 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.508610 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:51.509761 15873 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.510114 15748 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.510193 15873 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.512559 15791 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.516059 15873 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.517177 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:51.517911 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:51.519061 15642 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:51.520968 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:51.521638 15750 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:51.516294 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:51.526209 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:51.527077 15833 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.527421 15833 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.527725 15833 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:16:51.528416 15565 leader_election.cc:343] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:51.529582 15640 leader_election.cc:343] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.535465 16148 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.522933 16138 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.574958 15791 ts_tablet_manager.cc:1434] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.016s
I20260709 13:16:51.620368 15791 tablet_bootstrap.cc:492] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:51.599953 16177 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.602933 15672 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.644523 15792 tablet_bootstrap.cc:654] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.626263 16177 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.649535 15833 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.647284 15936 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:51.658331 15833 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.660321 15793 tablet_bootstrap.cc:654] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.560698 15498 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:51.674983 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:16:51.676538 15640 leader_election.cc:343] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.685906 16177 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:51.688505 15838 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:16:51.689045 15838 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.690929 15838 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.691510 15602 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:51.692521 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:51.699368 15602 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:51.716869 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 52139.7us
I20260709 13:16:51.722332 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:51.722919 15751 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.736312 15751 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:51.738485 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:51.733551 15748 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:51.797502 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:51.799638 15933 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.800102 15933 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:51.800911 15933 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.793298 15596 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:51.822975 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:51.824851 15873 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:51.825255 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:51.825627 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:51.826013 15676 raft_consensus.cc:2368] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3.
I20260709 13:16:51.825310 15873 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:51.828274 15873 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.830006 15792 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:51.830451 15792 ts_tablet_manager.cc:1403] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.352s	user 0.043s	sys 0.042s
I20260709 13:16:51.833463 15792 raft_consensus.cc:359] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.834151 15792 raft_consensus.cc:385] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.834151 15872 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:51.834640 15792 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.835264 15792 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.838037 15792 ts_tablet_manager.cc:1434] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:16:51.839962 15792 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:51.841048 15793 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:51.841683 15793 ts_tablet_manager.cc:1403] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.365s	user 0.046s	sys 0.022s
I20260709 13:16:51.850683 15792 tablet_bootstrap.cc:654] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.856264 15565 leader_election.cc:400] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3.
I20260709 13:16:51.856662 15565 leader_election.cc:403] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.860000 16105 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3.
I20260709 13:16:51.868322 15793 raft_consensus.cc:359] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.869256 15793 raft_consensus.cc:385] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:51.869619 15793 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:51.871201 15793 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.871688 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:51.886746 16140 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:51.887348 16140 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.887765 16140 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:51.902747 15791 tablet_bootstrap.cc:654] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:51.906790 16140 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.910429 16177 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:51.922519 16140 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:51.873955 16148 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 13:16:51.927480 16096 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.928135 16096 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.930757 16096 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:51.934595 15793 ts_tablet_manager.cc:1434] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
I20260709 13:16:51.936058 15793 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:51.936843 16105 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.937493 16105 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.940119 16105 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:51.970710 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:16:51.974985 15567 leader_election.cc:343] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:51.984793 16188 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.985522 16188 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:51.988307 16188 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:52.010617 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:16:52.018690 15565 leader_election.cc:343] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.019698 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:52.061022 15565 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.042906 15793 tablet_bootstrap.cc:654] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.047047 15792 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:52.062183 15838 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.063133 15792 ts_tablet_manager.cc:1403] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.223s	user 0.065s	sys 0.050s
W20260709 13:16:52.064755 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 46094.9us
I20260709 13:16:52.072733 16091 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.078720 15933 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.084887 15933 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.094192 15792 raft_consensus.cc:359] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.095263 15792 raft_consensus.cc:385] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.095671 15792 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.085275 15497 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.102355 15792 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.102780 15933 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:52.105474 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:16:52.108376 15567 leader_election.cc:343] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.112136 15792 ts_tablet_manager.cc:1434] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:16:52.116061 15793 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:52.116881 15793 ts_tablet_manager.cc:1403] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.181s	user 0.017s	sys 0.001s
I20260709 13:16:52.119956 15792 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:52.121412 15791 tablet_bootstrap.cc:492] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:52.121778 15791 ts_tablet_manager.cc:1403] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.528s	user 0.012s	sys 0.020s
W20260709 13:16:52.136432 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 250181us
W20260709 13:16:52.141649 15640 leader_election.cc:343] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.153653 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:52.153990 15792 tablet_bootstrap.cc:654] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.161337 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:52.163372 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:52.170483 15872 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.171007 15872 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.173038 15872 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:16:52.173009 15714 leader_election.cc:343] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.178828 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:52.179936 15748 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 1: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:16:52.181946 15791 raft_consensus.cc:359] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.182686 15791 raft_consensus.cc:385] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.182948 15791 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.183604 15791 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.185721 15791 ts_tablet_manager.cc:1434] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 13:16:52.186626 15791 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:52.193004 15791 tablet_bootstrap.cc:654] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.194530 15793 raft_consensus.cc:359] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.196873 15793 raft_consensus.cc:385] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.197248 15793 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.197527 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:52.198048 15793 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.202633 15793 ts_tablet_manager.cc:1434] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.085s	user 0.013s	sys 0.007s
I20260709 13:16:52.203833 15793 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:52.201777 15498 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.211086 15793 tablet_bootstrap.cc:654] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.215665 15791 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:52.216185 15791 ts_tablet_manager.cc:1403] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:16:52.218436 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:52.219034 15597 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.220999 15792 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:52.221462 15792 ts_tablet_manager.cc:1403] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.102s	user 0.021s	sys 0.002s
I20260709 13:16:52.225080 15792 raft_consensus.cc:359] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.225879 15792 raft_consensus.cc:385] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.226367 15792 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.227368 15597 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:52.219058 15791 raft_consensus.cc:359] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.228065 15791 raft_consensus.cc:385] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.228502 15791 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.229475 15791 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.232617 15791 ts_tablet_manager.cc:1434] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:16:52.234911 15791 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Bootstrap starting.
I20260709 13:16:52.227278 15792 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.237375 15792 ts_tablet_manager.cc:1434] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:16:52.237725 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:52.238751 15792 tablet_bootstrap.cc:492] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
W20260709 13:16:52.239632 15714 leader_election.cc:343] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:52.241298 15714 leader_election.cc:343] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:16:52.251019 15565 leader_election.cc:343] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.251667 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.252880 15872 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.256829 16148 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.257402 16148 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.260828 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.264390 15793 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:52.265205 15793 ts_tablet_manager.cc:1403] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.011s
I20260709 13:16:52.265472 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:52.266187 15748 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 0.
I20260709 13:16:52.269062 15793 raft_consensus.cc:359] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.270870 15793 raft_consensus.cc:385] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.271220 15793 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.271986 15793 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.274962 15838 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.280717 15792 tablet_bootstrap.cc:654] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.290252 15872 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.290747 15872 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:52.309501 15777 tablet.cc:2406] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:16:52.311069 15791 tablet_bootstrap.cc:654] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.313879 15872 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:52.308225 15793 ts_tablet_manager.cc:1434] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 13:16:52.335608 16148 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:52.336387 16189 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.340113 15642 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:16:52.343375 15548 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:16:52.344511 15838 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.352645 15793 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:52.345247 15936 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.355391 15936 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.355788 15936 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.358467 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:52.359222 15745 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
I20260709 13:16:52.363070 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:52.363876 15872 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.364244 15872 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.364565 15872 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.364487 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.367122 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:52.367821 15596 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:52.373382 16182 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.373948 16182 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:16:52.375057 15714 leader_election.cc:343] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.375519 15714 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.368077 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:52.386855 15872 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:52.387583 15565 leader_election.cc:343] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.381623 16196 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:52.374733 16182 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.406100 15872 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:52.407792 15676 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.420782 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:52.422312 15936 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.422664 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:52.423548 15746 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.426401 15936 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:16:52.428977 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50626.9us
I20260709 13:16:52.430047 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:52.430629 15602 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.431020 16188 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.431361 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:52.432269 16182 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.417920 16105 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:16:52.432664 16182 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.433105 16182 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.433377 16140 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.428205 15565 leader_election.cc:343] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.453996 15791 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: No bootstrap required, opened a new log
I20260709 13:16:52.454586 15791 ts_tablet_manager.cc:1403] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Time spent bootstrapping tablet: real 0.220s	user 0.010s	sys 0.005s
I20260709 13:16:52.459870 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:52.460506 15751 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.433845 16140 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.462560 15602 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:52.468458 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:52.469412 15936 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.469853 15936 raft_consensus.cc:697] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:16:52.470611 15936 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.471217 15833 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.494837 15792 tablet_bootstrap.cc:492] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:52.495419 15792 ts_tablet_manager.cc:1403] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.257s	user 0.021s	sys 0.007s
I20260709 13:16:52.503293 15872 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:52.505407 16188 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.508777 15751 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:16:52.505925 16188 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.485041 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:52.518973 15673 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:52.521706 15793 tablet_bootstrap.cc:654] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.528514 15791 raft_consensus.cc:359] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.530253 15791 raft_consensus.cc:385] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.530656 15791 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.534055 16188 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:52.536027 15791 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.541945 15791 ts_tablet_manager.cc:1434] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Time spent starting tablet: real 0.087s	user 0.002s	sys 0.008s
I20260709 13:16:52.535359 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:52.534089 16140 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:52.554847 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:52.570039 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:52.573418 15792 raft_consensus.cc:359] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.574353 15792 raft_consensus.cc:385] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.574672 15792 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.575438 15792 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.556309 15746 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:52.592757 15792 ts_tablet_manager.cc:1434] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260709 13:16:52.602993 15642 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:52.603981 15792 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
W20260709 13:16:52.609208 15714 leader_election.cc:343] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.617275 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:52.618141 15602 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:52.625135 16182 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.627717 16182 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:52.639515 15497 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.645498 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.653756 15793 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:52.654296 15793 ts_tablet_manager.cc:1403] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.303s	user 0.016s	sys 0.002s
I20260709 13:16:52.657330 15933 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.657805 15933 raft_consensus.cc:697] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:52.662048 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:52.662688 15675 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.663208 16188 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:52.658514 15933 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.674190 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.674937 16177 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.675307 16177 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.675659 16177 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.677080 15793 raft_consensus.cc:359] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.677749 15793 raft_consensus.cc:385] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.677970 15793 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.678577 15793 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.689625 15792 tablet_bootstrap.cc:654] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.692816 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:52.693487 15597 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.694380 15793 ts_tablet_manager.cc:1434] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 13:16:52.695583 15793 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:52.706681 16177 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.709192 16177 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:52.724406 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:52.725095 15599 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.722615 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:52.739625 15498 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:52.741261 15714 leader_election.cc:343] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:52.740742 15599 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:52.744746 15597 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:52.744793 15675 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:52.752588 15793 tablet_bootstrap.cc:654] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.773442 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:52.774315 16177 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.774811 16177 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:52.775560 16177 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.780640 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:52.783898 16129 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:52.784466 15792 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:52.784425 16129 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:52.784993 15792 ts_tablet_manager.cc:1403] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.181s	user 0.025s	sys 0.014s
I20260709 13:16:52.786243 16129 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.790292 15792 raft_consensus.cc:359] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.791548 15792 raft_consensus.cc:385] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.791863 15792 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.793200 15792 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.795994 15792 ts_tablet_manager.cc:1434] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:16:52.807957 15792 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:52.823928 15793 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:52.832681 15792 tablet_bootstrap.cc:654] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.824460 15793 ts_tablet_manager.cc:1403] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.129s	user 0.029s	sys 0.024s
I20260709 13:16:52.834847 15675 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.843529 16129 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.844256 15793 raft_consensus.cc:359] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.845847 15498 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:52.845115 15793 raft_consensus.cc:385] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.847422 15793 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.848280 15793 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.850919 15793 ts_tablet_manager.cc:1434] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:16:52.851954 15793 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:52.863926 15793 tablet_bootstrap.cc:654] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.878176 16129 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.885197 15793 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:52.886214 15793 ts_tablet_manager.cc:1403] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 13:16:52.888543 15792 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:52.889081 15792 ts_tablet_manager.cc:1403] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.003s
I20260709 13:16:52.892230 15793 raft_consensus.cc:359] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.893115 15793 raft_consensus.cc:385] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.893452 15793 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.895514 15793 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.898267 15793 ts_tablet_manager.cc:1434] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:16:52.899556 15793 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:52.899341 15792 raft_consensus.cc:359] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.900096 15792 raft_consensus.cc:385] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.900377 15792 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.900988 15792 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.903420 15792 ts_tablet_manager.cc:1434] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:16:52.904489 15792 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Bootstrap starting.
I20260709 13:16:52.910768 15792 tablet_bootstrap.cc:654] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.906405 15497 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.912752 15497 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.915861 15793 tablet_bootstrap.cc:654] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.933568 15793 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:52.934010 15793 ts_tablet_manager.cc:1403] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.004s
I20260709 13:16:52.938457 15793 raft_consensus.cc:359] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.939105 15793 raft_consensus.cc:385] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.939390 15793 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.942014 15793 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.944532 15793 ts_tablet_manager.cc:1434] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:16:52.952306 15873 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.958950 16129 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.959447 16129 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.963542 15793 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:52.965075 15792 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: No bootstrap required, opened a new log
I20260709 13:16:52.965672 15792 ts_tablet_manager.cc:1403] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.005s
I20260709 13:16:52.966572 15873 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:52.966724 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:52.967401 15597 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:52.968626 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:52.969385 16177 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:52.969729 16177 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.970070 15793 tablet_bootstrap.cc:654] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:52.970460 16129 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:52.970046 16177 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:52.971911 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:52.972581 15673 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:52.977911 15792 raft_consensus.cc:359] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:52.986867 15792 raft_consensus.cc:385] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:52.987622 15792 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Initialized, Role: FOLLOWER
I20260709 13:16:52.988658 15792 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.005976 15792 ts_tablet_manager.cc:1434] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.000s
I20260709 13:16:53.004303 16177 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.019055 16177 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:53.025465 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:53.026152 15675 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.028257 15793 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:53.028838 15793 ts_tablet_manager.cc:1403] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.024s
I20260709 13:16:53.031592 15793 raft_consensus.cc:359] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.032366 15793 raft_consensus.cc:385] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.032735 15793 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.033423 15793 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.037518 15793 ts_tablet_manager.cc:1434] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:16:53.042435 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:53.043072 15597 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.046540 15673 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.052915 15597 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:53.056434 15793 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:53.057212 15675 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:53.060000 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:53.062619 16177 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.063112 16177 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:53.063925 16177 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:16:53.090628 15565 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:53.093981 15981 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.094470 15981 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.098626 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:53.075167 15793 tablet_bootstrap.cc:654] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.096419 15981 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:53.105893 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:53.106493 15750 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 0.
W20260709 13:16:53.107520 15565 leader_election.cc:343] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:16:53.115516 15567 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:16:53.117388 15872 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.120004 15872 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.123958 15872 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.122412 15500 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.132257 15793 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:53.132799 15793 ts_tablet_manager.cc:1403] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.002s
I20260709 13:16:53.136185 15793 raft_consensus.cc:359] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.136888 15793 raft_consensus.cc:385] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.137132 15793 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.137434 15872 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.137760 15793 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.139735 15793 ts_tablet_manager.cc:1434] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:16:53.139794 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:53.140151 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:16:53.140388 15673 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.140341 15872 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:53.140797 15746 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.142108 15793 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:53.146914 15673 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:53.147847 16177 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.147936 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:53.148423 16177 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.149168 15872 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.149595 15872 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:16:53.150310 15872 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.151081 15746 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:16:53.152091 16177 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:53.148038 15793 tablet_bootstrap.cc:654] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.153606 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:53.154223 15597 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:53.156451 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:53.156785 16224 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.157053 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:53.157398 16177 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.157917 16177 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.158349 16177 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.157708 15673 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:53.169492 16177 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.170974 15793 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:53.171464 15793 ts_tablet_manager.cc:1403] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:16:53.172086 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:53.172698 15597 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.174506 15793 raft_consensus.cc:359] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.175209 15793 raft_consensus.cc:385] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.175479 15793 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.174800 15497 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:53.176123 15793 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.178251 15793 ts_tablet_manager.cc:1434] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:16:53.179704 15597 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:53.181003 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:53.181880 16129 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.182339 16129 raft_consensus.cc:697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:53.183046 16177 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:53.183158 16129 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.184417 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:53.184990 15673 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.188068 15793 tablet_bootstrap.cc:492] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: Bootstrap starting.
I20260709 13:16:53.198505 15673 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
W20260709 13:16:53.200637 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:53.203924 15793 tablet_bootstrap.cc:654] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: Neither blocks nor log segments found. Creating new log.
I20260709 13:16:53.227650 16182 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.228884 15793 tablet_bootstrap.cc:492] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: No bootstrap required, opened a new log
I20260709 13:16:53.229389 15793 ts_tablet_manager.cc:1403] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.011s
I20260709 13:16:53.232044 15793 raft_consensus.cc:359] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.232757 15793 raft_consensus.cc:385] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:16:53.233031 15793 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Initialized, Role: FOLLOWER
I20260709 13:16:53.233523 16217 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.233785 15793 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.235948 15793 ts_tablet_manager.cc:1434] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:53.243966 15497 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.252493 16182 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.268080 16177 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.268570 16177 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.270509 16177 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:53.273991 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:53.274408 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:16:53.274653 15601 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:53.274981 15673 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 0.
I20260709 13:16:53.278666 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:16:53.280293 16177 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:16:53.280759 16177 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.281195 16177 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.287277 16177 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.289302 16177 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:53.290222 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:16:53.290246 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:16:53.290982 15673 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.290940 15601 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.297353 15673 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:53.297528 15601 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:16:53.298717 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:16:53.299360 16217 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:16:53.299788 16217 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:16:53.300534 16217 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.311476 15497 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:53.460870 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:16:53.469367 16253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:53.469683 16254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:16:53.471343 16256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:16:53.472316 14501 server_base.cc:1061] running on GCE node
I20260709 13:16:53.474017 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:16:53.474241 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:16:53.474490 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603013474469 us; error 0 us; skew 500 ppm
I20260709 13:16:53.474817 15873 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.475258 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:16:53.475281 15873 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:16:53.478436 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:16:53.478897 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:16:53.479446 14501 webserver.cc:533] Webserver started at http://127.14.41.68:43847/ using document root <none> and password file <none>
I20260709 13:16:53.477246 15873 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:53.480232 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:16:53.480302 15640 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:16:53.480835 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:16:53.481344 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:16:53.481257 15873 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:16:53.482787 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-3-root/instance:
uuid: "398beb97ee4b40688f6279f18fa51ade"
format_stamp: "Formatted at 2026-07-09 13:16:53 on dist-test-slave-56lb"
I20260709 13:16:53.489418 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:16:53.495836 15675 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.515172 16261 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:53.516639 14501 fs_manager.cc:730] Time spent opening block manager: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:16:53.517066 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-3-root
uuid: "398beb97ee4b40688f6279f18fa51ade"
format_stamp: "Formatted at 2026-07-09 13:16:53 on dist-test-slave-56lb"
I20260709 13:16:53.517506 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:16:53.575628 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:16:53.577083 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:16:53.578678 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:16:53.581213 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:16:53.581427 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:53.581719 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:16:53.581900 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:16:53.595702 16177 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.608954 15933 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.623801 16182 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.693813 16148 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.722826 15933 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.724184 15671 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:16:53.807466 16148 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:16:53.822665 16290 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.835894 16148 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:16:53.905292 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.68:46739
I20260709 13:16:53.905395 16334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.68:46739 every 8 connection(s)
I20260709 13:16:53.910665 14501 auto_leader_rebalancer-test.cc:384] add a tserver: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:53.929039 16335 heartbeater.cc:344] Connected to a master server at 127.14.41.126:40467
I20260709 13:16:53.929497 16335 heartbeater.cc:461] Registering TS with master...
I20260709 13:16:53.930364 16335 heartbeater.cc:507] Master 127.14.41.126:40467 requested a full tablet report, sending...
I20260709 13:16:53.932588 15500 ts_manager.cc:194] Registered new tserver with Master: 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:16:53.934475 15500 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37366
I20260709 13:16:54.476445 15601 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:54.483785 15746 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:54.486122 15981 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:54.486685 15673 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:54.488207 15933 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:54.496085 16339 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.498601 15671 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.512029 15746 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.516808 15500 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:16:54.524950 15567 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c0bf08b91c244659abe8cb87e64f8cd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.552481 15673 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:54.561885 15601 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:54.563175 16353 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:54.565280 15746 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:54.572821 15873 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.579531 15601 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.590910 16353 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:54.590696 15673 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:16:54.606357 15642 consensus_peers.cc:597] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6a774e81f58442c90fd80ad59687b99. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.599354 15498 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.606899 15750 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:54.609542 15746 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.612165 16356 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:16:54.614488 15642 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9fa9cf9412ae412a8756d1fc1138ddce. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.616482 15597 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:54.618261 15873 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:54.647493 15873 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.656231 15601 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.667650 15673 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:54.673503 15497 catalog_manager.cc:5697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:54.674798 15750 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.676730 15601 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:54.676748 15642 consensus_peers.cc:597] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b90fe6b2a274b68b50cf564b626c03e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:54.679220 15873 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:54.679543 15748 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:54.682425 16353 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:54.697260 16353 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.702889 15748 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.705576 15599 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.723064 15500 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:54.934583 16364 ts_tablet_manager.cc:933] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:16:54.936540 16364 tablet_copy_client.cc:323] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:16:54.937206 16335 heartbeater.cc:499] Master 127.14.41.126:40467 was elected leader, sending a full tablet report...
I20260709 13:16:54.952251 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet 8c0bf08b91c244659abe8cb87e64f8cd from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:16:54.952944 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet 8c0bf08b91c244659abe8cb87e64f8cd from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-8c0bf08b91c244659abe8cb87e64f8cd
I20260709 13:16:54.959033 15612 tablet_copy_source_session.cc:215] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:54.962742 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c0bf08b91c244659abe8cb87e64f8cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:54.979133 16364 tablet_copy_client.cc:806] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:54.979826 16364 tablet_copy_client.cc:670] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:54.984790 16364 tablet_copy_client.cc:538] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:54.988456 16367 ts_tablet_manager.cc:933] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:54.994501 16364 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:55.011646 16367 tablet_copy_client.cc:323] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:16:55.028791 16364 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:55.029850 16364 tablet_bootstrap.cc:492] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:55.030519 16364 ts_tablet_manager.cc:1403] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.006s
I20260709 13:16:55.033536 16364 raft_consensus.cc:359] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.034399 16364 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:55.035017 16364 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.042521 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet f6a774e81f58442c90fd80ad59687b99 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:16:55.043196 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet f6a774e81f58442c90fd80ad59687b99 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-f6a774e81f58442c90fd80ad59687b99
I20260709 13:16:55.044837 16364 ts_tablet_manager.cc:1434] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.004s
I20260709 13:16:55.051501 15687 tablet_copy_source_session.cc:215] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:55.057607 16367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a774e81f58442c90fd80ad59687b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:55.060420 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-8c0bf08b91c244659abe8cb87e64f8cd received from {username='slave'} at 127.0.0.1:34574
I20260709 13:16:55.061029 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-8c0bf08b91c244659abe8cb87e64f8cd on tablet 8c0bf08b91c244659abe8cb87e64f8cd with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:55.062449 16370 ts_tablet_manager.cc:933] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:55.065516 16370 tablet_copy_client.cc:323] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:16:55.067379 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet 9fa9cf9412ae412a8756d1fc1138ddce from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:16:55.068002 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet 9fa9cf9412ae412a8756d1fc1138ddce from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-9fa9cf9412ae412a8756d1fc1138ddce
I20260709 13:16:55.076380 15687 tablet_copy_source_session.cc:215] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:55.081456 16367 tablet_copy_client.cc:806] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:55.082083 16367 tablet_copy_client.cc:670] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:55.083634 16370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9cf9412ae412a8756d1fc1138ddce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:55.086567 16367 tablet_copy_client.cc:538] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:55.119971 16364 ts_tablet_manager.cc:933] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:55.130616 16367 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:55.135208 16370 tablet_copy_client.cc:806] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:55.135864 16370 tablet_copy_client.cc:670] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:55.134184 16364 tablet_copy_client.cc:323] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:16:55.142990 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet 9b90fe6b2a274b68b50cf564b626c03e from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:16:55.143590 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet 9b90fe6b2a274b68b50cf564b626c03e from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-9b90fe6b2a274b68b50cf564b626c03e
I20260709 13:16:55.147528 16370 tablet_copy_client.cc:538] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:55.154223 15687 tablet_copy_source_session.cc:215] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:55.159555 16364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b90fe6b2a274b68b50cf564b626c03e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:55.167213 16367 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:55.168257 16367 tablet_bootstrap.cc:492] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:55.168378 16370 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:55.169060 16367 ts_tablet_manager.cc:1403] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.039s	user 0.025s	sys 0.005s
I20260709 13:16:55.172854 16367 raft_consensus.cc:359] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.173760 16367 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:55.174434 16367 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.181083 16367 ts_tablet_manager.cc:1434] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:16:55.182853 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-f6a774e81f58442c90fd80ad59687b99 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:16:55.183341 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-f6a774e81f58442c90fd80ad59687b99 on tablet f6a774e81f58442c90fd80ad59687b99 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:55.189342 16364 tablet_copy_client.cc:806] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:55.190639 16364 tablet_copy_client.cc:670] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:55.200286 16364 tablet_copy_client.cc:538] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:55.218112 16364 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:55.225548 16370 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:55.226503 16370 tablet_bootstrap.cc:492] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:55.227196 16370 ts_tablet_manager.cc:1403] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.004s
I20260709 13:16:55.230326 16370 raft_consensus.cc:359] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.231267 16370 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:55.231989 16370 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.235112 16370 ts_tablet_manager.cc:1434] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:16:55.237031 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-9fa9cf9412ae412a8756d1fc1138ddce received from {username='slave'} at 127.0.0.1:40216
I20260709 13:16:55.237499 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-9fa9cf9412ae412a8756d1fc1138ddce on tablet 9fa9cf9412ae412a8756d1fc1138ddce with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:55.241119 16364 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:55.242152 16364 tablet_bootstrap.cc:492] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:55.242939 16364 ts_tablet_manager.cc:1403] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.006s
I20260709 13:16:55.247485 16364 raft_consensus.cc:359] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.248345 16364 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:55.249281 16364 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:55.251596 16364 ts_tablet_manager.cc:1434] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:16:55.254160 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-9b90fe6b2a274b68b50cf564b626c03e received from {username='slave'} at 127.0.0.1:40216
I20260709 13:16:55.254639 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-9b90fe6b2a274b68b50cf564b626c03e on tablet 9b90fe6b2a274b68b50cf564b626c03e with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:55.357415 16310 raft_consensus.cc:1217] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:55.544797 16310 raft_consensus.cc:1217] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:55.564383 16310 raft_consensus.cc:1217] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:55.635848 16310 raft_consensus.cc:1217] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:55.878468 15838 raft_consensus.cc:1064] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:55.880760 15838 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:55.886665 15746 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:55.886732 16310 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:55.888324 15933 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.891072 15671 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:55.891547 15838 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.893618 15981 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:55.930183 15981 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:55.942965 15746 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:55.965569 16310 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:55.986399 15497 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:55.992919 15673 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.034909 15599 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:56.045333 15748 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.047348 16308 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.050946 16383 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:56.053176 15838 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.065570 16389 raft_consensus.cc:1064] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:56.068274 16389 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:56.069681 15873 raft_consensus.cc:1064] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:56.069585 15838 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.072001 15873 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:56.081108 16309 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.084805 15750 raft_consensus.cc:2955] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.088877 15599 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.090361 15873 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.106467 15746 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.113526 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c0bf08b91c244659abe8cb87e64f8cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:56.113698 16308 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.123134 15499 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.140149 16353 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:56.144882 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 59211.1us
I20260709 13:16:56.146766 15746 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.152454 16309 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.153437 16388 raft_consensus.cc:1064] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:56.156666 16388 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:56.157390 16353 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.163981 16353 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.171916 15601 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.173382 16390 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.176724 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c0bf08b91c244659abe8cb87e64f8cd with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:16:56.180796 15746 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.186388 16310 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.197592 15873 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.199010 15596 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:56.204773 16353 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:56.204900 16389 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:56.218158 15873 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:56.217540 16188 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:16:56.217970 16396 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:56.238713 16397 tablet_replica.cc:333] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:16:56.240545 16397 raft_consensus.cc:2243] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.247030 15599 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.255502 16397 raft_consensus.cc:2272] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.266388 16388 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.270398 16309 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.279891 16397 ts_tablet_manager.cc:1916] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:56.281412 15498 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.286875 15746 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.335930 16188 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.334092 15673 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:56.351997 16308 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.374696 15500 catalog_manager.cc:5697] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.365446 16397 ts_tablet_manager.cc:1929] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:56.376519 16397 log.cc:1199] T 8c0bf08b91c244659abe8cb87e64f8cd P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/8c0bf08b91c244659abe8cb87e64f8cd
I20260709 13:16:56.381894 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet 8c0bf08b91c244659abe8cb87e64f8cd (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:16:56.389094 15599 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.395511 15596 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.406237 16308 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.413661 16308 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.422185 15745 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.432170 15746 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.434283 15497 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.444784 16353 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:56.449568 16390 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.453281 15746 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.467108 16390 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.473994 16308 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.481856 15675 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:56.483089 15673 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:56.491343 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6a774e81f58442c90fd80ad59687b99 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:56.491528 16309 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.492645 16310 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.494385 15750 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.493050 15745 raft_consensus.cc:2955] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.517570 15599 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:56.519645 16390 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.519814 16353 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.523054 16353 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.524489 15497 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:56.524966 16353 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:56.536612 16188 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.541476 15599 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.543026 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet f6a774e81f58442c90fd80ad59687b99 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:16:56.569970 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9fa9cf9412ae412a8756d1fc1138ddce with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:56.568643 16353 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.570938 16308 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.574132 16310 raft_consensus.cc:2955] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.579079 16407 tablet_replica.cc:333] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:16:56.580154 16407 raft_consensus.cc:2243] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.581682 15498 catalog_manager.cc:5697] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.580886 15745 raft_consensus.cc:2955] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.586324 16407 raft_consensus.cc:2272] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.590809 16407 ts_tablet_manager.cc:1916] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:56.594907 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet 9fa9cf9412ae412a8756d1fc1138ddce with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:16:56.617167 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b90fe6b2a274b68b50cf564b626c03e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:56.628372 16408 tablet_replica.cc:333] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:16:56.630972 16408 raft_consensus.cc:2243] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.631755 16408 raft_consensus.cc:2272] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.634285 15500 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:56.639324 16408 ts_tablet_manager.cc:1916] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:56.642417 16407 ts_tablet_manager.cc:1929] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:56.642851 16407 log.cc:1199] T f6a774e81f58442c90fd80ad59687b99 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/f6a774e81f58442c90fd80ad59687b99
I20260709 13:16:56.644737 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet f6a774e81f58442c90fd80ad59687b99 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:16:56.652293 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b90fe6b2a274b68b50cf564b626c03e with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:16:56.653298 16407 tablet_replica.cc:333] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:16:56.654285 16407 raft_consensus.cc:2243] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:56.655581 16407 raft_consensus.cc:2272] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:56.658824 16407 ts_tablet_manager.cc:1916] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:56.658978 16408 ts_tablet_manager.cc:1929] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:56.659408 16408 log.cc:1199] T 9fa9cf9412ae412a8756d1fc1138ddce P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/9fa9cf9412ae412a8756d1fc1138ddce
I20260709 13:16:56.661152 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet 9fa9cf9412ae412a8756d1fc1138ddce (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:16:56.670303 16407 ts_tablet_manager.cc:1929] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:56.670797 16407 log.cc:1199] T 9b90fe6b2a274b68b50cf564b626c03e P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/9b90fe6b2a274b68b50cf564b626c03e
I20260709 13:16:56.672955 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 9b90fe6b2a274b68b50cf564b626c03e (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:16:57.719717 15673 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:57.725862 15599 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:57.725975 15750 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:57.726181 15642 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43658563a58a42e3b9a3da86a87a9c02. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.727445 16409 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:57.728401 16353 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.735121 16353 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.737143 15745 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.749830 15596 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:57.761559 15500 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.741811 15599 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.790092 15745 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:16:57.791320 15567 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 181e7ee5f1ce4aa3bf93c66197002509. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.793784 15981 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.793531 15673 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:57.801013 15981 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.815726 15838 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.817515 15671 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.819902 15745 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.830946 15596 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:57.839885 15498 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:16:57.843626 15567 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fc66402c5e04df38b56e6d8d4d7731d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:57.844543 15745 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:57.846053 15671 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:57.846326 15838 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.847503 15981 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.870576 16393 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.873991 15745 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.874686 15673 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.895444 15500 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:57.923539 15745 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:57.930850 15673 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:57.932698 15596 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:16:57.937389 16406 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.939334 16406 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:57.978988 16425 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:57.987454 15673 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:58.003391 15596 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:16:58.028644 15497 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:16:58.033710 15716 consensus_peers.cc:597] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5fd98191b2d04d05b9a41afba67ac044. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:58.123330 16433 ts_tablet_manager.cc:933] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:16:58.127822 16433 tablet_copy_client.cc:323] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:16:58.130549 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet 43658563a58a42e3b9a3da86a87a9c02 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:16:58.131090 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet 43658563a58a42e3b9a3da86a87a9c02 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-43658563a58a42e3b9a3da86a87a9c02
I20260709 13:16:58.136965 15687 tablet_copy_source_session.cc:215] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:58.139658 16433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43658563a58a42e3b9a3da86a87a9c02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.154924 16433 tablet_copy_client.cc:806] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:58.156368 16433 tablet_copy_client.cc:670] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:58.160048 16433 tablet_copy_client.cc:538] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:58.166281 16433 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:58.188757 16433 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:58.189744 16433 tablet_bootstrap.cc:492] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:58.190558 16433 ts_tablet_manager.cc:1403] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260709 13:16:58.193558 16433 raft_consensus.cc:359] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.194461 16433 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:58.195082 16433 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.198278 16433 ts_tablet_manager.cc:1434] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:16:58.201610 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-43658563a58a42e3b9a3da86a87a9c02 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:16:58.202047 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-43658563a58a42e3b9a3da86a87a9c02 on tablet 43658563a58a42e3b9a3da86a87a9c02 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:58.254936 16433 ts_tablet_manager.cc:933] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:16:58.256634 16433 tablet_copy_client.cc:323] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:16:58.258132 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet 6fc66402c5e04df38b56e6d8d4d7731d from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:16:58.258692 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet 6fc66402c5e04df38b56e6d8d4d7731d from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-6fc66402c5e04df38b56e6d8d4d7731d
I20260709 13:16:58.265802 15612 tablet_copy_source_session.cc:215] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:58.268517 16433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fc66402c5e04df38b56e6d8d4d7731d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.279318 16433 tablet_copy_client.cc:806] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:58.279853 16433 tablet_copy_client.cc:670] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:58.283972 16433 tablet_copy_client.cc:538] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:58.292640 16433 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:58.311455 16433 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:58.312268 16433 tablet_bootstrap.cc:492] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:58.312956 16433 ts_tablet_manager.cc:1403] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:16:58.315716 16433 raft_consensus.cc:359] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.316514 16433 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:58.317157 16433 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.319939 16433 ts_tablet_manager.cc:1434] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:16:58.329098 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-6fc66402c5e04df38b56e6d8d4d7731d received from {username='slave'} at 127.0.0.1:34574
I20260709 13:16:58.329574 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-6fc66402c5e04df38b56e6d8d4d7731d on tablet 6fc66402c5e04df38b56e6d8d4d7731d with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:58.333359 16439 ts_tablet_manager.cc:933] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:16:58.336328 16439 tablet_copy_client.cc:323] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:16:58.338646 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet 181e7ee5f1ce4aa3bf93c66197002509 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:16:58.339214 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet 181e7ee5f1ce4aa3bf93c66197002509 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-181e7ee5f1ce4aa3bf93c66197002509
I20260709 13:16:58.346692 15612 tablet_copy_source_session.cc:215] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:58.349982 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 181e7ee5f1ce4aa3bf93c66197002509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.363608 16439 tablet_copy_client.cc:806] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:58.364223 16439 tablet_copy_client.cc:670] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:58.367808 16439 tablet_copy_client.cc:538] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:58.375422 16439 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:58.399647 16439 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:58.400477 16439 tablet_bootstrap.cc:492] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:58.401242 16439 ts_tablet_manager.cc:1403] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.002s
I20260709 13:16:58.403439 16439 raft_consensus.cc:359] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.404237 16439 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:58.404817 16439 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.408027 16439 ts_tablet_manager.cc:1434] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:16:58.410091 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-181e7ee5f1ce4aa3bf93c66197002509 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:16:58.410521 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-181e7ee5f1ce4aa3bf93c66197002509 on tablet 181e7ee5f1ce4aa3bf93c66197002509 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:58.434051 16439 ts_tablet_manager.cc:933] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:16:58.437309 16439 tablet_copy_client.cc:323] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:16:58.452960 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 5fd98191b2d04d05b9a41afba67ac044 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:16:58.453487 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 5fd98191b2d04d05b9a41afba67ac044 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-5fd98191b2d04d05b9a41afba67ac044
I20260709 13:16:58.459916 15761 tablet_copy_source_session.cc:215] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:58.463055 16439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd98191b2d04d05b9a41afba67ac044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:58.475358 16439 tablet_copy_client.cc:806] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:58.476163 16439 tablet_copy_client.cc:670] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:58.480224 16439 tablet_copy_client.cc:538] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:58.489459 16439 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:16:58.523985 16439 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:58.525559 16439 tablet_bootstrap.cc:492] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:16:58.526268 16439 ts_tablet_manager.cc:1403] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.001s
I20260709 13:16:58.529268 16439 raft_consensus.cc:359] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.530140 16439 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:16:58.530821 16439 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:16:58.535724 16439 ts_tablet_manager.cc:1434] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:16:58.550417 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-5fd98191b2d04d05b9a41afba67ac044 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:16:58.552968 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-5fd98191b2d04d05b9a41afba67ac044 on tablet 5fd98191b2d04d05b9a41afba67ac044 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:16:58.714687 16308 raft_consensus.cc:1217] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:58.739230 16308 raft_consensus.cc:1217] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:58.897046 16308 raft_consensus.cc:1217] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:59.057127 16308 raft_consensus.cc:1217] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:16:59.106820 15981 raft_consensus.cc:1064] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:59.109087 15981 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.115767 15745 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.117381 16393 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.134548 16308 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.134609 15673 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.137614 15838 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.139230 15838 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.154199 16353 raft_consensus.cc:1064] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:59.157792 16353 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.157707 16453 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.175854 15750 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.183125 15497 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.196507 15673 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.204818 16310 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.205255 15750 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.206907 16446 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.218966 16353 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:59.223187 15596 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.225159 16353 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.239739 16308 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.261513 16353 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.266166 15596 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.267554 15750 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.274564 16308 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.294543 15499 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.315918 15671 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.321449 15599 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.321285 15596 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.323552 16446 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:59.326121 16308 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.327806 16446 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:59.327800 16310 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.331812 16454 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:59.337884 15599 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.338167 16353 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.352747 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43658563a58a42e3b9a3da86a87a9c02 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:59.356925 15671 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.356890 16310 raft_consensus.cc:2955] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.359980 16454 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:59.364650 15500 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.366756 16452 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.367893 16308 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.388242 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6fc66402c5e04df38b56e6d8d4d7731d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:59.390847 15671 raft_consensus.cc:2955] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.402747 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet 43658563a58a42e3b9a3da86a87a9c02 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:16:59.414291 15500 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.434446 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet 6fc66402c5e04df38b56e6d8d4d7731d with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:16:59.435186 16463 tablet_replica.cc:333] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:16:59.435979 16463 raft_consensus.cc:2243] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:59.436570 16463 raft_consensus.cc:2272] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:59.439141 16463 ts_tablet_manager.cc:1916] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:59.452955 16463 ts_tablet_manager.cc:1929] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:59.453372 16463 log.cc:1199] T 43658563a58a42e3b9a3da86a87a9c02 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/43658563a58a42e3b9a3da86a87a9c02
I20260709 13:16:59.455128 16463 tablet_replica.cc:333] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:16:59.456091 16463 raft_consensus.cc:2243] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:59.456024 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet 43658563a58a42e3b9a3da86a87a9c02 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:16:59.456923 16463 raft_consensus.cc:2272] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:59.459259 16463 ts_tablet_manager.cc:1916] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:59.473421 15981 raft_consensus.cc:1064] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:59.473873 16463 ts_tablet_manager.cc:1929] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:59.474334 16463 log.cc:1199] T 6fc66402c5e04df38b56e6d8d4d7731d P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/6fc66402c5e04df38b56e6d8d4d7731d
I20260709 13:16:59.475652 15981 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.480696 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet 6fc66402c5e04df38b56e6d8d4d7731d (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:16:59.486224 15745 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.486377 16310 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.487879 16393 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.489943 15671 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.491592 16452 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.501780 16393 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.510334 15838 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.511989 15750 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.521952 16310 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.529511 15499 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.571707 15671 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.597515 15599 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.602519 16310 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.603853 15750 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.603910 16454 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:59.605192 16452 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:59.611415 16454 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.613725 16310 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.631014 15745 raft_consensus.cc:2955] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.632323 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 181e7ee5f1ce4aa3bf93c66197002509 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:59.639261 15499 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:59.662654 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet 181e7ee5f1ce4aa3bf93c66197002509 with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:16:59.665416 16406 raft_consensus.cc:1064] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:16:59.667896 16406 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.668903 16468 tablet_replica.cc:333] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:16:59.680263 16468 raft_consensus.cc:2243] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:59.681196 16468 raft_consensus.cc:2272] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:59.682341 16308 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.684013 16432 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:59.684932 16468 ts_tablet_manager.cc:1916] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:59.692389 15673 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.694420 16447 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:59.697201 15599 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:16:59.700085 16406 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:59.709715 16468 ts_tablet_manager.cc:1929] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:59.710784 16468 log.cc:1199] T 181e7ee5f1ce4aa3bf93c66197002509 P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/181e7ee5f1ce4aa3bf93c66197002509
I20260709 13:16:59.713201 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet 181e7ee5f1ce4aa3bf93c66197002509 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:16:59.712203 16432 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.714238 15599 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.714754 15671 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.725700 16308 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.738683 15499 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.757202 15750 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:16:59.763608 16308 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.763608 15671 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:59.767023 16432 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:59.768821 16447 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:59.777218 16432 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.786805 16308 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.807394 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5fd98191b2d04d05b9a41afba67ac044 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:59.811084 15498 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.808445 15671 raft_consensus.cc:2955] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:16:59.835857 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 5fd98191b2d04d05b9a41afba67ac044 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:16:59.849349 16474 tablet_replica.cc:333] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:16:59.850988 16474 raft_consensus.cc:2243] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:59.851706 16474 raft_consensus.cc:2272] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:59.856423 16474 ts_tablet_manager.cc:1916] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:59.869174 16474 ts_tablet_manager.cc:1929] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:59.869510 16474 log.cc:1199] T 5fd98191b2d04d05b9a41afba67ac044 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/5fd98191b2d04d05b9a41afba67ac044
I20260709 13:16:59.870910 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 5fd98191b2d04d05b9a41afba67ac044 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:00.902444 15599 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:00.909222 15671 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:00.909926 15567 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b798e44b35ab41d0943297db40d7407f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:00.909214 15750 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:00.911026 16454 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:00.912078 15981 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:00.919907 15981 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:00.921661 15671 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:00.935215 15745 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:00.940922 15497 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.942157 15750 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:17:00.972289 15716 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3862488109f64226a32f4b77b567c1dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:00.974498 15675 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:00.976517 15599 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:00.976377 16432 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:00.980140 16477 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:00.998332 16477 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.000113 15599 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.009173 15671 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.020036 15750 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.023101 15498 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.030181 15671 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:01.030632 15716 consensus_peers.cc:597] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e1ddbbc3cce4edcbe5c245fb2d8ed29. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:01.032503 15599 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:01.032778 16477 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:01.042656 16477 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:01.050451 16432 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.054774 15599 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.057389 15675 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.066402 15597 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.079631 15500 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.083083 15750 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:01.083966 15567 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 958e81841a784ee79fccc9f488562c59. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:01.086654 16482 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:01.101025 15671 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:01.102725 16454 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.108546 16482 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:01.112736 15745 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.124306 15498 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.133548 15671 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:01.436342 16497 ts_tablet_manager.cc:933] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:01.439102 16497 tablet_copy_client.cc:323] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:01.441368 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:01.442006 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-9e1ddbbc3cce4edcbe5c245fb2d8ed29
I20260709 13:17:01.450846 15761 tablet_copy_source_session.cc:215] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:01.453909 16497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.468582 16497 tablet_copy_client.cc:806] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:01.469372 16497 tablet_copy_client.cc:670] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:01.475188 16497 tablet_copy_client.cc:538] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:01.489296 16497 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:01.498826 16499 ts_tablet_manager.cc:933] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:01.507645 16499 tablet_copy_client.cc:323] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:01.510802 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet b798e44b35ab41d0943297db40d7407f from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:01.511427 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet b798e44b35ab41d0943297db40d7407f from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-b798e44b35ab41d0943297db40d7407f
I20260709 13:17:01.522029 15612 tablet_copy_source_session.cc:215] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:01.525204 16502 ts_tablet_manager.cc:933] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:01.526154 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b798e44b35ab41d0943297db40d7407f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.533138 16497 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:01.534319 16497 tablet_bootstrap.cc:492] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:01.535208 16497 ts_tablet_manager.cc:1403] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.016s
I20260709 13:17:01.539407 16497 raft_consensus.cc:359] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.540985 16497 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:01.542322 16497 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.541051 16502 tablet_copy_client.cc:323] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:01.545804 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 3862488109f64226a32f4b77b567c1dc from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:01.546370 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 3862488109f64226a32f4b77b567c1dc from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-3862488109f64226a32f4b77b567c1dc
I20260709 13:17:01.559620 15761 tablet_copy_source_session.cc:215] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:01.561096 16497 ts_tablet_manager.cc:1434] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.011s
I20260709 13:17:01.568635 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-9e1ddbbc3cce4edcbe5c245fb2d8ed29 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:01.569147 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-9e1ddbbc3cce4edcbe5c245fb2d8ed29 on tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:01.579185 16499 tablet_copy_client.cc:806] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:01.579856 16499 tablet_copy_client.cc:670] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:01.582434 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3862488109f64226a32f4b77b567c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.604799 16499 tablet_copy_client.cc:538] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:01.623948 16499 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:01.627367 16497 ts_tablet_manager.cc:933] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:01.641462 16497 tablet_copy_client.cc:323] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:01.647061 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet 958e81841a784ee79fccc9f488562c59 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:01.647658 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet 958e81841a784ee79fccc9f488562c59 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-958e81841a784ee79fccc9f488562c59
I20260709 13:17:01.653424 16502 tablet_copy_client.cc:806] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:01.657663 16502 tablet_copy_client.cc:670] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:01.664053 16502 tablet_copy_client.cc:538] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:01.666345 16499 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:01.667284 15612 tablet_copy_source_session.cc:215] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:01.667418 16499 tablet_bootstrap.cc:492] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:01.670657 16499 ts_tablet_manager.cc:1403] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.007s
I20260709 13:17:01.673408 16502 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:01.675731 16499 raft_consensus.cc:359] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.676613 16499 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
W20260709 13:17:01.679243 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 56958.3us
I20260709 13:17:01.677279 16499 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.683790 16497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 958e81841a784ee79fccc9f488562c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:01.683820 16499 ts_tablet_manager.cc:1434] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:17:01.694267 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-b798e44b35ab41d0943297db40d7407f received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:01.695699 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-b798e44b35ab41d0943297db40d7407f on tablet b798e44b35ab41d0943297db40d7407f with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:01.720461 16497 tablet_copy_client.cc:806] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:01.721115 16497 tablet_copy_client.cc:670] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:01.727808 16497 tablet_copy_client.cc:538] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:01.743938 16497 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:01.746862 16502 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:01.748914 16502 tablet_bootstrap.cc:492] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:01.749677 16502 ts_tablet_manager.cc:1403] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.006s
I20260709 13:17:01.752947 16502 raft_consensus.cc:359] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.753638 16502 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:01.754184 16502 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.756474 16502 ts_tablet_manager.cc:1434] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:17:01.758956 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-3862488109f64226a32f4b77b567c1dc received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:01.759375 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-3862488109f64226a32f4b77b567c1dc on tablet 3862488109f64226a32f4b77b567c1dc with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:01.773622 16497 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:01.774471 16497 tablet_bootstrap.cc:492] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:01.775084 16497 ts_tablet_manager.cc:1403] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.004s
I20260709 13:17:01.777602 16497 raft_consensus.cc:359] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.778494 16497 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:01.779167 16497 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:01.781123 16497 ts_tablet_manager.cc:1434] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:01.783404 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-958e81841a784ee79fccc9f488562c59 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:01.783824 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-958e81841a784ee79fccc9f488562c59 on tablet 958e81841a784ee79fccc9f488562c59 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:01.967557 16310 raft_consensus.cc:1217] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:01.980645 16310 raft_consensus.cc:1217] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:02.032529 16310 raft_consensus.cc:1217] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:02.128813 16310 raft_consensus.cc:1217] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:02.413173 16406 raft_consensus.cc:1064] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:02.414880 16406 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:02.422008 16310 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.423749 16406 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.424496 15673 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.427120 16511 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.432694 15599 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.434846 16511 raft_consensus.cc:1064] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:02.435672 16432 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.438771 16511 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:02.458222 16406 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.464264 16310 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.463934 15599 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.466979 16505 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.481352 15671 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.481812 15597 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.483459 16432 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:02.492229 16505 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:02.503136 16308 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.531386 15671 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.539077 16519 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.541326 16309 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.516708 15497 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.566720 15675 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.597872 15499 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:02.606276 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 44435.9us
I20260709 13:17:02.612378 16478 raft_consensus.cc:1064] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:02.618654 16478 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:02.628544 15750 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.628587 16309 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.630398 16482 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.638543 15750 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:02.639793 15597 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.649317 16309 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:02.651245 16505 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:02.657033 15750 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:02.657560 16482 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.665599 15675 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.664726 16406 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.671250 15601 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:02.671427 16521 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:02.671118 16309 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.680722 16454 raft_consensus.cc:1064] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:02.683085 16454 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:02.684136 16310 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:02.686553 15673 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:02.688691 16511 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:02.690817 16519 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:02.706135 16432 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:02.709107 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3862488109f64226a32f4b77b567c1dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:02.710289 16432 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.718232 15750 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.720427 16307 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.723071 15673 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.724833 16454 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.727253 16454 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:02.730610 15599 raft_consensus.cc:2955] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.731833 16310 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:02.734086 15500 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.740240 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:02.748231 15673 raft_consensus.cc:2955] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.753973 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet 3862488109f64226a32f4b77b567c1dc with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:02.761654 15500 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.811722 16534 tablet_replica.cc:333] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:02.787387 16482 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:17:02.808418 16454 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.839511 16307 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.847851 16534 raft_consensus.cc:2243] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:02.848718 16534 raft_consensus.cc:2272] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:02.879756 15498 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.875233 16534 ts_tablet_manager.cc:1916] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:02.891404 15745 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.917342 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:02.931480 15675 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.954680 15673 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.943421 16538 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:02.990870 16307 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.020763 15500 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.023350 16534 ts_tablet_manager.cc:1929] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:03.023869 16534 log.cc:1199] T 3862488109f64226a32f4b77b567c1dc P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/3862488109f64226a32f4b77b567c1dc
I20260709 13:17:03.033002 15745 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.039032 16545 tablet_replica.cc:333] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:03.040241 16545 raft_consensus.cc:2243] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:03.038092 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet 3862488109f64226a32f4b77b567c1dc (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:03.043056 16545 raft_consensus.cc:2272] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:17:03.044934 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 116335us
I20260709 13:17:03.057536 16545 ts_tablet_manager.cc:1916] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:03.079532 15602 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:03.082201 15601 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:03.088464 15746 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:03.090188 16538 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:03.093995 16307 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:03.096391 16538 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:03.097568 16545 ts_tablet_manager.cc:1929] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:03.098133 16545 log.cc:1199] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/9e1ddbbc3cce4edcbe5c245fb2d8ed29
I20260709 13:17:03.100344 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 9e1ddbbc3cce4edcbe5c245fb2d8ed29 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:03.102072 16542 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.108639 16310 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.109568 15675 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:03.113363 16309 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:03.115162 16454 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:03.120924 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b798e44b35ab41d0943297db40d7407f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:03.128018 16454 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:03.130832 16538 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.133076 15673 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.142091 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 958e81841a784ee79fccc9f488562c59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:03.148506 16308 raft_consensus.cc:2955] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.130474 15746 raft_consensus.cc:2955] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.160877 15500 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:03.180398 15498 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:03.184365 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet b798e44b35ab41d0943297db40d7407f with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:03.185387 16534 tablet_replica.cc:333] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:03.186407 16534 raft_consensus.cc:2243] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:03.187074 16534 raft_consensus.cc:2272] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:03.190887 16534 ts_tablet_manager.cc:1916] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:03.200748 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet 958e81841a784ee79fccc9f488562c59 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:17:03.204463 16547 tablet_replica.cc:333] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:17:03.209008 16534 ts_tablet_manager.cc:1929] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:03.209553 16534 log.cc:1199] T b798e44b35ab41d0943297db40d7407f P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/b798e44b35ab41d0943297db40d7407f
I20260709 13:17:03.211045 16547 raft_consensus.cc:2243] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:03.211529 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet b798e44b35ab41d0943297db40d7407f (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:03.211790 16547 raft_consensus.cc:2272] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:03.215879 16547 ts_tablet_manager.cc:1916] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:03.231894 16547 ts_tablet_manager.cc:1929] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:03.232213 16547 log.cc:1199] T 958e81841a784ee79fccc9f488562c59 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/958e81841a784ee79fccc9f488562c59
I20260709 13:17:03.233765 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet 958e81841a784ee79fccc9f488562c59 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:04.271116 15673 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:17:04.277312 15642 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9e5693d3c474948b687ba64b0b31215. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.277346 15745 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:04.277733 15602 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:04.278991 16546 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.279799 16548 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.289789 16546 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.294121 15746 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.310809 15673 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:04.314848 15499 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.319499 15745 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:04.319559 15602 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.324004 16546 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.327069 15601 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:04.327831 15642 consensus_peers.cc:597] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eaaf7f7575314c29a12eedde1fe321a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.328470 16552 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.361380 16548 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.363319 15601 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.369015 15745 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.384917 15745 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:04.388025 15496 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:17:04.395241 15716 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ffd4ffeb1af146f384319d74146b93f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.395344 15671 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:04.396736 15601 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:04.397266 16519 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.400812 16519 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.410640 16519 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.412470 15671 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.414330 15601 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.428349 15499 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.429240 15745 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:17:04.443670 15716 consensus_peers.cc:597] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16817d3f588f45019ebd19d0c1915814. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:04.446230 15673 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:04.449762 16531 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:04.454909 15601 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:04.457489 16531 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:04.464962 16531 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.469558 15673 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.471309 15601 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:04.483850 15496 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:04.665076 16567 ts_tablet_manager.cc:933] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:04.667116 16567 tablet_copy_client.cc:323] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:17:04.669118 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet c9e5693d3c474948b687ba64b0b31215 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:17:04.669747 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet c9e5693d3c474948b687ba64b0b31215 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-c9e5693d3c474948b687ba64b0b31215
I20260709 13:17:04.678571 15687 tablet_copy_source_session.cc:215] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:04.681669 16567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e5693d3c474948b687ba64b0b31215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:04.695545 16567 tablet_copy_client.cc:806] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:04.696281 16567 tablet_copy_client.cc:670] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:04.700856 16567 tablet_copy_client.cc:538] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:04.709172 16567 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:04.739630 16567 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:04.740705 16567 tablet_bootstrap.cc:492] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:04.743134 16567 ts_tablet_manager.cc:1403] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.009s
I20260709 13:17:04.746426 16567 raft_consensus.cc:359] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:04.747370 16567 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:04.752502 16567 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:04.756314 16567 ts_tablet_manager.cc:1434] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:17:04.759079 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-c9e5693d3c474948b687ba64b0b31215 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:04.759565 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-c9e5693d3c474948b687ba64b0b31215 on tablet c9e5693d3c474948b687ba64b0b31215 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:04.875748 16567 ts_tablet_manager.cc:933] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:04.877470 16567 tablet_copy_client.cc:323] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:17:04.879030 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet eaaf7f7575314c29a12eedde1fe321a7 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:17:04.879544 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet eaaf7f7575314c29a12eedde1fe321a7 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-eaaf7f7575314c29a12eedde1fe321a7
I20260709 13:17:04.886482 15687 tablet_copy_source_session.cc:215] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:04.889501 16567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaf7f7575314c29a12eedde1fe321a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:04.916252 16567 tablet_copy_client.cc:806] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:04.916997 16567 tablet_copy_client.cc:670] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:04.920719 16567 tablet_copy_client.cc:538] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:04.927595 16567 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:04.946720 16567 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:04.947605 16567 tablet_bootstrap.cc:492] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:04.948268 16567 ts_tablet_manager.cc:1403] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:17:04.951481 16567 raft_consensus.cc:359] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:04.952310 16567 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:04.952965 16567 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:04.955489 16567 ts_tablet_manager.cc:1434] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:17:04.957773 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-eaaf7f7575314c29a12eedde1fe321a7 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:04.958216 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-eaaf7f7575314c29a12eedde1fe321a7 on tablet eaaf7f7575314c29a12eedde1fe321a7 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:05.014000 16567 ts_tablet_manager.cc:933] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:05.015681 16567 tablet_copy_client.cc:323] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:05.017230 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet ffd4ffeb1af146f384319d74146b93f6 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:05.017724 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet ffd4ffeb1af146f384319d74146b93f6 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-ffd4ffeb1af146f384319d74146b93f6
I20260709 13:17:05.026813 15761 tablet_copy_source_session.cc:215] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:05.030346 16567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd4ffeb1af146f384319d74146b93f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.043800 16567 tablet_copy_client.cc:806] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:05.044387 16567 tablet_copy_client.cc:670] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:05.048250 16567 tablet_copy_client.cc:538] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:05.061877 16567 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:05.078780 16575 ts_tablet_manager.cc:933] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:05.084779 16575 tablet_copy_client.cc:323] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:05.086786 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 16817d3f588f45019ebd19d0c1915814 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:05.087374 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 16817d3f588f45019ebd19d0c1915814 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-16817d3f588f45019ebd19d0c1915814
I20260709 13:17:05.091279 16308 raft_consensus.cc:1217] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:05.094699 16567 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:05.095709 16567 tablet_bootstrap.cc:492] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:05.096383 16567 ts_tablet_manager.cc:1403] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.003s
I20260709 13:17:05.098745 16567 raft_consensus.cc:359] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:05.099552 16567 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:05.100167 16567 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:05.102458 16567 ts_tablet_manager.cc:1434] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:17:05.105988 15760 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-ffd4ffeb1af146f384319d74146b93f6 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:05.106419 15760 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-ffd4ffeb1af146f384319d74146b93f6 on tablet ffd4ffeb1af146f384319d74146b93f6 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:05.123816 15761 tablet_copy_source_session.cc:215] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:05.133911 16575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16817d3f588f45019ebd19d0c1915814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:05.154965 16575 tablet_copy_client.cc:806] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:05.155563 16575 tablet_copy_client.cc:670] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:05.159241 16575 tablet_copy_client.cc:538] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:05.166159 16575 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:05.191808 16575 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:05.192809 16575 tablet_bootstrap.cc:492] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:05.193394 16575 ts_tablet_manager.cc:1403] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.013s
I20260709 13:17:05.196040 16575 raft_consensus.cc:359] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:05.196908 16575 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:05.197467 16575 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:05.199424 16575 ts_tablet_manager.cc:1434] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:17:05.201589 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-16817d3f588f45019ebd19d0c1915814 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:05.202011 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-16817d3f588f45019ebd19d0c1915814 on tablet 16817d3f588f45019ebd19d0c1915814 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:05.262781 16308 raft_consensus.cc:1217] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:05.564558 16308 raft_consensus.cc:1217] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:05.618175 16309 raft_consensus.cc:1217] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:05.688421 16572 raft_consensus.cc:1064] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:05.691048 16572 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:05.698416 15746 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:05.699400 16309 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:05.699457 15601 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:05.700506 16546 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.701481 16548 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.702260 16572 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.715191 16546 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.717319 16309 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.718672 15746 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.742573 15602 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.744141 15499 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.793066 16546 raft_consensus.cc:1064] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:05.795588 16546 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:05.799208 15671 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:05.805019 16309 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:05.805941 15601 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:05.806932 16585 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.808296 15746 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:05.809973 16546 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.810606 16309 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:05.808156 16548 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.812978 16572 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:05.827814 16585 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.838884 16309 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.842417 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c9e5693d3c474948b687ba64b0b31215 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:05.849519 15601 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:05.853401 15497 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.860713 16572 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:05.864485 15602 raft_consensus.cc:2955] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.872296 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet c9e5693d3c474948b687ba64b0b31215 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:17:05.876241 16595 tablet_replica.cc:333] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:17:05.886068 15602 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.890803 16595 raft_consensus.cc:2243] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:05.894809 16595 raft_consensus.cc:2272] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:05.870718 16591 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.887786 16308 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.912317 15745 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.907893 16595 ts_tablet_manager.cc:1916] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:05.928701 15496 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.953205 15671 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:05.954325 16595 ts_tablet_manager.cc:1929] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:05.954845 16595 log.cc:1199] T c9e5693d3c474948b687ba64b0b31215 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/c9e5693d3c474948b687ba64b0b31215
I20260709 13:17:05.957599 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet c9e5693d3c474948b687ba64b0b31215 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:05.958195 16308 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:05.959822 16591 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.959925 15745 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:05.963133 16591 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.967404 16585 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.969125 16308 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.973487 15745 raft_consensus.cc:2955] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:05.978901 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eaaf7f7575314c29a12eedde1fe321a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:05.983551 16505 raft_consensus.cc:1064] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:05.985841 16505 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:05.990444 15496 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.029745 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet eaaf7f7575314c29a12eedde1fe321a7 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:06.031725 16597 tablet_replica.cc:333] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:06.032792 16597 raft_consensus.cc:2243] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.033532 16597 raft_consensus.cc:2272] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.039646 16597 ts_tablet_manager.cc:1916] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:06.073609 15673 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:06.074175 15601 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:06.082418 16531 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.084887 16531 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.085268 16309 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:06.089241 16531 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.101079 16597 ts_tablet_manager.cc:1929] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:06.102140 16597 log.cc:1199] T eaaf7f7575314c29a12eedde1fe321a7 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/eaaf7f7575314c29a12eedde1fe321a7
I20260709 13:17:06.104148 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet eaaf7f7575314c29a12eedde1fe321a7 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:06.108805 16598 raft_consensus.cc:1064] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:06.113127 16598 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:06.137328 16308 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:06.140033 16505 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.141372 15671 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:06.142817 15601 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:06.155267 16505 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.156298 16531 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:06.160332 16505 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.164292 16308 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.180828 16531 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.182353 15602 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.192234 16309 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.193288 15673 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.195276 15496 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.209869 15671 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.208021 15497 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.241878 15746 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:06.252401 16308 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:06.254570 16578 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:06.261425 16598 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.264932 15602 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:06.269156 16505 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:06.270113 16309 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.271365 15602 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.275393 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ffd4ffeb1af146f384319d74146b93f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:17:06.287993 15486 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet ffd4ffeb1af146f384319d74146b93f6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:17:06.288034 15601 raft_consensus.cc:2955] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.286131 15498 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.305291 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet ffd4ffeb1af146f384319d74146b93f6 with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:06.310901 15745 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:06.308662 16606 tablet_replica.cc:333] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:06.318483 16308 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:06.318554 16606 raft_consensus.cc:2243] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.319499 16606 raft_consensus.cc:2272] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.320128 16598 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:06.320001 15673 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:06.322544 16531 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:06.325994 16606 ts_tablet_manager.cc:1916] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:06.329413 16531 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.332918 16308 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.344252 15673 raft_consensus.cc:2955] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.353070 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16817d3f588f45019ebd19d0c1915814 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:06.353472 15496 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:06.364382 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 16817d3f588f45019ebd19d0c1915814 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:06.365484 16597 tablet_replica.cc:333] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:06.366609 16597 raft_consensus.cc:2243] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:06.367376 16597 raft_consensus.cc:2272] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:06.372102 16597 ts_tablet_manager.cc:1916] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:06.387817 16597 ts_tablet_manager.cc:1929] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:06.388448 16597 log.cc:1199] T 16817d3f588f45019ebd19d0c1915814 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/16817d3f588f45019ebd19d0c1915814
I20260709 13:17:06.391331 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 16817d3f588f45019ebd19d0c1915814 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:06.392450 16606 ts_tablet_manager.cc:1929] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:06.392915 16606 log.cc:1199] T ffd4ffeb1af146f384319d74146b93f6 P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/ffd4ffeb1af146f384319d74146b93f6
I20260709 13:17:06.394527 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet ffd4ffeb1af146f384319d74146b93f6 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:07.446511 15601 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:07.452554 15745 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:07.453770 15673 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:07.454195 16610 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.455230 16580 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:07.457410 15567 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c248e8afdd4142d983c50c91087d8e01. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.465175 16580 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.466926 15673 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.483520 15601 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:07.485270 15499 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.482667 15745 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.497324 15746 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:07.498112 15671 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:07.509037 15567 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90bff7f9147743b39de29e593c7a83b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.509584 16610 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.510506 16538 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.531772 16607 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.539309 15671 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.551287 15673 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:07.566071 15745 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.575810 15746 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:07.568197 15496 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:07.571184 15642 consensus_peers.cc:597] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dc37ba667f048359988247ddb2d7f5b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.575059 15601 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:07.578843 16546 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.579852 16585 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.606825 16585 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.610714 15601 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.618419 15745 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.623927 15596 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:07.631860 15496 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:07.639899 15745 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:07.640429 15567 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bea9d89f73eb4c36b8a8270cda937174. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:07.644002 15671 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:07.645015 16580 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.649501 16610 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:07.656370 16610 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.659221 15745 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.668499 15673 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.680450 15498 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:07.893110 16629 ts_tablet_manager.cc:933] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:07.895435 16629 tablet_copy_client.cc:323] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:07.897531 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet 90bff7f9147743b39de29e593c7a83b1 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:07.898029 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet 90bff7f9147743b39de29e593c7a83b1 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-90bff7f9147743b39de29e593c7a83b1
I20260709 13:17:07.903558 15612 tablet_copy_source_session.cc:215] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:07.907235 16631 ts_tablet_manager.cc:933] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:07.908555 16629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bff7f9147743b39de29e593c7a83b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.909277 16631 tablet_copy_client.cc:323] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:07.911532 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet c248e8afdd4142d983c50c91087d8e01 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:07.912073 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet c248e8afdd4142d983c50c91087d8e01 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-c248e8afdd4142d983c50c91087d8e01
I20260709 13:17:07.920539 15612 tablet_copy_source_session.cc:215] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:07.923875 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c248e8afdd4142d983c50c91087d8e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:07.929783 16629 tablet_copy_client.cc:806] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:07.930503 16629 tablet_copy_client.cc:670] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:07.934244 16629 tablet_copy_client.cc:538] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:07.940382 16631 tablet_copy_client.cc:806] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:07.941076 16631 tablet_copy_client.cc:670] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:07.944516 16629 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:07.947749 16631 tablet_copy_client.cc:538] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:07.957186 16631 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:07.970409 16629 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:07.971448 16629 tablet_bootstrap.cc:492] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:07.972208 16629 ts_tablet_manager.cc:1403] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:17:07.975221 16629 raft_consensus.cc:359] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:07.977789 16629 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:07.978523 16629 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:07.994644 16629 ts_tablet_manager.cc:1434] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:17:07.996915 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-90bff7f9147743b39de29e593c7a83b1 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:07.997398 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-90bff7f9147743b39de29e593c7a83b1 on tablet 90bff7f9147743b39de29e593c7a83b1 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:08.078261 16631 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:08.079663 16631 tablet_bootstrap.cc:492] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:08.080417 16631 ts_tablet_manager.cc:1403] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.123s	user 0.022s	sys 0.053s
I20260709 13:17:08.083844 16631 raft_consensus.cc:359] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:08.085803 16631 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:08.086541 16631 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:08.089257 16631 ts_tablet_manager.cc:1434] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:17:08.091547 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-c248e8afdd4142d983c50c91087d8e01 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:08.091993 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-c248e8afdd4142d983c50c91087d8e01 on tablet c248e8afdd4142d983c50c91087d8e01 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:08.121601 16631 ts_tablet_manager.cc:933] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:08.123486 16631 tablet_copy_client.cc:323] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:17:08.125795 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet 9dc37ba667f048359988247ddb2d7f5b from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:17:08.126309 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet 9dc37ba667f048359988247ddb2d7f5b from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-9dc37ba667f048359988247ddb2d7f5b
I20260709 13:17:08.132248 15687 tablet_copy_source_session.cc:215] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:08.135174 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc37ba667f048359988247ddb2d7f5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.146828 16631 tablet_copy_client.cc:806] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:08.147449 16631 tablet_copy_client.cc:670] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:08.151700 16631 tablet_copy_client.cc:538] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:08.160202 16631 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:08.178026 16631 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:08.178777 16631 tablet_bootstrap.cc:492] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:08.179354 16631 ts_tablet_manager.cc:1403] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 13:17:08.181823 16631 raft_consensus.cc:359] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:08.182623 16631 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:08.183123 16631 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:08.185429 16631 ts_tablet_manager.cc:1434] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:17:08.187279 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-9dc37ba667f048359988247ddb2d7f5b received from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:08.187704 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-9dc37ba667f048359988247ddb2d7f5b on tablet 9dc37ba667f048359988247ddb2d7f5b with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:08.246131 16631 ts_tablet_manager.cc:933] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:08.248733 16631 tablet_copy_client.cc:323] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:08.250332 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet bea9d89f73eb4c36b8a8270cda937174 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:08.250871 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet bea9d89f73eb4c36b8a8270cda937174 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-bea9d89f73eb4c36b8a8270cda937174
I20260709 13:17:08.257992 15612 tablet_copy_source_session.cc:215] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:08.261401 16631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea9d89f73eb4c36b8a8270cda937174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:08.278013 16631 tablet_copy_client.cc:806] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:08.278616 16631 tablet_copy_client.cc:670] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:08.283488 16631 tablet_copy_client.cc:538] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:08.290241 16631 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:08.308370 16631 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:08.309209 16631 tablet_bootstrap.cc:492] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:08.309916 16631 ts_tablet_manager.cc:1403] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:17:08.312093 16631 raft_consensus.cc:359] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:08.312696 16631 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:08.313159 16631 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:08.317168 16631 ts_tablet_manager.cc:1434] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:17:08.323426 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-bea9d89f73eb4c36b8a8270cda937174 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:08.323885 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-bea9d89f73eb4c36b8a8270cda937174 on tablet bea9d89f73eb4c36b8a8270cda937174 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:08.372561 16309 raft_consensus.cc:1217] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:08.519410 16309 raft_consensus.cc:1217] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:08.614053 16309 raft_consensus.cc:1217] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:08.845078 16308 raft_consensus.cc:1217] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:08.925686 16643 raft_consensus.cc:1064] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:08.927682 16643 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:08.934064 15745 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.934795 16308 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.934999 15673 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:08.936257 16642 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:08.937567 16628 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:08.939968 16642 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:08.961158 16642 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:08.965389 15671 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:08.967506 15746 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:08.977994 16308 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:08.988265 15498 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:08.995714 16610 raft_consensus.cc:1064] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:08.998317 16610 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:09.032666 16309 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.033144 15746 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.034178 16628 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:09.035717 16643 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:09.088732 15601 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:09.094805 16308 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.096313 16643 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:09.097815 15673 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.103286 15673 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.114877 16622 raft_consensus.cc:1064] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:09.115842 16628 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.117519 16622 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:09.128382 16654 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.135010 16643 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:09.130477 16309 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.131944 15746 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.136924 16642 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.154942 15673 raft_consensus.cc:2955] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.178689 15499 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.194998 16309 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.204460 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet 90bff7f9147743b39de29e593c7a83b1 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:17:09.211933 16308 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.212785 15671 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.213590 15750 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.216889 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90bff7f9147743b39de29e593c7a83b1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:09.225214 16644 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:09.226416 16610 raft_consensus.cc:1064] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:09.228837 16622 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:09.229238 16610 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:09.228581 15499 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.244483 16663 tablet_replica.cc:333] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:17:09.246732 16663 raft_consensus.cc:2243] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.251076 15598 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.252452 16307 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.254272 16644 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.256132 15750 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.260694 15746 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.253536 16663 raft_consensus.cc:2272] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.255188 16610 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:09.262810 16654 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:09.264621 16663 ts_tablet_manager.cc:1916] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:09.271826 16622 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:09.273298 15673 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:09.291936 15499 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.293205 16642 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:09.310395 16308 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.319657 15598 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:09.325224 16642 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.333292 15746 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.346308 16309 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.346726 15750 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.348908 16610 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.353098 16654 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.359488 16663 ts_tablet_manager.cc:1929] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:09.360052 16663 log.cc:1199] T 90bff7f9147743b39de29e593c7a83b1 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/90bff7f9147743b39de29e593c7a83b1
I20260709 13:17:09.367161 15671 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:09.368252 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet 90bff7f9147743b39de29e593c7a83b1 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:09.372268 16308 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.374492 16610 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.375574 15746 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.375308 16308 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.374517 16644 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:17:09.379235 16644 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.387089 16309 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.388494 15498 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:09.391666 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c248e8afdd4142d983c50c91087d8e01 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:09.394827 16622 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.395989 15746 raft_consensus.cc:2955] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.399183 16310 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.416718 15497 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.421407 15748 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.439482 15498 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.456579 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dc37ba667f048359988247ddb2d7f5b with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:09.467872 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet c248e8afdd4142d983c50c91087d8e01 with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:09.468947 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dc37ba667f048359988247ddb2d7f5b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:09.484169 16674 tablet_replica.cc:333] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:09.485548 16674 raft_consensus.cc:2243] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.486330 16674 raft_consensus.cc:2272] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.490411 16674 ts_tablet_manager.cc:1916] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:09.484313 15601 raft_consensus.cc:2955] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:09.585762 15640 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.14.41.126:40467, user_credentials={real_user=slave}} blocked reactor thread for 51082.9us
I20260709 13:17:09.624013 16674 ts_tablet_manager.cc:1929] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:09.630491 16674 log.cc:1199] T c248e8afdd4142d983c50c91087d8e01 P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/c248e8afdd4142d983c50c91087d8e01
I20260709 13:17:09.632292 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet c248e8afdd4142d983c50c91087d8e01 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:09.661463 15675 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.666922 16673 tablet_replica.cc:333] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:09.667922 16673 raft_consensus.cc:2243] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.668557 16673 raft_consensus.cc:2272] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.673707 16673 ts_tablet_manager.cc:1916] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:09.695413 16673 ts_tablet_manager.cc:1929] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:09.695915 16673 log.cc:1199] T 9dc37ba667f048359988247ddb2d7f5b P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/9dc37ba667f048359988247ddb2d7f5b
I20260709 13:17:09.701784 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 9dc37ba667f048359988247ddb2d7f5b (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:09.705988 15596 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:09.711196 16308 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.711807 15671 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:09.712713 16642 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.713587 16610 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:09.721583 16655 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.726434 16308 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.736508 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bea9d89f73eb4c36b8a8270cda937174 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:09.740634 15675 raft_consensus.cc:2955] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:09.743963 15496 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:09.766458 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet bea9d89f73eb4c36b8a8270cda937174 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:17:09.767493 16663 tablet_replica.cc:333] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:17:09.768774 16663 raft_consensus.cc:2243] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:09.769527 16663 raft_consensus.cc:2272] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:09.775247 16663 ts_tablet_manager.cc:1916] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:09.798615 16663 ts_tablet_manager.cc:1929] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:09.799002 16663 log.cc:1199] T bea9d89f73eb4c36b8a8270cda937174 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/bea9d89f73eb4c36b8a8270cda937174
I20260709 13:17:09.800637 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet bea9d89f73eb4c36b8a8270cda937174 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:10.860396 15746 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:17:10.867604 15716 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efe3434ebb0f4f6f9578442969e933e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:10.868310 15673 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:10.869113 15598 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:10.869890 16678 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:10.871083 16578 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.880439 16578 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.882324 15673 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.888545 15598 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.904691 15498 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.910849 15746 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:17:10.924057 15716 consensus_peers.cc:597] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cee88791b35487fb5b26c8d3d7ee6c8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:10.924649 15673 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:10.926375 16578 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.928078 15598 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:10.930245 16578 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:10.936254 16678 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.938097 15673 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.939971 15598 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.953956 15748 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:10.965747 15598 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:17:10.966691 15716 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e105ea6267284f22bdfda14678176b49. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:10.968397 15497 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:10.975181 16636 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:10.967504 15675 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:10.981947 16636 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:11.000310 16636 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:11.003741 15596 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:11.003877 15673 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:11.021075 15496 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:11.023229 15598 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.037037 15748 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:11.037184 15567 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e303011bed72412ab6f5eebf5a6de748. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:11.038694 16676 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:11.044950 15673 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:11.046924 16676 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:11.049623 16642 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:11.051990 15748 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:11.060987 15673 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:11.071362 15497 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.351886 16695 ts_tablet_manager.cc:933] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:11.356024 16695 tablet_copy_client.cc:323] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:11.358587 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 6cee88791b35487fb5b26c8d3d7ee6c8 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:11.359289 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 6cee88791b35487fb5b26c8d3d7ee6c8 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-6cee88791b35487fb5b26c8d3d7ee6c8
I20260709 13:17:11.371246 15761 tablet_copy_source_session.cc:215] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:11.374774 16695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cee88791b35487fb5b26c8d3d7ee6c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.392127 16695 tablet_copy_client.cc:806] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:11.392899 16695 tablet_copy_client.cc:670] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:11.397245 16695 tablet_copy_client.cc:538] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:11.408890 16695 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:11.438795 16695 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:11.440011 16695 tablet_bootstrap.cc:492] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:11.440836 16695 ts_tablet_manager.cc:1403] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.014s
I20260709 13:17:11.444324 16695 raft_consensus.cc:359] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.445386 16695 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:11.446662 16695 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.461227 16695 ts_tablet_manager.cc:1434] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 13:17:11.461968 16697 ts_tablet_manager.cc:933] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:11.465193 16699 ts_tablet_manager.cc:933] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:11.466398 16700 ts_tablet_manager.cc:933] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:11.472502 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-6cee88791b35487fb5b26c8d3d7ee6c8 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:11.473156 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-6cee88791b35487fb5b26c8d3d7ee6c8 on tablet 6cee88791b35487fb5b26c8d3d7ee6c8 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:11.494228 16699 tablet_copy_client.cc:323] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:11.494863 16697 tablet_copy_client.cc:323] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:11.496165 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet efe3434ebb0f4f6f9578442969e933e5 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:11.496371 16700 tablet_copy_client.cc:323] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:11.496767 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet efe3434ebb0f4f6f9578442969e933e5 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-efe3434ebb0f4f6f9578442969e933e5
I20260709 13:17:11.498154 15760 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet e105ea6267284f22bdfda14678176b49 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:11.498692 15760 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet e105ea6267284f22bdfda14678176b49 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-e105ea6267284f22bdfda14678176b49
I20260709 13:17:11.507066 15760 tablet_copy_source_session.cc:215] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:11.512982 16697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e105ea6267284f22bdfda14678176b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.513852 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet e303011bed72412ab6f5eebf5a6de748 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:11.514493 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet e303011bed72412ab6f5eebf5a6de748 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-e303011bed72412ab6f5eebf5a6de748
I20260709 13:17:11.524014 15612 tablet_copy_source_session.cc:215] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:11.530012 16700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e303011bed72412ab6f5eebf5a6de748. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.536284 15761 tablet_copy_source_session.cc:215] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:11.539948 16699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efe3434ebb0f4f6f9578442969e933e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:11.557792 16697 tablet_copy_client.cc:806] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:11.558422 16697 tablet_copy_client.cc:670] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:11.558815 16700 tablet_copy_client.cc:806] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:11.559387 16700 tablet_copy_client.cc:670] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:11.559645 16699 tablet_copy_client.cc:806] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:11.561414 16699 tablet_copy_client.cc:670] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:11.563273 16700 tablet_copy_client.cc:538] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:11.571358 16699 tablet_copy_client.cc:538] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:11.572835 16697 tablet_copy_client.cc:538] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:11.577582 16700 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:11.585414 16699 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:11.596437 16697 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:11.636713 16699 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:11.637145 16700 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:11.637760 16699 tablet_bootstrap.cc:492] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:11.638199 16700 tablet_bootstrap.cc:492] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:11.638562 16699 ts_tablet_manager.cc:1403] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.010s
I20260709 13:17:11.639252 16700 ts_tablet_manager.cc:1403] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.006s
I20260709 13:17:11.639675 16697 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:11.640755 16697 tablet_bootstrap.cc:492] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:11.644152 16697 ts_tablet_manager.cc:1403] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.049s	user 0.030s	sys 0.004s
I20260709 13:17:11.644697 16699 raft_consensus.cc:359] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.643198 16700 raft_consensus.cc:359] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.645642 16699 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:11.645792 16700 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:11.646411 16699 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.649595 16699 ts_tablet_manager.cc:1434] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:17:11.648196 16697 raft_consensus.cc:359] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.650543 16697 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:11.651242 16697 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.646517 16700 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:11.657272 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-efe3434ebb0f4f6f9578442969e933e5 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:11.657765 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-efe3434ebb0f4f6f9578442969e933e5 on tablet efe3434ebb0f4f6f9578442969e933e5 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:11.662099 16697 ts_tablet_manager.cc:1434] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:17:11.664811 16700 ts_tablet_manager.cc:1434] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 13:17:11.665932 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-e105ea6267284f22bdfda14678176b49 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:11.666442 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-e105ea6267284f22bdfda14678176b49 on tablet e105ea6267284f22bdfda14678176b49 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:11.667475 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-e303011bed72412ab6f5eebf5a6de748 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:11.667958 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-e303011bed72412ab6f5eebf5a6de748 on tablet e303011bed72412ab6f5eebf5a6de748 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:11.802484 16310 raft_consensus.cc:1217] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:17:11.899926 16308 raft_consensus.cc:1217] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:11.931505 16308 raft_consensus.cc:1217] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:11.994946 16308 raft_consensus.cc:1217] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:12.285063 16636 raft_consensus.cc:1064] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:12.286510 16578 raft_consensus.cc:1064] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:12.287287 16636 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.288849 16578 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.298394 16308 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:12.300550 16708 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:12.307475 15673 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:12.310950 15598 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:17:12.316262 15673 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.308425 16308 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.327499 16678 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:12.330420 16712 raft_consensus.cc:1064] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:12.331166 15598 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.333323 16712 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.343627 16713 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:12.346313 16578 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:12.348135 16678 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:12.349825 16578 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:12.353036 16306 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.355068 16712 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:12.362670 15675 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.380033 15596 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.383533 16578 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:12.387108 16713 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:12.402519 16712 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.404217 15598 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.417800 16676 raft_consensus.cc:1064] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:12.427546 16578 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.427819 16676 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.456202 16310 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.466073 16308 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.471648 15496 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.521522 15497 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.536862 16726 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:12.547326 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 70557.4us
I20260709 13:17:12.548744 15748 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.554869 15672 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:12.558714 16308 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:17:12.562963 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 86261.5us
I20260709 13:17:12.564930 16308 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.567365 16709 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:17:12.567468 15675 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.568696 16676 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:12.580099 16642 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:12.587313 15672 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.604758 15598 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.594424 15675 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.646710 15601 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.654060 16733 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.658458 16310 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.670321 15675 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.679970 15746 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.686028 15748 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.688539 16308 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:12.689677 15598 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:12.690379 16730 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:12.700282 16636 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.701385 15496 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.708771 16308 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.718572 16713 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:12.725638 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e105ea6267284f22bdfda14678176b49 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:12.725975 15497 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.748678 15500 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.734838 15601 raft_consensus.cc:2955] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.754603 15746 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.761353 16308 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:12.762226 15602 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:12.762809 16730 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:12.763799 16713 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:12.763926 15748 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.771596 16310 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:12.771850 15672 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:12.774410 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet e105ea6267284f22bdfda14678176b49 with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:12.774580 16713 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:12.775931 16726 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.776567 15602 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:12.782341 16713 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:12.786167 16730 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.790589 15672 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:12.796520 16308 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.798807 16733 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:12.805055 16310 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:12.804894 16306 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.808058 16731 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:12.819149 16709 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.822461 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efe3434ebb0f4f6f9578442969e933e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:12.823786 16742 tablet_replica.cc:333] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:12.825042 16742 raft_consensus.cc:2243] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:12.825863 16742 raft_consensus.cc:2272] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:12.827680 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6cee88791b35487fb5b26c8d3d7ee6c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:12.827157 15497 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.830065 16307 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.844583 15675 raft_consensus.cc:2955] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.848763 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet efe3434ebb0f4f6f9578442969e933e5 with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:12.856480 16742 ts_tablet_manager.cc:1916] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:12.855751 15497 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.858953 15498 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:12.863773 15601 raft_consensus.cc:2955] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.881949 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e303011bed72412ab6f5eebf5a6de748 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:12.896441 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet e303011bed72412ab6f5eebf5a6de748 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:17:12.904470 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cee88791b35487fb5b26c8d3d7ee6c8 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:12.907925 15672 raft_consensus.cc:2955] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:12.918346 16743 tablet_replica.cc:333] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:17:12.924672 16744 tablet_replica.cc:333] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:12.929859 16744 raft_consensus.cc:2243] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:12.940428 16744 raft_consensus.cc:2272] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:12.883639 16742 ts_tablet_manager.cc:1929] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:17:12.941418 16742 log.cc:1199] T e105ea6267284f22bdfda14678176b49 P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/e105ea6267284f22bdfda14678176b49
I20260709 13:17:12.943481 16742 tablet_replica.cc:333] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:12.944020 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet e105ea6267284f22bdfda14678176b49 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:12.946098 16744 ts_tablet_manager.cc:1916] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:12.948503 16742 raft_consensus.cc:2243] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:12.949229 16742 raft_consensus.cc:2272] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:12.952721 16742 ts_tablet_manager.cc:1916] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:12.955217 16743 raft_consensus.cc:2243] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:12.956066 16743 raft_consensus.cc:2272] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:12.959324 16743 ts_tablet_manager.cc:1916] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:12.965088 16744 ts_tablet_manager.cc:1929] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:12.965720 16744 log.cc:1199] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/6cee88791b35487fb5b26c8d3d7ee6c8
I20260709 13:17:12.967749 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 6cee88791b35487fb5b26c8d3d7ee6c8 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:12.968784 16742 ts_tablet_manager.cc:1929] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:12.969195 16742 log.cc:1199] T efe3434ebb0f4f6f9578442969e933e5 P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/efe3434ebb0f4f6f9578442969e933e5
I20260709 13:17:12.970661 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet efe3434ebb0f4f6f9578442969e933e5 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:12.976148 16743 ts_tablet_manager.cc:1929] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:12.976799 16743 log.cc:1199] T e303011bed72412ab6f5eebf5a6de748 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/e303011bed72412ab6f5eebf5a6de748
I20260709 13:17:12.979197 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet e303011bed72412ab6f5eebf5a6de748 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:13.912091 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:14.042250 15673 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.056394 15746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:14.057583 15746 raft_consensus.cc:606] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:14.060731 15746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:14.062615 15746 raft_consensus.cc:606] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:14.063319 15745 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:14.064311 15602 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:14.064800 15642 consensus_peers.cc:597] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 889d20b228a74f7abdc0104e2529c28d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:14.066444 16721 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:14.072739 16644 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:14.079234 16745 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.081179 15602 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.090309 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:14.090943 15601 raft_consensus.cc:606] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:14.092072 15745 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.093806 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:14.094374 15748 raft_consensus.cc:606] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:14.099988 15496 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.102684 15673 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.118808 15672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:14.119419 15672 raft_consensus.cc:606] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:14.122140 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:14.122871 15748 raft_consensus.cc:606] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:14.123420 16745 raft_consensus.cc:993] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:14.125082 16745 raft_consensus.cc:1081] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:14.125761 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:14.126353 15748 raft_consensus.cc:606] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:14.126896 15746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48728
I20260709 13:17:14.127441 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:17:14.127543 15746 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.127951 15746 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.132407 15601 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:14.133824 15748 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:14.134930 16721 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:14.137830 16713 raft_consensus.cc:993] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:14.138413 16713 raft_consensus.cc:1081] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:14.141911 15746 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.142217 16306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:17:14.143040 16306 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:17:14.143200 15642 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 29bae97aafa2447892a23984cd26cd90. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:14.143406 16306 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.145582 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:14.148633 16721 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:14.155699 15746 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:14.153491 16306 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.159231 16747 raft_consensus.cc:993] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:14.159727 16747 raft_consensus.cc:1081] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:14.161223 16306 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:14.162925 16307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:17:14.163499 16307 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.163524 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:14.163975 16307 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.164275 15602 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.165165 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:14.165948 15671 raft_consensus.cc:3055] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.166294 15671 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:14.167344 15671 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.170727 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:14.171387 15746 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.174564 15746 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:14.171334 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:14.175518 15672 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.176551 15671 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.176563 15746 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.178037 15746 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.174139 15602 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:14.180197 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:14.181208 16713 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.181918 16713 raft_consensus.cc:697] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:14.183190 16713 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.185809 16307 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.186463 15746 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:14.189752 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:14.190567 15677 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.191812 16307 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:14.195552 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:14.196246 15746 raft_consensus.cc:3055] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.196188 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:14.196938 15746 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:14.197965 15746 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.198726 16761 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.200448 15746 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.199257 16721 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.202335 15602 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.217029 16761 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:14.217851 15746 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:14.218616 16761 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:14.220016 16757 log.cc:927] Time spent T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:17:14.220896 15671 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:14.221743 15677 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:14.222416 16265 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:14.231212 16762 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.235332 15672 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:14.239418 15602 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.245249 16762 raft_consensus.cc:697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:14.246618 16762 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.250864 15748 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.280994 15672 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:14.282529 16747 raft_consensus.cc:993] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:14.283052 16747 raft_consensus.cc:1081] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:14.284687 16307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:17:14.285255 16307 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.285724 16307 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.283089 16746 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:17:14.288627 15567 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee9f9791071f42759780d6353d07808d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:14.295099 15748 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:14.299058 16655 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:14.304886 16307 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.304697 15500 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.317263 15498 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.307505 16307 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:14.311545 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:14.312678 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:14.329018 15598 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.328400 15746 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.334125 15746 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:14.335500 15746 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.338797 16747 raft_consensus.cc:993] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:14.340333 16713 raft_consensus.cc:1081] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:14.340788 15746 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.344110 15671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:14.344899 15671 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.345259 15671 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.347729 15746 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:14.348170 15598 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:14.349210 16263 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:14.350597 16762 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.351076 16762 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:14.351933 16762 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:14.356177 16746 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.362958 15671 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.366058 15672 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.369411 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:14.370122 15602 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.371812 15497 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.382068 15671 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:14.386144 15602 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:14.389150 15677 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.390970 15640 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:14.393812 16644 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.394297 16644 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:14.393630 15497 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.395045 16644 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.391718 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:14.400018 15746 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.401824 15746 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:14.402704 15746 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.404974 15746 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.412688 15496 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.415498 15496 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.418497 15748 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.419962 15746 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:14.422714 16747 raft_consensus.cc:993] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:14.440789 15598 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:14.444237 15642 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b171707a6f8e44b7a4f81ef5fbf30230. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:14.444294 16644 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:14.445628 16713 raft_consensus.cc:1081] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:14.452224 15497 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.456173 15745 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:14.460711 15672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:14.461328 15672 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.461673 15672 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.463653 16746 raft_consensus.cc:993] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:14.464666 16733 raft_consensus.cc:1081] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:14.468227 15745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:14.468879 15745 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:14.469296 15745 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.474463 16644 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:14.480753 16721 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.483331 15745 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.482771 15598 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.490363 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:14.490979 15602 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.491293 15602 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:14.492017 15602 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.493161 15602 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.494757 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:14.495296 15677 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.480229 15672 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.502128 15602 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:14.503322 15677 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:14.492020 15745 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:14.506228 15672 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:14.507198 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:14.509747 16713 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.510604 16713 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:14.511624 16713 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.509709 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:14.517349 15748 raft_consensus.cc:3055] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:14.518688 15748 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:14.522419 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:14.523077 15598 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.519937 15748 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.524168 15748 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:14.526043 15498 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.535559 15598 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:14.537709 15748 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:14.538022 15640 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:14.538926 16745 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:14.539487 16745 raft_consensus.cc:697] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:14.540735 16745 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:14.547987 15496 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:14.553452 16778 ts_tablet_manager.cc:933] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:14.548026 15748 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:14.569591 16778 tablet_copy_client.cc:323] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:17:14.573832 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet 29bae97aafa2447892a23984cd26cd90 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:17:14.574601 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet 29bae97aafa2447892a23984cd26cd90 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-29bae97aafa2447892a23984cd26cd90
I20260709 13:17:14.586717 15687 tablet_copy_source_session.cc:215] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:14.587123 15498 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.591526 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29bae97aafa2447892a23984cd26cd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:14.609694 16778 tablet_copy_client.cc:806] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:14.610376 16778 tablet_copy_client.cc:670] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:14.615361 15602 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:14.616809 16713 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.626564 16778 tablet_copy_client.cc:538] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:17:14.639147 15716 consensus_peers.cc:597] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 889d20b228a74f7abdc0104e2529c28d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:14.642175 15677 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:14.641357 16778 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:14.644063 16747 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:14.658819 15748 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:14.660385 16762 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:14.669855 15672 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:14.671543 16761 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.686700 15746 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:14.688656 16762 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.720402 16778 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:14.724236 16778 tablet_bootstrap.cc:492] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:14.725098 16778 ts_tablet_manager.cc:1403] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.008s
I20260709 13:17:14.728470 16778 raft_consensus.cc:359] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.731583 16778 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:14.732718 16778 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.740830 15677 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:14.742964 16778 ts_tablet_manager.cc:1434] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:17:14.750448 16761 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.750952 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-29bae97aafa2447892a23984cd26cd90 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:14.751451 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-29bae97aafa2447892a23984cd26cd90 on tablet 29bae97aafa2447892a23984cd26cd90 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:14.754769 16778 ts_tablet_manager.cc:933] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:14.786748 16778 tablet_copy_client.cc:323] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:14.789499 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet ee9f9791071f42759780d6353d07808d from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:14.790088 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet ee9f9791071f42759780d6353d07808d from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-ee9f9791071f42759780d6353d07808d
I20260709 13:17:14.802116 15612 tablet_copy_source_session.cc:215] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:14.805145 16778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9f9791071f42759780d6353d07808d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:14.805871 15598 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:14.807715 16765 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.821811 16778 tablet_copy_client.cc:806] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:14.822710 16778 tablet_copy_client.cc:670] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:14.832170 15746 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:14.834340 16761 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.851130 16778 tablet_copy_client.cc:538] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:14.861714 16790 ts_tablet_manager.cc:933] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:14.864176 16778 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:14.868259 16790 tablet_copy_client.cc:323] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:17:14.872226 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet b171707a6f8e44b7a4f81ef5fbf30230 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:17:14.872854 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet b171707a6f8e44b7a4f81ef5fbf30230 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-b171707a6f8e44b7a4f81ef5fbf30230
I20260709 13:17:14.884902 15598 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:14.886919 16644 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:14.891626 15687 tablet_copy_source_session.cc:215] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:14.902701 16790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b171707a6f8e44b7a4f81ef5fbf30230. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:14.912696 15748 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:14.922415 16745 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:14.952212 16778 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:14.961946 16778 tablet_bootstrap.cc:492] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:14.962715 16778 ts_tablet_manager.cc:1403] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.099s	user 0.032s	sys 0.032s
I20260709 13:17:14.965746 16778 raft_consensus.cc:359] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.966640 16778 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:14.967339 16778 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:14.969935 16778 ts_tablet_manager.cc:1434] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:17:14.974979 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-ee9f9791071f42759780d6353d07808d received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:14.975448 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-ee9f9791071f42759780d6353d07808d on tablet ee9f9791071f42759780d6353d07808d with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:14.983628 16790 tablet_copy_client.cc:806] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:14.986318 16790 tablet_copy_client.cc:670] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:14.990806 16790 tablet_copy_client.cc:538] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:14.998390 16307 raft_consensus.cc:1217] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:15.016094 16790 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:15.047331 16790 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:15.048089 16790 tablet_bootstrap.cc:492] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:15.048727 16790 ts_tablet_manager.cc:1403] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.010s
I20260709 13:17:15.051185 16790 raft_consensus.cc:359] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:15.052026 16790 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:15.052709 16790 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:15.055750 16790 ts_tablet_manager.cc:1434] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:15.059952 15598 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:15.061581 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-b171707a6f8e44b7a4f81ef5fbf30230 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:15.062016 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-b171707a6f8e44b7a4f81ef5fbf30230 on tablet b171707a6f8e44b7a4f81ef5fbf30230 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:15.068637 16721 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:15.083190 16790 ts_tablet_manager.cc:933] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:15.093130 15746 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:15.094816 16790 tablet_copy_client.cc:323] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:15.095995 15672 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:15.097914 16730 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:15.100495 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 889d20b228a74f7abdc0104e2529c28d from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:15.101061 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 889d20b228a74f7abdc0104e2529c28d from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-889d20b228a74f7abdc0104e2529c28d
I20260709 13:17:15.105006 15596 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:15.106407 16758 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:15.111282 16713 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:15.132087 15761 tablet_copy_source_session.cc:215] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:15.143245 16790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 889d20b228a74f7abdc0104e2529c28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:15.148924 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:15.183262 16790 tablet_copy_client.cc:806] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:15.183946 16790 tablet_copy_client.cc:670] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:15.188781 16790 tablet_copy_client.cc:538] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:15.218726 16790 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:15.246505 16790 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:15.247313 16790 tablet_bootstrap.cc:492] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:15.247920 16790 ts_tablet_manager.cc:1403] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.008s
I20260709 13:17:15.250638 16790 raft_consensus.cc:359] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:15.252009 16790 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:15.252775 16790 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:15.255311 16790 ts_tablet_manager.cc:1434] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:17:15.257550 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-889d20b228a74f7abdc0104e2529c28d received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:15.258013 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-889d20b228a74f7abdc0104e2529c28d on tablet 889d20b228a74f7abdc0104e2529c28d with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:15.271550 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:15.291709 16306 raft_consensus.cc:1217] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:15.324360 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:15.325029 15748 raft_consensus.cc:606] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:15.328698 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:15.329291 15598 raft_consensus.cc:606] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:15.332798 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:15.333371 15598 raft_consensus.cc:606] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:15.335793 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9f9791071f42759780d6353d07808d"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:15.336328 15598 raft_consensus.cc:606] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:15.338908 15673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:15.339442 15673 raft_consensus.cc:606] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:15.341922 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:15.342602 15748 raft_consensus.cc:606] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:15.343698 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:15.345295 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:15.349277 16800 raft_consensus.cc:993] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:15.349908 16800 raft_consensus.cc:1081] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:15.352216 15748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee9f9791071f42759780d6353d07808d"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:15.352985 15748 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.356483 15748 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.368978 15748 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:15.373071 15748 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:15.374711 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:15.375231 15672 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.381232 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:15.381927 15598 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:15.382197 15598 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:15.382967 15598 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:15.384186 15598 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.390506 15672 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:15.391462 15598 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:15.391918 15714 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:15.392704 16713 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:15.393201 16713 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:15.394130 16713 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:15.404377 15497 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.435344 16306 raft_consensus.cc:1217] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:15.445075 16655 raft_consensus.cc:993] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:15.445582 16733 raft_consensus.cc:1081] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:15.448325 16306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:36520
I20260709 13:17:15.449028 16306 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.451639 16306 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.457167 16306 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.459025 16306 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:15.460011 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:15.460637 15598 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:15.460989 15598 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:15.460637 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:15.461583 15672 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.461833 15598 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.463035 15598 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.469017 15598 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:15.470189 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:15.471055 16761 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:15.471515 16761 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:15.473045 16761 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.476383 15672 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:15.486941 16758 raft_consensus.cc:1064] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:15.496968 15497 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.501606 16758 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.524154 16713 raft_consensus.cc:993] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:15.524691 16747 raft_consensus.cc:1081] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:15.526552 15673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:15.527180 15673 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.527523 15673 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.546382 15673 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:15.549050 15673 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:15.551600 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:15.551819 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:15.552202 15748 raft_consensus.cc:3055] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:15.552404 15596 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.552585 15748 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:15.553835 15748 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:15.554937 15748 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.558877 15596 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:15.560323 15640 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:15.561195 16644 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:15.561515 15746 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:15.561666 16644 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:15.562472 16644 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:15.560313 16306 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:15.564546 16745 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:15.566331 16758 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:15.572821 15748 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:15.579486 15596 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:15.588725 16721 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:15.587653 16745 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:15.590031 15748 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:15.601387 16306 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:15.600953 15497 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:15.615151 15596 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:15.622547 15497 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:15.693722 16306 raft_consensus.cc:1217] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:15.726902 16745 raft_consensus.cc:993] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:15.727392 16745 raft_consensus.cc:1081] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:15.729141 16306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:36530
I20260709 13:17:15.729725 16306 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.730077 16306 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.733995 16747 raft_consensus.cc:993] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:15.734532 16747 raft_consensus.cc:1081] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:15.736877 16307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:17:15.739323 16307 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.739792 16307 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.741122 16306 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.743949 16306 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:15.744311 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:15.745029 15746 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.743988 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:15.747865 15673 raft_consensus.cc:3055] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:15.748152 15673 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:15.748920 15673 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.749964 15673 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.752095 15746 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:15.753480 16265 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:15.754525 16761 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:15.756023 16761 raft_consensus.cc:697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:15.757014 16761 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.757477 15673 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:15.757682 16655 raft_consensus.cc:993] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:15.761278 16655 raft_consensus.cc:1081] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:15.746681 16307 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.764966 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:15.765568 15596 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.766052 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:15.766633 15746 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:15.766907 15746 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:15.767822 15746 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.769120 15746 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.769277 15748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:15.769836 15748 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.770169 15748 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.778070 15596 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:15.764489 16307 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:15.779320 16263 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:15.780194 16807 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:15.783278 15748 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:15.787225 15746 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:15.789796 15748 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:15.792394 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:15.792985 15596 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:15.793263 15596 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:15.793977 15596 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:15.795265 15596 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.796144 15672 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:15.801388 16747 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:15.803416 16807 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:15.804510 16807 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.806236 15596 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:15.806396 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:15.807765 15673 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:15.814951 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:15.816347 16747 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:15.817157 16747 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:15.819881 15497 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.836349 16747 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:15.844084 15673 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:15.847537 15497 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:15.900942 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 72574.6us
I20260709 13:17:15.906401 16307 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Advancing to term 2
I20260709 13:17:15.909916 15601 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:15.910591 15673 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:15.911656 16713 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:15.912889 16761 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:15.917831 15498 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:15.931839 16307 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:15.949368 16747 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:15.986435 15601 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:15.989617 16730 raft_consensus.cc:1064] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:15.990664 16818 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:15.991860 16730 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:15.997311 16644 raft_consensus.cc:1064] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:15.999365 16306 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:16.003979 16747 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:15.999460 16644 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:16.031785 15602 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:16.036172 16730 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:16.043191 15672 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:17:16.061410 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 44944.5us
I20260709 13:17:16.065531 16730 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:16.074460 15598 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:16.076869 15746 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:16.085961 16758 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:16.085258 16713 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.087405 15672 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:16.090518 16838 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:16.093124 16307 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:16.098678 16306 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:16.100409 16827 raft_consensus.cc:1064] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:16.111446 15746 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:16.117301 16838 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:16.119637 15602 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:16.107522 16827 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:16.123348 15602 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:16.123669 16838 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:16.125245 16837 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:16.133025 16834 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:16.138674 16308 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.140105 15602 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.175441 16308 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:16.138729 16834 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.282486 16730 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:16.286229 15672 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.280114 15497 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:16.301009 16839 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:17:16.302526 16830 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:17:16.313261 15673 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:16.325565 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 29bae97aafa2447892a23984cd26cd90 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:16.328625 16713 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:16.333986 16306 raft_consensus.cc:2955] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.329751 15602 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.348703 16841 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.350328 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:16.338212 16844 log.cc:927] Time spent T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:17:16.368927 15602 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:16.387815 15677 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:16.395236 15602 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:16.363710 15749 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:16.404505 16816 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.141s	user 0.003s	sys 0.000s
I20260709 13:17:16.409739 15751 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:16.435467 15748 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:16.442777 16730 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:16.448479 16824 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:16.440421 16818 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:17:16.504832 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 82194.5us
I20260709 13:17:16.511292 15596 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.509493 15498 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.518751 15602 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:16.569948 15677 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:16.507637 16807 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:17:16.583608 16849 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 13:17:16.585131 16849 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:16.596717 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 61715us
W20260709 13:17:16.638248 16851 log.cc:927] Time spent T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:17:16.666291 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 243656us
I20260709 13:17:16.670724 16747 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:16.745064 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 112056us
I20260709 13:17:16.750211 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:16.751448 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 55768.4us
W20260709 13:17:16.825754 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 43841.3us
I20260709 13:17:16.882072 16310 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:16.898504 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 135646us
I20260709 13:17:16.848400 16822 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:16.963377 16310 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.027410 15596 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:17.112113 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 148842us
W20260709 13:17:17.115127 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 91736.5us
W20260709 13:17:17.271171 16880 log.cc:927] Time spent T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:17:17.279462 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 44899.7us
I20260709 13:17:17.330770 15670 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:17.456766 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 138959us
I20260709 13:17:17.475999 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
W20260709 13:17:17.477458 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 192029us
I20260709 13:17:17.501607 15748 raft_consensus.cc:606] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:17.518990 15670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:17.519860 15670 raft_consensus.cc:606] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:17.522979 15498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 225) took 1260 ms. Trace:
I20260709 13:17:17.526144 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:17.526770 15598 raft_consensus.cc:606] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:17.530898 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "958e81841a784ee79fccc9f488562c59"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:17.532008 15598 raft_consensus.cc:606] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:17.535840 15600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:17.536461 15600 raft_consensus.cc:606] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:17.543733 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9f9791071f42759780d6353d07808d"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:17.544468 15748 raft_consensus.cc:606] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:17.549237 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:17.550913 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:17.558182 15500 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.560891 15500 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.523490 15498 rpcz_store.cc:276] 0709 13:17:16.262679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.262816 (+   137us) service_pool.cc:224] Handling call
0709 13:17:17.522890 (+1260074us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:16.927508 (+     0us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b54003e4d28. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf04aac9e1 00007faf04aab64c 00007faf0213aadc 00007faf021260a6 00007faf02125d58 00007faf0212a9f1 00007faf0212a9a9 00007faf0212a939 00007faf0212a901 00007faf02129b2d 000000000038f354
0709 13:17:16.927585 (+    77us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:16.928099 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:16.928127 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:17:16.928140 (+    13us) tablet.cc:662] Decoding operations
0709 13:17:16.928461 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:16.928511 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:16.928535 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:16.928738 (+   203us) tablet.cc:701] Row locks acquired
0709 13:17:16.928759 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:16.928902 (+   143us) write_op.cc:270] Start()
0709 13:17:16.929087 (+   185us) write_op.cc:276] Timestamp: P: 1783603036928862 usec, L: 0
0709 13:17:16.929107 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:16.929672 (+   565us) log.cc:844] Serialized 533 byte log entry
0709 13:17:17.167825 (+238153us) op_driver.cc:464] REPLICATION: finished
0709 13:17:17.450421 (+282596us) write_op.cc:301] APPLY: starting
0709 13:17:17.450505 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:17.450609 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:17.450630 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:17.450901 (+   271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:17.451064 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:17.451107 (+    43us) write_op.cc:312] APPLY: finished
0709 13:17:17.459107 (+  8000us) log.cc:844] Serialized 23 byte log entry
0709 13:17:17.464890 (+  5783us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:17.466490 (+  1600us) write_op.cc:454] Released schema lock
0709 13:17:17.466538 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:17.478788 (+ 12250us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:17.479987 (+  1199us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115571,"reported_tablets":2,"spinlock_wait_cycles":1962240,"child_traces":[["op",{"apply.queue_time_us":276251,"apply.run_cpu_time_us":1904,"apply.run_wall_time_us":23820,"num_ops":1,"prepare.queue_time_us":4058,"prepare.run_cpu_time_us":6592,"prepare.run_wall_time_us":348407,"replication_time_us":220681,"spinlock_wait_cycles":2922240,"thread_start_us":143891,"threads_started":1}]]}
I20260709 13:17:17.578070 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet 29bae97aafa2447892a23984cd26cd90 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
W20260709 13:17:17.584059 15486 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 1 similar messages]
I20260709 13:17:17.589864 16900 tablet_replica.cc:333] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:17:17.591073 16900 raft_consensus.cc:2243] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.591802 16900 raft_consensus.cc:2272] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.595110 16900 ts_tablet_manager.cc:1916] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:17.621068 16856 raft_consensus.cc:993] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:17.621655 16856 raft_consensus.cc:1081] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:17.625069 16310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "958e81841a784ee79fccc9f488562c59"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:36520
I20260709 13:17:17.625633 16310 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:17.625983 16310 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.629251 16900 ts_tablet_manager.cc:1929] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:17:17.629343 15486 catalog_manager.cc:4755] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): ChangeConfig:REMOVE_PEER RPC failed for tablet ee9f9791071f42759780d6353d07808d: Remote error: Service unavailable: leader transfer in progress
I20260709 13:17:17.630890 16900 log.cc:1199] T 29bae97aafa2447892a23984cd26cd90 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/29bae97aafa2447892a23984cd26cd90
I20260709 13:17:17.632543 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet 29bae97aafa2447892a23984cd26cd90 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:17.634338 16310 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.646584 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:17.647267 15598 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:17.647568 15598 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:17.647604 16655 raft_consensus.cc:993] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:17.648443 16655 raft_consensus.cc:1081] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:17.648296 15598 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.649246 15598 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.651469 15744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:17.651744 16875 raft_consensus.cc:993] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:17.652065 15744 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:17.652204 16875 raft_consensus.cc:1081] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:17.652459 15744 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.658627 15598 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:17.671190 16307 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee9f9791071f42759780d6353d07808d"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:17:17.671757 16307 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:17.672081 16307 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.678789 16310 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:17.683115 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:17.683692 15675 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.690466 15675 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:17.691684 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:17.691767 16307 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.692551 16807 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:17.693089 16807 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:17.693953 16807 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.700584 15744 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.702720 15744 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:17.703990 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:17.704792 15675 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.712477 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:17.713147 15670 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.714077 16307 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:17.715453 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:17.716099 15600 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.716797 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:17.717357 15748 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:17.717638 15748 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:17.718444 15748 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.719859 15748 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.724984 15673 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.725325 15742 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.728720 15600 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:17.731151 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:17.731949 15595 raft_consensus.cc:3055] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:17.732298 15595 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:17.733125 15595 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.734251 15595 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:17.737922 15672 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:17.742740 16875 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:17.743324 15748 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:17.747880 15486 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ee9f9791071f42759780d6353d07808d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5433f0c9863e427d88ba5916819e28e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.748375 15595 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:17.751822 16307 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:17.755499 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:17.755087 15498 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.757274 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:17.755602 16875 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:17:17.757941 16807 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:17.758200 16898 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:17.761051 16898 raft_consensus.cc:697] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:17.762744 16898 consensus_queue.cc:237] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.763480 16730 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.760987 16807 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:17.766847 16807 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:17.768649 16307 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.769469 16310 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.770219 16859 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:17.773037 15673 raft_consensus.cc:2955] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.777707 16721 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.781445 16306 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.793326 15670 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:17.800225 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 889d20b228a74f7abdc0104e2529c28d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:17.802688 15598 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:17.803830 15498 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 3 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.796119 15675 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:17.818492 15676 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:17.823246 16837 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.856868 15500 catalog_manager.cc:5697] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.861622 16839 raft_consensus.cc:993] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:17.862362 16839 raft_consensus.cc:1081] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:17.864945 15744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48728
I20260709 13:17:17.865617 15744 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:17.867431 15744 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.869143 15595 raft_consensus.cc:2955] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:17.882655 15500 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:17.892814 16876 raft_consensus.cc:993] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:17.896394 16876 raft_consensus.cc:1081] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:17.893970 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b171707a6f8e44b7a4f81ef5fbf30230 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:17.897408 15744 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.898451 15675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:17.899173 15675 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:17.888551 15498 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 4, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.903216 15675 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.908414 15675 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.926945 15675 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:17.928510 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:17.929096 15748 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:17.929384 15748 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:17.930068 15748 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.930574 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:17.931145 15598 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.931516 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 889d20b228a74f7abdc0104e2529c28d with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:17.940661 15748 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.944128 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:17.944849 15595 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.949709 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:17.950363 15673 raft_consensus.cc:3055] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:17.950693 15673 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:17.951387 15673 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.952385 15673 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:17.953034 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet b171707a6f8e44b7a4f81ef5fbf30230 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48722
I20260709 13:17:17.953838 15748 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:17.954066 16900 tablet_replica.cc:333] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:17:17.955238 16900 raft_consensus.cc:2243] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.956074 16900 raft_consensus.cc:2272] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:17.962410 15595 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:17.962972 16910 tablet_replica.cc:333] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:17.964712 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:17.964816 15598 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:17.965564 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:17.971709 16910 raft_consensus.cc:2243] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:17.984946 16876 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:17.985057 15673 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:17.985522 16876 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:17.949864 15744 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:17.981001 16900 ts_tablet_manager.cc:1916] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:17.976406 16837 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:17.986647 16837 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:17.986374 16876 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:17.987505 16837 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:18.023233 16910 raft_consensus.cc:2272] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.039031 15500 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 3, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.047744 16910 ts_tablet_manager.cc:1916] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:18.061606 16868 raft_consensus.cc:993] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:18.064908 16868 raft_consensus.cc:1081] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:18.066593 16306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:36520
I20260709 13:17:18.067214 16306 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:18.067617 16306 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.079708 16306 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:18.082604 16910 ts_tablet_manager.cc:1929] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:18.101094 16910 log.cc:1199] T 889d20b228a74f7abdc0104e2529c28d P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/889d20b228a74f7abdc0104e2529c28d
I20260709 13:17:18.103426 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 889d20b228a74f7abdc0104e2529c28d (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:18.107784 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:18.108512 15670 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.106818 16306 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:18.113992 15500 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.115875 15670 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:18.117659 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:18.117971 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:18.118582 15601 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:18.119019 15601 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:18.119642 15601 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:18.118618 16849 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:18.121285 16849 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:18.122179 16849 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:18.122942 16900 ts_tablet_manager.cc:1929] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:18.123369 16900 log.cc:1199] T b171707a6f8e44b7a4f81ef5fbf30230 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/b171707a6f8e44b7a4f81ef5fbf30230
I20260709 13:17:18.127794 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet b171707a6f8e44b7a4f81ef5fbf30230 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:18.120453 15601 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.145553 15601 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:18.149960 15595 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:18.153028 16876 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:18.154013 15500 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:18.197710 15670 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:18.199146 16876 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:18.201052 15601 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:18.215293 16849 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:18.219844 15601 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:18.225521 16849 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:18.237960 15676 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:18.239625 16849 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:18.312319 15670 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:18.313781 16807 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:18.335395 15748 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:18.337365 16849 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:18.412427 16306 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:18.418501 15744 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:18.418661 15601 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:18.419950 16807 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:18.420588 16849 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:18.427317 16885 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:18.430469 15598 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:18.433852 15744 raft_consensus.cc:2955] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 4 to 6, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:18.436458 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee9f9791071f42759780d6353d07808d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 13:17:18.447433 15500 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 4 to 6, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 3 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:18.465034 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet ee9f9791071f42759780d6353d07808d with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:18.489624 16924 tablet_replica.cc:333] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:18.490906 16924 raft_consensus.cc:2243] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:18.491757 16924 raft_consensus.cc:2272] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:18.495289 16924 ts_tablet_manager.cc:1916] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:18.506222 16924 ts_tablet_manager.cc:1929] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:17:18.506570 16924 log.cc:1199] T ee9f9791071f42759780d6353d07808d P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/ee9f9791071f42759780d6353d07808d
I20260709 13:17:18.507978 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet ee9f9791071f42759780d6353d07808d (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:18.529316 15748 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.531366 16839 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:18.535076 15676 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.536432 16822 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:18.543262 15598 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.544946 16840 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:18.549299 15670 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:18.551878 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:18.552150 16807 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:18.567611 15601 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:18.574631 15601 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:18.575799 16807 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:18.584530 16898 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:18.622083 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:18.676946 15675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:18.677472 15675 raft_consensus.cc:606] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:18.680151 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:18.680673 15748 raft_consensus.cc:606] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:18.683025 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:18.683506 15748 raft_consensus.cc:606] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:18.685935 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:18.686432 15595 raft_consensus.cc:606] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:18.687532 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:18.688649 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:18.759985 16868 raft_consensus.cc:993] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:18.760538 16855 raft_consensus.cc:1081] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:18.762120 15748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:18.762674 15748 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:18.763033 15748 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.767642 15748 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:18.769498 15748 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:18.770349 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:18.770545 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:18.771086 15595 raft_consensus.cc:3055] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:18.771155 16306 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.771586 15595 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:18.772545 15595 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:18.774016 15595 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.782261 16306 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:18.783404 15716 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:18.784098 16730 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:18.784492 16730 raft_consensus.cc:697] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:18.785262 16730 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:18.786993 15595 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:18.795251 15498 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:18.941715 16898 raft_consensus.cc:993] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:18.942251 16898 raft_consensus.cc:1081] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:18.943935 15595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:51472
I20260709 13:17:18.944626 15595 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:18.944978 15595 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.950497 15595 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:18.953442 15595 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:18.953647 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:18.954278 15742 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:18.954617 15742 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:18.955125 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:18.955894 15675 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.955461 15742 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:18.957778 15742 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:18.962767 15675 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:18.964468 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:18.965520 16855 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:18.965763 15742 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:18.966112 16855 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:18.967262 16855 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:18.980374 15498 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.090669 16822 raft_consensus.cc:993] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:19.091176 16898 raft_consensus.cc:1081] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:19.092739 16306 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:17:19.093232 16306 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:19.093520 16306 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.098098 16306 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:19.101233 16306 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:19.101106 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:19.101428 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:19.101908 15676 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.102042 15748 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:19.102594 15748 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:19.103353 15748 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:19.104743 15748 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:19.109125 15676 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:19.110626 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:19.111786 15748 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:19.111678 16807 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:19.112648 16807 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:19.113562 16807 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:19.121856 15498 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:19.143076 16840 raft_consensus.cc:993] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: : Instructing follower 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:19.143563 16934 raft_consensus.cc:1081] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Signalling peer 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:19.145164 15595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:51468
I20260709 13:17:19.145732 15595 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:19.146152 15595 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:19.151659 15595 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:19.153842 15595 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:19.173385 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:19.174130 15675 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:19.174492 15675 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:19.176258 15675 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:19.177242 15675 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:19.178941 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:19.179502 15748 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:19.191663 15748 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:19.193491 15675 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:19.195003 15567 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:19.196748 16935 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:19.197340 16935 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:19.198201 16935 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:19.209280 15496 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 3 to 4, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.376772 16307 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:19.377929 16730 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:19.392014 15601 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:19.393630 16730 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:19.537653 15675 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:19.544843 15748 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:19.545660 15642 consensus_peers.cc:597] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1e65bafed7145eb85b802c6c68a9129. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.546334 15601 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.546650 16934 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.547345 15675 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:19.548162 16840 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:19.552489 16855 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.552699 15744 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:19.557550 16935 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.562803 15676 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:19.567571 16885 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:19.592103 16840 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.610251 15748 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:19.613685 16857 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:19.615895 15746 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.621559 15748 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:19.633778 15601 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.649142 15672 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:19.654965 16855 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:19.665887 15674 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.666213 15601 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:19.666579 15716 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 473662f2d754459c9d26a0322ab3531a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.655591 15497 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.667517 16730 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.670622 15748 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:19.671284 16730 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.674155 16935 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:19.693117 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:19.696146 16898 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.709637 15600 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.726049 15601 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:19.732232 15672 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.743489 15496 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.751937 15748 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.753785 15670 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.762390 16935 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:17:19.754920 15567 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 534cd68adf1a448ba243ff66d1dcd5da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.764515 16935 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.776088 16935 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.785248 15746 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.793111 15748 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:19.802606 15497 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.821277 15676 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:17:19.836186 15716 consensus_peers.cc:597] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6556ac1ec52640c3bad0bf13607c8d19. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:19.836277 15672 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.838094 15600 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:19.839820 16898 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.838336 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:19.847141 16898 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:19.885905 16898 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.887871 15672 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.891706 15600 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:19.914446 15500 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:19.943606 15600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:19.944259 15600 raft_consensus.cc:606] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:19.947363 15670 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:19.947878 15670 raft_consensus.cc:606] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:19.950855 15746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:19.951336 15746 raft_consensus.cc:606] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:19.952486 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:19.954053 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:19.961575 16965 ts_tablet_manager.cc:933] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:19.963603 16965 tablet_copy_client.cc:323] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:17:19.965559 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet e1e65bafed7145eb85b802c6c68a9129 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:17:19.966148 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet e1e65bafed7145eb85b802c6c68a9129 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-e1e65bafed7145eb85b802c6c68a9129
I20260709 13:17:19.971274 15687 tablet_copy_source_session.cc:215] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:19.974306 16965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e65bafed7145eb85b802c6c68a9129. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:19.986130 16965 tablet_copy_client.cc:806] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:19.986708 16965 tablet_copy_client.cc:670] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:19.992110 16965 tablet_copy_client.cc:538] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:20.001271 16965 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:20.020541 16965 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:20.021656 16965 tablet_bootstrap.cc:492] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:20.022524 16965 ts_tablet_manager.cc:1403] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:17:20.025465 16965 raft_consensus.cc:359] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.026124 16965 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:20.026757 16965 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.029722 16965 ts_tablet_manager.cc:1434] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:17:20.031808 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-e1e65bafed7145eb85b802c6c68a9129 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:20.032286 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-e1e65bafed7145eb85b802c6c68a9129 on tablet e1e65bafed7145eb85b802c6c68a9129 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:20.215982 16935 raft_consensus.cc:993] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:20.216967 16935 raft_consensus.cc:1081] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:20.219856 15746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:20.224200 15746 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.224749 15746 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.234867 15746 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.237706 15746 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:20.238510 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:20.239526 15600 raft_consensus.cc:3055] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.239935 15600 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:20.241729 15600 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.242548 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:20.243436 15676 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.244024 15600 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.251430 15676 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:20.252805 15600 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:20.259970 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:20.261560 16822 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.262710 16822 raft_consensus.cc:697] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:20.264173 16822 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.295136 16965 ts_tablet_manager.cc:933] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:20.333679 16965 tablet_copy_client.cc:323] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:20.336185 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 473662f2d754459c9d26a0322ab3531a from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:20.336923 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 473662f2d754459c9d26a0322ab3531a from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-473662f2d754459c9d26a0322ab3531a
W20260709 13:17:20.356732 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 65733.9us
I20260709 13:17:20.356412 15496 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.363739 15761 tablet_copy_source_session.cc:215] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:20.389158 16730 raft_consensus.cc:993] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:20.389816 16730 raft_consensus.cc:1081] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:20.398205 15672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:20.398831 15672 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.399263 15672 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.409515 16965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 473662f2d754459c9d26a0322ab3531a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:20.421039 15672 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:20.427395 16974 ts_tablet_manager.cc:933] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:20.431362 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:20.432049 15601 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.430276 15672 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:20.431362 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:20.437305 15748 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.437646 15748 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:20.438407 15748 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:20.439932 15748 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.444463 16965 tablet_copy_client.cc:806] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:20.445188 16965 tablet_copy_client.cc:670] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:20.450598 16965 tablet_copy_client.cc:538] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:20.451409 15601 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:20.461506 16974 tablet_copy_client.cc:323] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:20.463406 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 6556ac1ec52640c3bad0bf13607c8d19 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:20.464097 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 6556ac1ec52640c3bad0bf13607c8d19 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-6556ac1ec52640c3bad0bf13607c8d19
I20260709 13:17:20.465732 15640 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:20.466917 16970 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.467515 16970 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:20.468747 16970 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:20.473683 16965 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:20.477734 15761 tablet_copy_source_session.cc:215] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:20.481911 16974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6556ac1ec52640c3bad0bf13607c8d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:20.503321 16310 raft_consensus.cc:1217] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.508141 16949 raft_consensus.cc:993] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: : Instructing follower 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:20.508694 16949 raft_consensus.cc:1081] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Signalling peer 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:20.513911 16974 tablet_copy_client.cc:806] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:20.514624 16974 tablet_copy_client.cc:670] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:20.526113 16974 tablet_copy_client.cc:538] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:20.533010 15600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:51468
I20260709 13:17:20.533675 15600 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:20.534035 15600 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.535044 16965 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:20.536058 16965 tablet_bootstrap.cc:492] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:20.536828 16965 ts_tablet_manager.cc:1403] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.012s
I20260709 13:17:20.540678 16965 raft_consensus.cc:359] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.541743 16965 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:20.540953 15600 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:20.545874 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:20.546482 16310 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.538556 16974 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:20.542517 16965 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.560711 16965 ts_tablet_manager.cc:1434] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.001s
I20260709 13:17:20.561101 15600 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:20.556309 16310 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:20.564229 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-473662f2d754459c9d26a0322ab3531a received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:20.564740 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-473662f2d754459c9d26a0322ab3531a on tablet 473662f2d754459c9d26a0322ab3531a with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:20.565896 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:20.574436 15497 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.577231 16976 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:20.582547 16976 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:20.583829 16976 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:20.588498 15748 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:20.601749 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:20.602397 15672 raft_consensus.cc:3055] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:20.602694 15672 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:20.603560 15672 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:20.604889 15672 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:20.617480 15672 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:20.633967 15496 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:20.639417 16974 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:20.640508 16974 tablet_bootstrap.cc:492] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:20.644783 16974 ts_tablet_manager.cc:1403] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.107s	user 0.030s	sys 0.025s
I20260709 13:17:20.648108 16974 raft_consensus.cc:359] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.648841 16974 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:20.649508 16974 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:20.652247 16974 ts_tablet_manager.cc:1434] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:17:20.659077 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-6556ac1ec52640c3bad0bf13607c8d19 received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:20.659544 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-6556ac1ec52640c3bad0bf13607c8d19 on tablet 6556ac1ec52640c3bad0bf13607c8d19 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:20.765290 15672 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.766774 16973 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:20.783210 15716 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 534cd68adf1a448ba243ff66d1dcd5da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:20.783993 15600 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:20.785882 16973 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:20.847534 16310 raft_consensus.cc:1217] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.909004 15600 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.910262 16970 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.928472 15742 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:20.929986 16949 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:20.939643 16306 raft_consensus.cc:1217] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:20.956101 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:21.019830 16948 raft_consensus.cc:1064] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:21.023670 16948 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:21.036331 15748 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.037272 15595 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.038321 16306 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.039804 16970 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:21.041215 16948 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:21.042425 16840 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:21.055796 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:21.095244 16970 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.097921 16310 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.123989 16306 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:21.125844 16868 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:21.113847 15600 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.107798 15746 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.118448 15500 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:21.273211 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 49330.8us
I20260709 13:17:21.323328 15672 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:21.326090 15746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:21.326768 15746 raft_consensus.cc:606] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:21.329366 16855 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:21.341208 15672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:21.341951 15672 raft_consensus.cc:606] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:21.348560 15600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:21.350157 15600 raft_consensus.cc:606] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:21.352777 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:21.354071 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:21.352432 16999 raft_consensus.cc:993] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:21.356024 16973 raft_consensus.cc:1081] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:21.359056 15670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:21.359709 15670 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:21.360126 15670 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.381512 15670 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.384469 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:21.385396 15600 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.388427 15670 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:21.395884 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:21.396507 15748 raft_consensus.cc:3055] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:21.396818 15748 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:21.397676 15748 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.398306 15670 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:21.398844 15748 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.408417 15746 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.409770 16310 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.410123 16970 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.412792 16970 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.418469 16971 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.423260 15746 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.425693 15600 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:21.435122 16310 raft_consensus.cc:2955] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.441301 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e1e65bafed7145eb85b802c6c68a9129 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.451886 15640 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:21.452921 16840 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:21.453513 16840 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:21.454411 16840 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.452831 15748 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:21.469537 16973 raft_consensus.cc:1064] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:21.470623 15498 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.473433 17005 ts_tablet_manager.cc:933] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:21.474135 16822 raft_consensus.cc:1064] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:21.481204 16822 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:21.494318 16973 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:21.510952 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet e1e65bafed7145eb85b802c6c68a9129 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:21.522482 16309 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.524286 16898 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:21.526068 16970 raft_consensus.cc:993] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: : Instructing follower 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:21.526324 16855 raft_consensus.cc:993] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:21.526628 16970 raft_consensus.cc:1081] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Signalling peer 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:21.526854 16855 raft_consensus.cc:1081] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:21.529162 15595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:51468
I20260709 13:17:21.529738 15595 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:21.530077 15595 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:21.530164 15744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:21.530782 15744 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:21.531114 15744 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.537992 15600 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.541401 15670 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.543455 16999 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:21.548264 16730 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:21.545953 15595 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.551172 15595 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:21.552110 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:21.552769 15746 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:21.553797 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:21.554452 15676 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:21.554749 15676 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:21.555527 15676 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.556519 15676 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:21.565557 16310 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.566161 15672 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.568760 16730 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:21.569023 15598 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:21.570781 16898 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:21.572350 16898 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:21.572731 15744 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.575069 15744 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:21.580720 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:21.581367 15677 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.587122 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:21.587854 15601 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:21.588238 15601 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:21.589104 15601 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.590466 15601 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:21.591988 15677 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:21.599741 15601 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:21.601996 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:21.603713 15746 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:21.604984 15567 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:21.605880 16855 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:21.606431 16855 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:21.607522 16855 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.597987 15676 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:21.626207 16898 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:21.625842 15497 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 3, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.626755 16898 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:21.627772 16898 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:21.675657 17008 tablet_replica.cc:333] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:21.675395 16973 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:21.683305 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 53949.9us
I20260709 13:17:21.686406 17008 raft_consensus.cc:2243] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.687379 17008 raft_consensus.cc:2272] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.688825 17005 tablet_copy_client.cc:323] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.67:40623
I20260709 13:17:21.690668 15761 tablet_copy_service.cc:140] P 5433f0c9863e427d88ba5916819e28e3: Received BeginTabletCopySession request for tablet 534cd68adf1a448ba243ff66d1dcd5da from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:44676)
I20260709 13:17:21.691237 15761 tablet_copy_service.cc:161] P 5433f0c9863e427d88ba5916819e28e3: Beginning new tablet copy session on tablet 534cd68adf1a448ba243ff66d1dcd5da from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:44676: session id = 398beb97ee4b40688f6279f18fa51ade-534cd68adf1a448ba243ff66d1dcd5da
I20260709 13:17:21.691745 17008 ts_tablet_manager.cc:1916] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.692162 15497 catalog_manager.cc:5697] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:21.699335 15761 tablet_copy_source_session.cc:215] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:21.705986 15601 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.711048 17005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 534cd68adf1a448ba243ff66d1dcd5da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:21.707190 15496 catalog_manager.cc:5697] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:21.718860 17008 ts_tablet_manager.cc:1929] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:21.703593 16306 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.700646 16898 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.721911 17008 log.cc:1199] T e1e65bafed7145eb85b802c6c68a9129 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/e1e65bafed7145eb85b802c6c68a9129
I20260709 13:17:21.726704 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet e1e65bafed7145eb85b802c6c68a9129 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:21.720953 16309 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.738824 17005 tablet_copy_client.cc:806] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:21.739457 17005 tablet_copy_client.cc:670] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:21.736007 15497 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.744077 17005 tablet_copy_client.cc:538] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:21.758818 15672 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.766345 15496 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.766249 15600 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.779166 15670 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.792034 17005 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:21.796277 15744 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:21.804710 15746 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:21.807807 15598 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.811198 16309 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.811995 16973 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.812340 16306 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.815132 16898 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.815956 16994 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:17:21.822572 16999 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.832911 16306 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.837986 16994 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.841645 16309 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.849756 15672 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:17:21.863349 16898 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:21.873872 15672 raft_consensus.cc:2955] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.913815 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6556ac1ec52640c3bad0bf13607c8d19 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.914631 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 473662f2d754459c9d26a0322ab3531a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:21.917821 15600 raft_consensus.cc:2955] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.921444 15498 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.923384 15498 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 3 to 4, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 1 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:21.942291 15746 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:21.945251 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet 6556ac1ec52640c3bad0bf13607c8d19 with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:21.946574 17008 tablet_replica.cc:333] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:21.947641 17008 raft_consensus.cc:2243] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.948318 17008 raft_consensus.cc:2272] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.952159 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet 473662f2d754459c9d26a0322ab3531a with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:21.957368 17008 ts_tablet_manager.cc:1916] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.961789 17021 tablet_replica.cc:333] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:21.964175 17021 raft_consensus.cc:2243] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:21.964988 17021 raft_consensus.cc:2272] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:21.967293 16949 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:21.968046 17005 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:21.978439 17005 tablet_bootstrap.cc:492] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:21.979167 17005 ts_tablet_manager.cc:1403] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.187s	user 0.034s	sys 0.026s
I20260709 13:17:21.980041 17021 ts_tablet_manager.cc:1916] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:21.983940 17005 raft_consensus.cc:359] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:21.985764 17005 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:21.986958 17005 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:21.989900 17005 ts_tablet_manager.cc:1434] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:17:21.991587 15761 tablet_copy_service.cc:342] P 5433f0c9863e427d88ba5916819e28e3: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-534cd68adf1a448ba243ff66d1dcd5da received from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:21.991953 15761 tablet_copy_service.cc:434] P 5433f0c9863e427d88ba5916819e28e3: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-534cd68adf1a448ba243ff66d1dcd5da on tablet 534cd68adf1a448ba243ff66d1dcd5da with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:22.018739 17021 ts_tablet_manager.cc:1929] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:22.019407 17021 log.cc:1199] T 473662f2d754459c9d26a0322ab3531a P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/473662f2d754459c9d26a0322ab3531a
I20260709 13:17:22.022639 17008 ts_tablet_manager.cc:1929] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:17:22.023167 17008 log.cc:1199] T 6556ac1ec52640c3bad0bf13607c8d19 P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/6556ac1ec52640c3bad0bf13607c8d19
I20260709 13:17:22.358688 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:22.400883 15748 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:22.422509 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet 473662f2d754459c9d26a0322ab3531a (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:22.425473 15676 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:22.452747 16999 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.461467 16855 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:22.477512 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet 6556ac1ec52640c3bad0bf13607c8d19 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:22.488184 15675 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:22.513257 15600 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:22.517791 16306 raft_consensus.cc:1217] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:22.570807 15600 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:22.587208 16730 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.596972 16949 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:22.604301 17025 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:22.626266 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:22.703044 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:22.703796 15598 raft_consensus.cc:606] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:22.707538 15674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:22.708174 15674 raft_consensus.cc:606] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:22.711277 15744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:22.711892 15744 raft_consensus.cc:606] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:22.714637 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:22.715210 15598 raft_consensus.cc:606] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:22.716254 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:22.717854 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:22.861424 17024 raft_consensus.cc:993] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:22.862002 17024 raft_consensus.cc:1081] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:22.864869 16310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:36520
I20260709 13:17:22.865453 16310 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:22.865820 16310 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.872529 16310 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:22.875487 16310 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:22.875728 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:22.876485 15744 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.877241 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:22.877871 15598 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:22.878196 15598 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:22.879155 15598 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:22.881806 15598 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.886257 15744 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:22.887777 16265 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:22.889053 16997 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:22.889652 16997 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:22.890534 16997 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:22.911716 15598 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:22.916623 15498 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:22.921181 16949 raft_consensus.cc:993] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: : Instructing follower 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:22.921965 17031 raft_consensus.cc:1081] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Signalling peer 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:22.924409 15600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:51468
I20260709 13:17:22.925199 15600 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:22.925618 15600 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.939973 15600 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:22.942663 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:22.942962 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:22.943270 15672 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:22.943524 15748 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.943603 15672 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:22.944480 15672 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:22.945528 15672 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:22.953212 15672 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:22.956664 15565 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:22.959556 16855 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:22.960050 16855 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:22.960897 16855 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:22.965860 15600 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:22.968886 15748 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:22.991429 15498 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.026432 16991 raft_consensus.cc:993] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:23.026968 16855 raft_consensus.cc:1081] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:23.031423 15748 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:23.032084 15748 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:23.032518 15748 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:23.040297 15748 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:23.042798 15748 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:23.043819 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:23.044484 15674 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:23.048322 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:23.048924 15600 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:23.049239 15600 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:23.049960 15600 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:23.051028 15600 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:23.051651 15674 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:23.052940 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:23.053862 16822 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:23.054375 16822 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:23.055217 16822 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:23.057452 15600 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:23.065989 17029 raft_consensus.cc:1064] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:23.068751 17029 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:23.070286 15498 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.079069 16306 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:23.079999 15600 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:23.080335 15674 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:23.080762 16999 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.081875 16730 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.086191 16730 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.116299 16999 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.120097 17029 raft_consensus.cc:993] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:23.120736 17029 raft_consensus.cc:1081] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:23.122754 15672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:23.123334 15672 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:23.123663 15672 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.124171 15600 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.127594 16306 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.133630 15674 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.145304 15496 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.130438 15672 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:23.155308 15672 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:23.155207 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:23.155920 15600 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.163097 15600 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:23.164364 15640 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:23.165227 16331 debug-util.cc:398] Leaking SignalData structure 0x7b0800301060 after lost signal to thread 14504
I20260709 13:17:23.165781 16971 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:17:23.166343 16331 debug-util.cc:398] Leaking SignalData structure 0x7b0800301740 after lost signal to thread 15534
I20260709 13:17:23.166508 16971 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:17:23.167608 16331 debug-util.cc:398] Leaking SignalData structure 0x7b0800372240 after lost signal to thread 15626
I20260709 13:17:23.167553 16971 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:23.168812 16331 debug-util.cc:398] Leaking SignalData structure 0x7b080036ce20 after lost signal to thread 15701
W20260709 13:17:23.169888 16331 debug-util.cc:398] Leaking SignalData structure 0x7b080035d6c0 after lost signal to thread 15775
I20260709 13:17:23.170336 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:23.170929 15748 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:17:23.171007 16331 debug-util.cc:398] Leaking SignalData structure 0x7b0800314ae0 after lost signal to thread 16334
I20260709 13:17:23.171343 15748 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:23.172241 15748 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:23.173481 15748 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:23.175422 15744 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:23.181941 15748 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:23.185859 16306 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:23.187012 15600 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:23.187358 16999 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:23.190809 16730 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:23.197160 16730 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.203481 15500 catalog_manager.cc:5697] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:23.204892 15600 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.225289 16306 raft_consensus.cc:2955] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:23.229393 15486 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 534cd68adf1a448ba243ff66d1dcd5da with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:23.240741 15498 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index 4 to 5, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:23.269331 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet 534cd68adf1a448ba243ff66d1dcd5da with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:48120
I20260709 13:17:23.299116 17051 tablet_replica.cc:333] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:17:23.300909 17051 raft_consensus.cc:2243] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:23.301867 17051 raft_consensus.cc:2272] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:23.306717 17051 ts_tablet_manager.cc:1916] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:23.322438 17051 ts_tablet_manager.cc:1929] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:23.322813 17051 log.cc:1199] T 534cd68adf1a448ba243ff66d1dcd5da P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/534cd68adf1a448ba243ff66d1dcd5da
I20260709 13:17:23.324425 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet 534cd68adf1a448ba243ff66d1dcd5da (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:17:23.383674 15744 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:23.385027 16997 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:23.418902 15600 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:23.420645 16997 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:23.439447 15672 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.441354 16730 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:23.475134 15598 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.479031 17029 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.500267 15744 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.502178 17025 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.554605 15672 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:23.570907 16991 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:23.660707 15742 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:23.662029 17031 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:23.681995 15598 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:23.685629 17031 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:23.718784 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:23.851516 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:23.916671 15674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:23.917668 15674 raft_consensus.cc:606] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:23.920538 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "693cb838c6224bb88e8195042cafa653"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:23.921088 15601 raft_consensus.cc:606] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:23.923295 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:23.924463 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:23.996496 16855 raft_consensus.cc:993] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:23.997022 16855 raft_consensus.cc:1081] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:24.000161 15742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "693cb838c6224bb88e8195042cafa653"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:17:24.000905 15742 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.001273 15742 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.009280 15742 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:24.011601 15742 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:24.013216 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:24.013841 15674 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.013797 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:24.014614 15601 raft_consensus.cc:3055] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:24.014923 15601 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:24.015648 15601 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:24.016846 15601 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.021055 15674 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:24.022377 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:24.023344 16730 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:24.023795 16730 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:24.024590 16730 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:24.026441 15601 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:24.061877 15500 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.347862 17071 raft_consensus.cc:993] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: : Instructing follower 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:24.348433 17071 raft_consensus.cc:1081] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Signalling peer 558532223b984cf796cb6b98ddd6c9f2 to start an election
I20260709 13:17:24.350970 15600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:51468
I20260709 13:17:24.351513 15600 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:24.351846 15600 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.359381 15600 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:24.360473 15601 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:24.362712 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:24.363319 15742 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.363627 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:24.364319 15674 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:24.364674 15674 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:24.365424 15674 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:24.367811 15674 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:24.361465 15600 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:24.380712 15674 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:24.382669 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:24.384052 17025 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:24.384646 17025 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:24.385679 17025 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:24.427795 15742 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:24.430306 15567 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86c5f054f586412fbd8a416245340d63. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.432322 15674 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:24.442855 15744 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:24.444470 17062 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:24.445842 15600 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:24.448403 17025 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:24.450604 15500 catalog_manager.cc:5697] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.453043 16730 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:24.486656 15670 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:24.488657 16730 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:24.498001 16991 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.503865 15742 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:17:24.549350 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 54750.7us
I20260709 13:17:24.550469 15500 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.583045 15670 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:17:24.595301 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54183.7us
I20260709 13:17:24.633107 15675 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:24.683415 15744 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:17:24.684146 15642 consensus_peers.cc:597] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea2d5bac8fb54783a1f420061d08067f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.685938 17065 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:24.688853 15598 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:24.691960 17072 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.721992 17072 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.725102 15744 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.744263 15601 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:24.744889 15595 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.751557 15500 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.779007 15744 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:17:24.780153 15567 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 651bfd4950ab4835b117f7364ee51b09. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.781301 16855 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.781894 15675 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:17:24.783371 16855 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:24.797953 17062 raft_consensus.cc:2955] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.801934 15675 raft_consensus.cc:2955] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.822346 15498 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:24.815752 15601 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:24.830567 15744 raft_consensus.cc:2955] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.910768 15742 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:17:24.912856 15675 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:17:24.915555 15567 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc4ccb73a2c14aa7864a676c25f3a2fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:17:24.916214 17025 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:24.920724 17025 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:24.925453 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:24.942224 15744 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:24.946599 17025 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:24.960153 16855 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:24.968724 15748 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:25.004024 15675 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:17:25.014883 15500 catalog_manager.cc:5697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index -1 to 2, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.015794 15670 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:25.026471 17083 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:25.071177 17098 ts_tablet_manager.cc:933] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:25.089068 17098 tablet_copy_client.cc:323] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:25.092998 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet 86c5f054f586412fbd8a416245340d63 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:25.093662 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet 86c5f054f586412fbd8a416245340d63 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-86c5f054f586412fbd8a416245340d63
I20260709 13:17:25.114655 15612 tablet_copy_source_session.cc:215] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:25.118288 17098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86c5f054f586412fbd8a416245340d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.143181 17098 tablet_copy_client.cc:806] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:25.143904 17098 tablet_copy_client.cc:670] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:25.148581 17098 tablet_copy_client.cc:538] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:25.158870 17098 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:25.177830 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:25.178977 17100 ts_tablet_manager.cc:933] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:25.216773 17100 tablet_copy_client.cc:323] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:25.220214 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet 651bfd4950ab4835b117f7364ee51b09 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:25.220959 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet 651bfd4950ab4835b117f7364ee51b09 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-651bfd4950ab4835b117f7364ee51b09
I20260709 13:17:25.246057 15612 tablet_copy_source_session.cc:215] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:25.254937 17100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651bfd4950ab4835b117f7364ee51b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.270929 17098 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.272030 17098 tablet_bootstrap.cc:492] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:25.272914 17098 ts_tablet_manager.cc:1403] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.114s	user 0.034s	sys 0.012s
I20260709 13:17:25.273494 17103 ts_tablet_manager.cc:933] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:25.276312 17098 raft_consensus.cc:359] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.282140 17098 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:25.282912 17098 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.306493 17098 ts_tablet_manager.cc:1434] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:17:25.290411 17103 tablet_copy_client.cc:323] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:17:25.319624 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet ea2d5bac8fb54783a1f420061d08067f from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:17:25.320178 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet ea2d5bac8fb54783a1f420061d08067f from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-ea2d5bac8fb54783a1f420061d08067f
I20260709 13:17:25.333756 15687 tablet_copy_source_session.cc:215] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:25.341639 17103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2d5bac8fb54783a1f420061d08067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.288096 17100 tablet_copy_client.cc:806] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:25.343755 17100 tablet_copy_client.cc:670] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:25.348119 17100 tablet_copy_client.cc:538] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:25.353739 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-86c5f054f586412fbd8a416245340d63 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:25.354318 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-86c5f054f586412fbd8a416245340d63 on tablet 86c5f054f586412fbd8a416245340d63 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:25.398988 15746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:25.399693 15746 raft_consensus.cc:606] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:25.400768 17105 ts_tablet_manager.cc:933] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:17:25.401787 17100 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:25.412359 17103 tablet_copy_client.cc:806] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:25.413048 17103 tablet_copy_client.cc:670] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:25.417382 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:25.418011 15601 raft_consensus.cc:606] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:17:25.419020 17103 tablet_copy_client.cc:538] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:25.425738 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:17:25.426311 17105 tablet_copy_client.cc:323] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:17:25.427793 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:25.428215 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet fc4ccb73a2c14aa7864a676c25f3a2fc from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:17:25.431994 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet fc4ccb73a2c14aa7864a676c25f3a2fc from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-fc4ccb73a2c14aa7864a676c25f3a2fc
I20260709 13:17:25.433178 17103 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:25.439862 17100 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.440891 15612 tablet_copy_source_session.cc:215] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:17:25.441316 17100 tablet_bootstrap.cc:492] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:25.442303 17100 ts_tablet_manager.cc:1403] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.041s	user 0.029s	sys 0.003s
I20260709 13:17:25.445804 17100 raft_consensus.cc:359] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.446774 17100 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:25.447484 17100 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.449766 17105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc4ccb73a2c14aa7864a676c25f3a2fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:17:25.450438 17100 ts_tablet_manager.cc:1434] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:17:25.452303 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-651bfd4950ab4835b117f7364ee51b09 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:25.452757 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-651bfd4950ab4835b117f7364ee51b09 on tablet 651bfd4950ab4835b117f7364ee51b09 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:25.494342 17103 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.498489 17105 tablet_copy_client.cc:806] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:17:25.505508 17105 tablet_copy_client.cc:670] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:17:25.509835 17105 tablet_copy_client.cc:538] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:17:25.510398 17103 tablet_bootstrap.cc:492] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:25.511245 17103 ts_tablet_manager.cc:1403] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.006s
I20260709 13:17:25.514827 17103 raft_consensus.cc:359] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.516965 17103 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:25.517752 17103 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.523443 17105 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:17:25.542258 17080 raft_consensus.cc:993] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:25.542824 17080 raft_consensus.cc:1081] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:25.545877 15672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48128
I20260709 13:17:25.546497 15672 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.546839 15672 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.550078 17103 ts_tablet_manager.cc:1434] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:17:25.554697 15672 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:25.557930 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-ea2d5bac8fb54783a1f420061d08067f received from {username='slave'} at 127.0.0.1:40216
I20260709 13:17:25.558472 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-ea2d5bac8fb54783a1f420061d08067f on tablet ea2d5bac8fb54783a1f420061d08067f with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:25.560751 15672 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:25.561380 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:25.562086 15601 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.563357 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:25.564262 15746 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:25.564677 15746 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:25.565718 15746 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:25.567399 15746 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.573654 15601 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:25.575052 15640 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:25.576000 17065 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:25.576503 17065 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:25.577560 17065 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:25.583910 16309 raft_consensus.cc:1217] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:17:25.600904 17105 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:17:25.602265 17105 tablet_bootstrap.cc:492] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:17:25.603632 17105 ts_tablet_manager.cc:1403] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.007s
I20260709 13:17:25.604943 15746 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:25.608322 17105 raft_consensus.cc:359] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.615500 17105 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:17:25.616441 17105 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:25.619082 15498 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:25.623155 17105 ts_tablet_manager.cc:1434] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:17:25.625835 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-fc4ccb73a2c14aa7864a676c25f3a2fc received from {username='slave'} at 127.0.0.1:34574
I20260709 13:17:25.626279 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-fc4ccb73a2c14aa7864a676c25f3a2fc on tablet fc4ccb73a2c14aa7864a676c25f3a2fc with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:25.686147 16310 raft_consensus.cc:1217] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:25.743223 17025 raft_consensus.cc:993] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:25.746529 17083 raft_consensus.cc:1081] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:17:25.748234 15672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:17:25.748871 15672 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:25.749265 15672 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.766445 15672 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:25.770779 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:25.771384 15601 raft_consensus.cc:3055] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:25.771713 15601 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:25.772459 15601 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:25.773552 15601 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.791245 16310 raft_consensus.cc:1217] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:17:25.817611 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:25.818266 16310 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:25.825448 15672 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:25.827451 16310 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:25.831457 15601 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:25.831794 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:25.832800 17072 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:25.834129 17072 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:25.837018 17072 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:25.916273 16309 raft_consensus.cc:1217] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:17:25.944775 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 46353.6us
I20260709 13:17:25.975703 15496 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 3, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:26.143436 15598 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:26.148191 17065 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:26.160804 15748 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:26.162635 17072 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:26.202082 17031 raft_consensus.cc:1064] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:26.208282 17062 raft_consensus.cc:1064] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:26.210915 17062 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:26.204916 17031 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:26.285558 15742 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:26.288357 17062 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:26.296645 16309 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:26.302739 17114 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:26.310647 15747 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:26.313303 17116 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:26.318023 16309 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:26.348722 17065 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:26.388525 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 141479us
W20260709 13:17:26.405133 17129 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:26.416132 16310 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:26.422664 15672 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:26.429204 17062 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:26.453095 16306 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:26.459273 17025 raft_consensus.cc:1064] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:26.464125 15600 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:26.466969 17083 raft_consensus.cc:1064] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:17:26.470805 17025 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:26.474350 15600 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:26.446269 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:26.483457 17065 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:26.486254 17083 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:26.545466 17133 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:17:26.548036 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50952.4us
W20260709 13:17:26.562112 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 152150us
I20260709 13:17:26.591747 17142 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:26.542968 17072 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:17:26.612486 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 100692us
W20260709 13:17:26.627489 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 136594us
I20260709 13:17:26.624243 17065 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:26.635519 15748 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:26.665923 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 81430.5us
W20260709 13:17:26.668978 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 84054.9us
I20260709 13:17:26.673833 16307 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:26.743527 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 129172us
I20260709 13:17:26.761466 15672 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:26.765525 15500 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.774905 15496 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:26.793290 15742 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:27.624193 17162 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.011s	sys 0.013s
W20260709 13:17:27.624776 17162 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.012s	sys 0.013s
I20260709 13:17:28.482628 17167 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.483212 17167 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.485558 17167 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.488330 17168 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.490463 17168 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.494387 17168 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.498737 17168 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.500154 17168 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.503769 17168 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.496937 17169 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.507519 17169 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.510444 17169 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.511197 17169 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.512537 17169 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.515282 17169 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.511873 17168 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.516117 17168 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.518682 17168 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.506239 17170 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.519536 17170 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.522264 17170 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.522971 17170 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.523979 17170 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.526655 17170 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.536726 17167 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.537407 17167 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.538033 17150 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.538564 17150 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.539152 17167 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.540321 17150 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:28.540833 17150 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.541324 17150 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.543558 17150 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.544083 17150 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.544667 17150 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.546800 17150 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.547302 17150 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.547765 17150 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.550642 17150 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.551397 17150 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.552043 17150 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.561379 17150 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:28.564925 17150 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.566429 17150 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.570211 17150 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.626240 17150 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.627646 15496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 287) took 1938 ms. Trace:
I20260709 13:17:28.627102 17150 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.630827 17150 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.631327 17150 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.628106 15496 rpcz_store.cc:276] 0709 13:17:26.689526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.689659 (+   133us) service_pool.cc:224] Handling call
0709 13:17:28.627546 (+1937887us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:26.796380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:26.796999 (+   619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:26.797031 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:17:26.797049 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:26.797397 (+   348us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:26.797466 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:26.797495 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:26.797683 (+   188us) tablet.cc:701] Row locks acquired
0709 13:17:26.797701 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:17:26.797837 (+   136us) write_op.cc:270] Start()
0709 13:17:26.797943 (+   106us) write_op.cc:276] Timestamp: P: 1783603046797786 usec, L: 0
0709 13:17:26.797963 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:26.798700 (+   737us) log.cc:844] Serialized 595 byte log entry
0709 13:17:26.811553 (+ 12853us) op_driver.cc:464] REPLICATION: finished
0709 13:17:26.814262 (+  2709us) write_op.cc:301] APPLY: starting
0709 13:17:26.814345 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:26.814444 (+    99us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:26.814575 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:26.814800 (+   225us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:26.814963 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:26.815008 (+    45us) write_op.cc:312] APPLY: finished
0709 13:17:26.815211 (+   203us) log.cc:844] Serialized 23 byte log entry
0709 13:17:27.016802 (+201591us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.016884 (+    82us) write_op.cc:454] Released schema lock
0709 13:17:27.019370 (+  2486us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:27.024150 (+  4780us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.024187 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8047,"reported_tablets":1,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":2482,"apply.run_cpu_time_us":1857,"apply.run_wall_time_us":209813,"num_ops":1,"prepare.queue_time_us":11730,"prepare.run_cpu_time_us":2648,"prepare.run_wall_time_us":14343,"replication_time_us":13458,"thread_start_us":15753,"threads_started":2}]]}
I20260709 13:17:28.631748 17150 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.633460 16997 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.634279 17150 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:28.634001 16997 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.636484 16997 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.639465 16997 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.640040 16997 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.642251 17171 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.643317 16997 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.643918 16997 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.644479 16997 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.647480 16997 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:28.648008 16997 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.648557 16997 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.649238 17065 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.649814 17065 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.650520 17144 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.651054 17144 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.651688 16997 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.651793 17065 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.652388 17065 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.652391 16997 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.653007 17065 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.654071 17173 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.653103 17144 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.655027 17144 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.654716 17173 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.657189 17173 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.657568 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1433) took 1875 ms. Trace:
I20260709 13:17:28.657954 15596 rpcz_store.cc:276] 0709 13:17:26.782123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.656858 (+1874735us) service_pool.cc:224] Handling call
0709 13:17:28.657089 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.657221 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.657242 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.657276 (+    34us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:28.657301 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.657340 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.657412 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.658988 17065 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.659126 17167 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:28.642925 17171 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.668406 17171 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.674216 17065 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.674927 17065 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:28.677026 17065 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.677878 17123 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.677975 17065 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.678651 17065 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.678602 17123 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.680729 17065 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.681005 17175 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.681600 17175 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.684386 15672 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:28.684365 17175 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.685588 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.686157 15672 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:28.686493 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.687299 17175 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.688059 17065 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.691777 17123 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.692148 17168 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.687865 16309 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:17:28.692349 17065 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.692700 17168 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.692937 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:28.693625 16308 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:28.664186 17144 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.694299 17065 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.694556 17168 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.695708 17144 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.696640 17168 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:28.697642 17152 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.698160 17152 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.701699 17152 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.688947 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.689015 17083 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.703254 17083 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.703560 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:28.704434 17144 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.705722 17114 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.706082 17083 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.706693 17083 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:28.706292 17114 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.707420 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.686388 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:28.690522 17025 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.708233 16304 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:28.670468 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 316) took 1929 ms. Trace:
I20260709 13:17:28.709851 17114 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.709214 15500 rpcz_store.cc:276] 0709 13:17:26.741507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.742029 (+   522us) service_pool.cc:224] Handling call
0709 13:17:28.670400 (+1928371us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:26.805681 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:26.806258 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:26.806293 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:17:26.806307 (+    14us) tablet.cc:662] Decoding operations
0709 13:17:26.806667 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:26.806716 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:26.806746 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:26.806930 (+   184us) tablet.cc:701] Row locks acquired
0709 13:17:26.806945 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:17:26.807086 (+   141us) write_op.cc:270] Start()
0709 13:17:26.807206 (+   120us) write_op.cc:276] Timestamp: P: 1783603046807040 usec, L: 0
0709 13:17:26.807223 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:17:26.807833 (+   610us) log.cc:844] Serialized 595 byte log entry
0709 13:17:26.816167 (+  8334us) op_driver.cc:464] REPLICATION: finished
0709 13:17:27.024564 (+208397us) write_op.cc:301] APPLY: starting
0709 13:17:27.024683 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:27.024825 (+   142us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:27.024973 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:27.025247 (+   274us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:27.025394 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:27.025443 (+    49us) write_op.cc:312] APPLY: finished
0709 13:17:27.025637 (+   194us) log.cc:844] Serialized 23 byte log entry
0709 13:17:27.025817 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.025895 (+    78us) write_op.cc:454] Released schema lock
0709 13:17:27.025938 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1610589,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":208174,"apply.run_cpu_time_us":1715,"apply.run_wall_time_us":1714,"num_ops":1,"prepare.queue_time_us":21573,"prepare.run_cpu_time_us":2392,"prepare.run_wall_time_us":2391,"replication_time_us":8831,"thread_start_us":808765,"threads_started":1}]]}
W20260709 13:17:28.701785 15531 debug-util.cc:398] Leaking SignalData structure 0x7b08000671c0 after lost signal to thread 14504
I20260709 13:17:28.713981 17152 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.689769 17167 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:28.707661 15594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.955s	user 0.009s	sys 0.047s
W20260709 13:17:28.714491 15531 debug-util.cc:398] Leaking SignalData structure 0x7b08000678a0 after lost signal to thread 15534
W20260709 13:17:28.714831 15594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.963s	user 0.009s	sys 0.048s
I20260709 13:17:28.715623 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1182) took 1966 ms. Trace:
I20260709 13:17:28.715855 17166 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.708382 17025 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.691504 17170 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.718269 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.718169 17170 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.719053 17171 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.719558 17171 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.720356 17025 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.720616 17170 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.705399 17144 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.722409 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.690949 17169 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.725298 15677 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:28.732232 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.733093 15675 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:28.733135 17144 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.733081 17169 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.734231 17144 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.707088 17083 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.734772 17144 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.735420 17083 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:28.736250 17169 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.716557 17166 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.687896 17175 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.716006 15594 rpcz_store.cc:276] 0709 13:17:26.748907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.750865 (+  1958us) service_pool.cc:224] Handling call
0709 13:17:26.751183 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.751531 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.751564 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.752061 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.715236 (+1963175us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:28.715281 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.715364 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.715417 (+    53us) raft_consensus.cc:1685] finished
0709 13:17:28.715435 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.715551 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7,"raft.queue_time_us":855,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":96,"thread_start_us":1962882,"threads_started":1,"wal-append.queue_time_us":286735,"wal-append.run_cpu_time_us":1783,"wal-append.run_wall_time_us":1001809}
I20260709 13:17:28.756052 17080 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.743000 17167 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.757510 17171 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:28.758405 17025 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.777549 17029 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.806759 17065 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.809383 17029 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:27.013903 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 159098us
I20260709 13:17:28.810913 17065 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.786597 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1430) took 2007 ms. Trace:
I20260709 13:17:28.804876 16306 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.806068 17025 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.816212 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46324 (request call id 310) took 2061 ms. Trace:
I20260709 13:17:28.811795 15598 rpcz_store.cc:276] 0709 13:17:26.779063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.785382 (+2006319us) service_pool.cc:224] Handling call
0709 13:17:28.785873 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.786113 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.786169 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.786228 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:28.786277 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.786356 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.786514 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.653088 16997 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:28.819079 16307 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.980s	user 0.001s	sys 0.019s
I20260709 13:17:28.776405 17136 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.714489 17152 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.816859 15497 rpcz_store.cc:276] 0709 13:17:26.754610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.755586 (+   976us) service_pool.cc:224] Handling call
0709 13:17:28.816130 (+2060544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42063,"reported_tablets":1}
I20260709 13:17:28.819212 17175 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.811264 17168 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.834849 17029 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:28.821379 17065 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:28.836978 16307 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.998s	user 0.002s	sys 0.020s
I20260709 13:17:28.837082 17065 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:28.835631 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 132142us
I20260709 13:17:28.837895 17029 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.839381 17174 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.759737 17080 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.839538 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:28.837716 17065 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.814766 17171 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.842761 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:28.843628 17029 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.845227 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:28.845870 16309 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:28.846293 16307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 476) took 2099 ms. Trace:
I20260709 13:17:28.846876 17029 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:28.847129 15744 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:17:28.827769 17144 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:28.846791 16307 rpcz_store.cc:276] 0709 13:17:26.746941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.747063 (+   122us) service_pool.cc:224] Handling call
0709 13:17:26.838229 (+ 91166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.838511 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:28.841007 (+2002496us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.845824 (+  4817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.845896 (+    72us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.845956 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.846036 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.846193 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":784661,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":97,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":2002824,"threads_started":2}
I20260709 13:17:28.848798 17029 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.850975 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:28.854099 17029 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.848681 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:28.850845 17171 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:28.839921 17174 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:28.854223 16308 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:29.096052 17137 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:28.884454 15674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.112s	user 0.008s	sys 0.016s
I20260709 13:17:29.049911 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:28.928645 16997 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:28.856920 17065 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.100203 15744 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:17:29.101791 15674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.329s	user 0.017s	sys 0.023s
I20260709 13:17:29.102687 17186 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.102461 15674 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:29.103216 17186 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:29.037955 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.104535 17171 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.047973 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.107698 17182 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:29.108460 17182 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.109311 17187 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.109905 17187 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:28.835532 17169 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.114986 17029 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.058630 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.116282 15750 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:29.002815 17167 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.119261 17029 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:29.120453 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 271865us
I20260709 13:17:29.125833 17029 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.123080 17191 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:29.123687 17190 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.847506 17150 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.927687 17123 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:28.977384 17146 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.096793 17137 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:29.020967 17178 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:28.883085 17181 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.978679 17180 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:28.883332 17177 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:28.976959 17153 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.030627 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.135229 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.117971 17175 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:29.141561 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:28.843329 17168 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.142906 17167 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:17:29.134246 15531 debug-util.cc:398] Leaking SignalData structure 0x7b0800316340 after lost signal to thread 15626
I20260709 13:17:29.148548 17029 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.159081 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:28.834427 17136 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.171753 17136 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.126910 17169 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.174132 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.175312 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.137780 17191 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:29.177037 17139 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.177404 17168 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.165951 15747 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:29.185449 17029 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.192750 17029 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:29.194097 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 55282.6us
W20260709 13:17:29.200232 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 72428us
I20260709 13:17:29.136373 17150 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.151624 17062 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.202788 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.156008 17080 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:29.173267 15531 debug-util.cc:398] Leaking SignalData structure 0x7b0800317280 after lost signal to thread 15627
I20260709 13:17:29.136091 17123 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.157831 17177 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.204263 17029 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.147300 17146 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.205296 17173 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.191591 17136 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.183712 17191 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:29.209605 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.173525 17025 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.179047 17186 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.165416 15749 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:29.149075 17181 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.208034 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1557) took 2447 ms. Trace:
I20260709 13:17:29.160547 17175 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.216778 15670 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:29.222077 15674 rpcz_store.cc:276] 0709 13:17:26.758933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.770658 (+ 11725us) service_pool.cc:224] Handling call
0709 13:17:26.771231 (+   573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.771556 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.771589 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.772433 (+   844us) log.cc:844] Serialized 556 byte log entry
0709 13:17:29.102332 (+2329899us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:29.128704 (+ 26372us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.205150 (+ 76446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.205612 (+   462us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.205667 (+    55us) raft_consensus.cc:1685] finished
0709 13:17:29.205683 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.205823 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2405577,"threads_started":3,"wal-append.queue_time_us":351357,"wal-append.run_cpu_time_us":2116,"wal-append.run_wall_time_us":1002115}
I20260709 13:17:29.177963 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.224092 15677 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:29.217577 17167 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.227497 17183 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.227680 17167 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.214629 17062 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.212759 17168 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:29.140061 17190 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:29.231614 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 58327.8us
I20260709 13:17:29.212975 17139 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.232359 15567 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.237769 17029 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.238063 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.222481 17025 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.237097 15745 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:29.240311 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.238281 17029 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.206367 17153 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.242349 17029 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.242811 17029 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.243356 17153 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.243192 17029 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.244931 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.244174 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:29.235544 15531 debug-util.cc:398] Leaking SignalData structure 0x7b0800354e60 after lost signal to thread 15701
I20260709 13:17:29.218581 17136 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.230532 17166 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.218842 17173 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.244905 17152 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.228112 17183 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.258505 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.178447 17178 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.263988 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.235040 17168 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.169139 17180 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.247648 17025 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:29.349866 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 117596us
I20260709 13:17:29.354074 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.350244 15672 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.354689 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.354600 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.355499 15670 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.355849 15674 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.356648 17029 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:29.314628 17083 consensus_meta.cc:287] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.579s	user 0.007s	sys 0.004s
I20260709 13:17:29.374954 17146 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.375300 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.343544 17080 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.257691 17192 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.376444 17175 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.314103 17139 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.264266 17123 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.338564 17137 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.339486 17136 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.264621 17195 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.385862 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.365856 17114 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.389474 17177 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.390875 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.391744 17083 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.394965 17188 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:29.379966 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 180373us
I20260709 13:17:29.395409 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.401064 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:29.402709 15531 debug-util.cc:398] Leaking SignalData structure 0x7b08003390c0 after lost signal to thread 15775
I20260709 13:17:29.406598 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.384387 17182 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.409255 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.299793 17187 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.413038 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.412490 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.425482 15498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 206) took 2646 ms. Trace:
I20260709 13:17:29.403528 17167 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.400142 17174 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.430284 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.414935 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.431640 15595 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:17:29.434361 15602 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:29.417928 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.432976 15498 rpcz_store.cc:276] 0709 13:17:26.779511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.779853 (+   342us) service_pool.cc:224] Handling call
0709 13:17:29.425385 (+2645532us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 13:17:29.406009 17170 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.436110 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.438323 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.402045 17198 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:29.414258 15531 debug-util.cc:398] Leaking SignalData structure 0x7b080037db60 after lost signal to thread 15776
I20260709 13:17:29.405421 17114 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:29.444896 17181 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.446035 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.427594 17169 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.457502 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.429455 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.457736 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.415841 17136 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.461221 17114 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.465164 17136 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.466784 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.467350 17136 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.427131 17173 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.399348 17080 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.415071 17206 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.427404 17189 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.463930 15597 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:29.413968 17183 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.473927 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.432327 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.471468 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.474607 16309 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:29.474974 16310 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:29.461745 17180 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.475672 15746 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:29.477129 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.453857 17187 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.481432 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.478245 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.479504 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.482638 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.483062 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.483291 16309 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:29.468804 17206 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:29.484166 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.484720 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.484961 15595 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:29.485836 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.446719 17170 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.489161 15672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:29.490325 15672 raft_consensus.cc:606] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:29.490433 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.428663 17195 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.492481 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.476948 17189 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.493499 15742 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:29.494590 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.495617 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.474126 17198 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:29.487617 15531 debug-util.cc:398] Leaking SignalData structure 0x7b080012ff60 after lost signal to thread 16334
I20260709 13:17:29.483906 17180 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.504838 17189 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.415354 17188 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.408017 17192 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.554157 17180 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.552084 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.489939 17137 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.549561 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.492070 17178 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.487179 17187 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.607579 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.607616 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.609972 17195 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.551398 17207 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.631413 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.631610 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.632197 15673 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:29.550947 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.633631 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.606938 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.635689 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.636332 15595 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.639731 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.642234 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.643666 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.645210 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.642923 15676 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:29.665999 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.666450 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.653923 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.667547 15745 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.611721 17191 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.653410 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.669124 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.615298 17190 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.673674 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:29.675171 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.677533 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.621841 17137 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.677040 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.675784 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.679548 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:29.679610 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.681011 17029 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.679162 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.681430 17029 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.679817 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.652964 17169 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:17:29.681839 17029 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.634711 17114 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.678207 15596 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.684491 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.660650 17080 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.656980 17083 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.685413 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.693521 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.694464 15595 raft_consensus.cc:2393] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:29.649886 17178 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.686187 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.687672 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.697391 15602 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:29.686527 17203 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:29.691484 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.691846 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.693308 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.697822 17203 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.698292 17203 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.690310 15745 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:29.691857 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.699013 15745 raft_consensus.cc:606] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Received request to transfer leadership to TS 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:29.690744 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.699810 17192 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.631603 17207 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.690747 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.686610 17177 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:29.689079 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.712970 15598 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:29.713718 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.719249 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.721133 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.722220 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.691246 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.721411 15746 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:29.723498 15750 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.712306 17114 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:29.734011 17208 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:17:29.734869 17196 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:17:29.736769 17065 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.737358 17065 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.711742 17177 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:29.788354 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.789127 16308 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:29.720669 17170 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.797592 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.705416 17178 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.723716 15749 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:29.799606 17029 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:29.804891 17207 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.805431 17178 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.805729 17191 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.734921 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.729099 15669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:29.841600 17065 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.850342 17029 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.841651 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.822609 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.852516 16306 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:17:29.836673 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.881322 17188 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.870865 17189 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:29.883481 15594 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:29.884513 17189 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.785348 17177 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:29.895537 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 177241us
I20260709 13:17:29.895185 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.801306 17150 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.905923 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:29.906713 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 123954us
I20260709 13:17:29.806823 17187 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:29.911139 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.923816 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.920325 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:29.925004 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.925248 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.929754 17137 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.930788 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.933146 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.908030 15669 raft_consensus.cc:606] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:29.938527 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:29.942062 17144 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.942538 17144 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:29.942904 17144 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.944360 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:29.938802 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:29.936048 15567 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.945317 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.945513 15640 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:29.945209 15600 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:29.926615 17196 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:29.960878 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.962592 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:29.966310 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.972358 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.973419 15567 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.975449 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:29.977447 17114 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:29.977782 17168 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:29.965113 17167 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.978880 17167 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.979408 17167 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:29.956847 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:29.977888 17114 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.951298 17197 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:29.993456 17114 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.958227 17196 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:29.984807 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:29.985131 17204 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:29.985698 17209 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:30.017549 17209 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.018152 17209 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:29.987433 17025 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:29.984405 17202 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.008509 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.008919 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.011849 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:30.012672 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:30.021478 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 76029.6us
I20260709 13:17:30.022445 15640 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:30.013425 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.015319 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:30.026589 17211 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:17:30.027124 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.027884 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.012349 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.971114 17191 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.032979 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:30.023521 17187 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:30.023538 17212 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:30.024250 17210 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.024441 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.024856 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.002226 17168 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.030061 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.045001 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.031070 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.039281 15567 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:30.006110 17196 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:30.030550 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.031899 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.078308 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:30.092129 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.093478 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:30.068849 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.065160 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.094071 15672 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.095058 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.079489 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:29.984467 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.082219 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.099171 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:30.101547 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.061766 15716 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.067437 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:30.095420 15742 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:30.096688 15565 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.069885 17195 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.097335 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.096737 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.068140 17168 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:30.088035 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 128474us
I20260709 13:17:30.103852 15565 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.097303 17025 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:30.022295 17204 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.104210 15716 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.029317 17202 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.102530 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.108301 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:30.091668 17178 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.104265 17169 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:30.110913 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45321.4us
I20260709 13:17:30.081142 17189 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:17:30.113417 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.105886 17195 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:30.104781 17136 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.080749 17210 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:30.115427 17202 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.121995 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.133112 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.114399 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.123332 15640 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:30.123423 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.104707 17187 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:30.110852 17168 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.115450 17178 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.125381 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.104812 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:30.111341 15743 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:30.113613 17204 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.099438 17212 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:30.112412 17025 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.141933 17025 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:30.103551 17191 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:30.115695 17137 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.142232 17177 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.119928 17169 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.134975 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.155980 15673 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:30.112303 17198 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.131942 17210 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.112116 17166 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.136958 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.126508 17213 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:30.143695 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.140027 17188 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:30.132378 15593 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:30.131115 17193 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.128978 17195 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.143491 17212 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.192128 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.173193 17169 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.124500 17062 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.139079 17178 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.146920 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.138427 17187 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.145515 17191 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.180058 17166 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.181758 17188 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.195508 17193 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.187081 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:30.191597 17213 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:30.203163 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 92573.9us
I20260709 13:17:30.190568 17189 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.189720 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.206506 17166 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.215005 15597 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:30.204691 17191 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:30.209697 17188 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.201753 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.206205 17198 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.209178 17206 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.212548 17193 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.230635 15565 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.235003 17196 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.217103 17213 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.221103 17200 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:30.242359 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 139895us
I20260709 13:17:30.247959 15672 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:30.248914 15677 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:30.254812 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.229521 15593 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:30.259979 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:30.223453 17189 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.236426 17204 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.270097 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.278165 17196 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.227101 17198 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:30.273192 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 304760us
I20260709 13:17:30.299391 15565 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.299321 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.304100 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.270865 17181 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:30.307910 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:30.309612 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.311033 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.313527 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.315054 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.312415 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.262810 17205 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.258980 17221 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.296285 17177 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.301635 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.322813 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:30.314558 17203 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.616s	user 0.023s	sys 0.012s
I20260709 13:17:30.301724 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:30.388561 17029 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:30.314149 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:30.397370 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 95858.3us
I20260709 13:17:30.397233 17029 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.302865 17114 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.316386 17181 raft_consensus.cc:697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:30.412398 17152 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.413173 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.321861 17222 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.417276 17029 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.397085 17207 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:30.419085 17223 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.390280 17203 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.430634 17114 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.432505 17204 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.411079 17167 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.434630 17167 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.435277 17191 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.431962 17209 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.402923 17187 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:30.417057 17222 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.445595 17191 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.446442 17166 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.410697 17205 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.426154 17223 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.448028 17213 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.453519 17166 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.449435 17168 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.443476 17222 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.458220 17210 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.451067 17189 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.461505 17188 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.463140 17188 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.423998 17207 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:30.452840 17223 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.464883 17212 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:30.500977 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 202112us
I20260709 13:17:30.505283 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:30.508946 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 188387us
I20260709 13:17:30.387660 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.508013 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.530288 15600 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:30.529032 15594 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:30.528700 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.529106 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.401155 15642 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.534631 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:30.536017 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 134820us
I20260709 13:17:30.534060 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.464385 17195 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:30.550138 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.550585 17203 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.551760 17168 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.554828 17209 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.555642 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.468858 17213 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.545305 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.574045 15751 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:30.581935 15601 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:30.587364 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 47031.3us
I20260709 13:17:30.594719 17206 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.599962 17231 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.602682 15750 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:30.604882 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 281377us
I20260709 13:17:30.605465 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.606508 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.606745 17207 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.458573 17193 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.603997 17195 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.620844 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.623188 15602 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:30.602651 17232 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:30.625201 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 226949us
W20260709 13:17:30.629626 17144 consensus_meta.cc:287] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.011s
I20260709 13:17:30.630430 17144 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.449633 17181 consensus_queue.cc:237] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.634902 16263 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.639928 17221 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.640863 17210 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.641093 15747 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:30.642679 17152 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.646646 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.653148 15745 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:17:30.654277 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:30.657289 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.646824 17212 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.651151 17178 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.600427 17205 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.667299 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.668133 15746 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.670843 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.671828 15742 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:30.667151 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.672919 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.674079 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.663529 17114 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:30.678798 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.679634 15751 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.684455 17198 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:30.663790 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 50380.9us
I20260709 13:17:30.691953 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:30.692719 17193 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.692006 15593 raft_consensus.cc:1240] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:30.645324 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.696236 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.698789 17199 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.702719 15751 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:30.704196 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 76558.8us
W20260709 13:17:30.707589 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 199796us
I20260709 13:17:30.710414 17152 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.714257 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:30.715961 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1475) took 1071 ms. Trace:
I20260709 13:17:30.718622 17180 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.719452 15675 rpcz_store.cc:276] 0709 13:17:29.644413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.644529 (+   116us) service_pool.cc:224] Handling call
0709 13:17:30.713666 (+1069137us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:30.715820 (+  2154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6454656}
I20260709 13:17:30.735733 17192 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:30.736541 17192 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.738900 17192 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.720304 15744 raft_consensus.cc:1240] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 13:17:30.765116 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 53208.6us
I20260709 13:17:30.767311 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.772758 17144 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.773015 17178 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.773604 15498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 207) took 1138 ms. Trace:
I20260709 13:17:30.774098 15498 rpcz_store.cc:276] 0709 13:17:29.634764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.634908 (+   144us) service_pool.cc:224] Handling call
0709 13:17:30.773295 (+1138387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3508,"reported_tablets":1}
W20260709 13:17:30.777639 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 139903us
I20260709 13:17:30.778349 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:30.778957 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.780683 16265 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.781874 17144 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.801229 17214 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.801626 15742 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:30.803782 15746 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:30.805940 17169 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.604s	user 0.000s	sys 0.015s
I20260709 13:17:30.806645 17169 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.811240 16265 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:17:30.813975 17025 consensus_meta.cc:287] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.671s	user 0.003s	sys 0.016s
I20260709 13:17:30.814695 17025 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:30.824790 17215 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.837123 17144 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.837641 17144 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.838007 17144 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.843403 17222 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:30.747421 17202 consensus_meta.cc:287] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.517s	user 0.014s	sys 0.005s
I20260709 13:17:30.850711 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.868590 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.869151 17222 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.869547 17169 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.870481 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.875833 17186 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.876696 17186 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.878988 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58156 (request call id 9) took 1156 ms. Trace:
I20260709 13:17:30.849879 17215 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:30.887234 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 108519us
I20260709 13:17:30.885514 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 199) took 1161 ms. Trace:
I20260709 13:17:30.889583 15597 rpcz_store.cc:276] 0709 13:17:29.725325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.931648 (+206323us) service_pool.cc:224] Handling call
0709 13:17:29.931951 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.220647 (+288696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.883278 (+662631us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b5400248954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:30.885286 (+  2008us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592412928}
I20260709 13:17:30.896008 17238 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.882498 15669 rpcz_store.cc:276] 0709 13:17:29.722589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.724644 (+  2055us) service_pool.cc:224] Handling call
0709 13:17:30.625780 (+901136us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540015f2a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe66d520 00007faefe6ea652 00007faf036b860a 00007faefcc3e7d4 00007faefcc3e762 00007faefcc3e691 00007faefcc3e60c 00007faefcc3d8c2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:30.878393 (+252613us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b540015f2a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe66b5e7 00007faefe6eac68 00007faefe6ea84a 00007faf036b860a 00007faefcc3e7d4 00007faefcc3e762 00007faefcc3e691 00007faefcc3e60c 00007faefcc3d8c2 00007faefca2b48c
0709 13:17:30.878721 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108458112}
I20260709 13:17:30.895846 17215 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.886783 17223 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:30.901026 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 90019.6us
W20260709 13:17:30.904650 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 48346.1us
I20260709 13:17:30.860138 17202 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:30.905418 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.906946 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.907311 17202 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:30.895884 17187 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.908218 15670 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:30.909384 17228 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.911407 17025 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.911764 17223 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:30.913697 17239 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.915723 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 317) took 1238 ms. Trace:
I20260709 13:17:30.916488 15497 rpcz_store.cc:276] 0709 13:17:29.676337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.676491 (+   154us) service_pool.cc:224] Handling call
0709 13:17:30.914670 (+1238179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396318,"reported_tablets":3}
I20260709 13:17:30.917739 15565 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.926389 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.928896 15748 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:30.934804 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62333.2us
I20260709 13:17:30.935814 15642 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.937744 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.939357 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.929314 17025 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:30.945796 17202 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:30.946875 16265 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.947901 17228 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.948330 17228 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.948751 17228 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.938938 17223 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.951119 17214 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:30.954573 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 47743.1us
I20260709 13:17:30.955520 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.957978 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:30.957854 16265 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.959225 17150 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.959800 17150 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:30.960346 17150 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.953497 17215 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:30.966420 17223 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:30.967981 17223 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.968480 17223 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.973397 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:30.978480 16263 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:30.980089 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.981178 17220 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:30.981472 16265 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:30.976455 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:30.983824 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:30.985355 15567 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:30.987710 17239 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:30.988373 17178 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:30.993034 17178 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:30.993356 17178 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:31.002874 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 86730.3us
W20260709 13:17:31.003439 15714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.613s (SENT) [suppressed 1 similar messages]
I20260709 13:17:31.006085 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:31.007779 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 86141.3us
I20260709 13:17:30.965869 17202 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:31.008936 17241 consensus_queue.cc:1059] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:31.015420 17241 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:31.015820 17241 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.017933 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:31.018603 17025 consensus_queue.cc:1059] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.019259 17238 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.019634 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:31.019848 17238 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.020107 17083 consensus_queue.cc:1059] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:31.010658 17190 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.020485 17169 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:31.021387 17083 raft_consensus.cc:3055] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.021668 17169 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.020990 17238 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.021930 17083 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.022853 17169 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.022894 17083 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.024562 17083 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.025300 15597 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:31.027760 17025 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:31.028224 17025 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.017457 17241 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.012521 16265 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.030316 17216 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.030740 17216 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:31.031132 17216 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:30.992694 17215 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.039036 15598 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:31.039572 15670 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:31.039915 15669 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.008164 17239 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.043210 15567 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:31.041635 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:31.044014 17025 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.043776 17187 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:31.048173 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.015722 17144 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.057164 17187 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.009781 17178 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:31.064453 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 88107.8us
I20260709 13:17:31.053580 17241 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.067106 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.068866 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.070904 17178 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:31.072038 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.074306 17114 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.081303 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.081890 17114 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.082823 15669 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:31.083000 17114 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.077955 17187 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:31.085009 17144 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:31.074991 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62625.7us
I20260709 13:17:31.091043 17187 raft_consensus.cc:993] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: : Instructing follower 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:31.091006 15716 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.092447 17181 raft_consensus.cc:1081] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Signalling peer 398beb97ee4b40688f6279f18fa51ade to start an election
I20260709 13:17:31.093212 17223 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.094286 17181 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.079186 17200 consensus_queue.cc:1059] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:31.045562 17202 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.107563 17220 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.107635 17025 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.114748 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:31.115427 15748 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:31.116456 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.118355 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.119727 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:31.095865 17150 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.137676 15598 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:31.119973 17200 consensus_queue.cc:1243] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:17:31.144269 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 64464.8us
I20260709 13:17:31.136251 17190 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.148233 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.149369 15593 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.136533 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.150508 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:31.126247 17216 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.156978 17202 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.158576 15599 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.161484 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:31.162328 15746 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:31.166884 16309 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.166807 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.173635 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.174404 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.163589 15594 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.172931 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.169586 16302 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:31.185694 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.186378 17190 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.187299 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.187742 15593 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.188939 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:31.189647 15751 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.185863 17150 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.191296 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.197777 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.199582 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:31.203066 15642 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.204612 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.205623 17175 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:31.209870 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.211251 15748 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:31.212467 15567 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:31.209748 17175 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:31.229162 15599 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.231014 17025 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:31.233309 15751 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:31.237874 16308 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:31.216542 17175 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.244364 17025 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.243430 15716 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.246604 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.216655 17190 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.251281 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.255535 15599 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:31.253873 17025 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.252738 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.245527 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.260869 17139 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.261003 17180 consensus_queue.cc:1059] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:31.261015 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.263703 16308 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.252668 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.269800 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.273555 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.279162 15716 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.271236 15598 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:17:31.284286 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.293200 17183 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:17:31.288576 17181 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.295975 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.296568 17178 raft_consensus.cc:3055] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.275483 17139 consensus_queue.cc:1059] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:17:31.297057 17178 raft_consensus.cc:740] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.290499 15677 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:31.301496 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.302582 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.304020 15593 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.305274 15598 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.309993 15599 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.311170 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.311937 16309 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:31.316512 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.300230 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.320515 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:31.324415 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 56720.8us
I20260709 13:17:31.315117 17202 consensus_queue.cc:1059] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:17:31.327476 17245 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:17:31.328421 17186 raft_consensus.cc:3055] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.328863 17186 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:31.329865 17186 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.331204 17186 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.331620 15594 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.333241 16307 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.334489 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:31.335817 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.336695 15593 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.341269 17139 raft_consensus.cc:3055] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:31.341778 17139 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:31.350510 17139 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.353237 16307 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.353785 16304 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:31.358388 17223 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.364993 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.366127 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.366227 17175 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:31.366539 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.367789 17187 raft_consensus.cc:3055] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.368165 15670 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:31.368371 17187 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:31.369658 17187 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.371073 17187 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.379390 16307 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.380894 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.371770 15671 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:17:31.352324 17139 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.381826 17216 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.395927 16299 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.397773 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.399061 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.399855 15672 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 2: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:31.321455 17228 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.401729 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.402118 17228 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.404917 16302 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.406044 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.407397 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.406031 17178 consensus_queue.cc:260] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.374534 17175 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.399600 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.412485 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:31.376075 16309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
 from {username='slave'} at 127.0.0.1:47962
I20260709 13:17:31.396023 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:17:31.422966 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 137182us
I20260709 13:17:31.424880 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:31.431007 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.430017 16309 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:31.433727 16309 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.436010 16306 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.437554 16265 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:31.438377 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:31.447194 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.450291 15594 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:31.452433 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:31.452864 17246 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:17:31.453981 15671 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:31.455497 17150 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.456180 17150 raft_consensus.cc:697] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:31.457237 17150 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.464586 15716 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.466095 15716 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.466382 15599 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:31.466953 17139 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:31.467813 15716 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:31.468158 17139 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.469075 17139 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.469823 17139 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.470180 17139 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:31.471076 17139 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.471936 16309 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.472446 17139 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.474054 16309 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.474848 17248 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.435009 17187 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:31.501562 17248 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:31.477083 17247 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:17:31.482456 16310 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.483261 17180 raft_consensus.cc:3055] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.483469 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.485005 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.485394 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.486047 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:31.491592 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:31.491904 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.494233 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.498497 17178 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.498112 16302 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:31.499747 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.500072 15716 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.500510 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.501035 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:31.501358 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:31.527817 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.533375 16307 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 2: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:31.533613 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:31.539942 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 56573.9us
W20260709 13:17:31.546357 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 67226.5us
I20260709 13:17:31.546262 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:31.540792 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45099.3us
I20260709 13:17:31.529816 17248 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:31.542382 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 112151us
I20260709 13:17:31.501870 17187 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:31.547762 17025 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:31.548024 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 56515.9us
I20260709 13:17:31.539052 15669 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:31.560817 17187 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:31.562430 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.562871 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.551679 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.530172 17180 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:31.538648 17175 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.567615 16304 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 2: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:31.572700 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:31.573707 17249 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.574402 17217 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.574831 15567 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.579200 17238 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:31.579726 17238 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.581317 17180 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.582685 17180 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.583130 17238 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.584563 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.585806 15599 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:31.584939 17238 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:31.586953 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.587167 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 87178.3us
I20260709 13:17:31.590075 15716 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:31.592757 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:31.592041 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.594401 15600 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:31.595384 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.595566 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.596009 15597 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:31.596372 15596 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:31.584939 17175 consensus_queue.cc:1059] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:17:31.584990 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.599673 17202 raft_consensus.cc:3055] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.600018 17202 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:31.600358 17181 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.586609 17238 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.600795 17181 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:31.601282 17181 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.601083 17202 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.591820 15497 catalog_manager.cc:5697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.603351 17239 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:31.603380 15716 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.576823 17083 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.614631 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.615458 15599 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:31.620872 17183 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.604121 17239 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.622906 17183 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:31.624261 17255 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:31.625802 17083 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.624648 17255 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:31.633780 17220 consensus_queue.cc:1059] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:31.633915 17255 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.634981 17220 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:31.635367 17220 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:31.636134 17239 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:31.636394 17220 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.637722 17220 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:31.638700 17187 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:31.640764 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.635311 17255 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:31.643599 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:31.644570 15751 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:31.645366 17183 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:31.645769 17183 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:31.646134 17183 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.646548 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:31.647225 15746 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.647001 17248 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:31.648931 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.617233 17190 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.649732 15672 raft_consensus.cc:1240] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.650602 17238 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:31.651414 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:31.652943 17187 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:31.657202 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:31.658121 17238 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.660442 15672 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.673698 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:31.676999 17083 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:31.677316 15751 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.677204 15498 catalog_manager.cc:5697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.678241 17083 raft_consensus.cc:3055] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.678632 17083 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.679493 17083 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.681085 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:31.681653 15750 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.684048 15751 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:31.685547 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:31.690155 15748 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:31.692852 15601 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.695149 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:31.696095 15748 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.696698 15748 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:31.697460 15748 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.698405 15748 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.699226 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.702833 17238 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:31.703377 17238 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.704308 17238 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.706831 15750 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
W20260709 13:17:31.709240 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 149710us
I20260709 13:17:31.709954 15746 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:31.710245 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.716548 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:31.702193 17083 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.727141 17025 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.727485 15748 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:31.728859 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.730505 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.731613 15594 raft_consensus.cc:2410] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:17:31.721470 17186 consensus_queue.cc:1059] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:31.716385 17190 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:31.736126 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 73520.2us
I20260709 13:17:31.737486 15601 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:31.746730 15640 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.748296 17259 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.749850 17259 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.750298 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.753865 15594 raft_consensus.cc:1240] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:31.757731 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:31.757129 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.759104 16265 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:31.761356 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.746661 17262 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:17:31.759986 16265 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:31.763042 15746 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:31.734306 17248 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:31.764385 16265 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:31.765542 16265 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:31.765798 17025 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.766422 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:31.767719 16304 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.768893 17256 raft_consensus.cc:3055] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.769506 17256 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:31.771582 17223 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.772336 17223 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:31.773859 17257 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:31.773715 17223 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.774631 17257 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.777173 17025 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.777570 17025 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.778478 17025 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.779681 17025 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.781638 17257 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:31.781024 17190 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.782510 17241 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.783434 17190 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:31.784009 15751 raft_consensus.cc:1240] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.785117 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.785720 17257 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.786788 17255 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.786639 17181 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.788232 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.765182 17187 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.788808 15750 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:31.789019 17257 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.790464 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.791283 17257 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.791424 17228 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.792183 17228 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:31.792480 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:31.792706 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.793577 17257 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.793581 17228 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.795635 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:31.796401 15714 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.797369 17257 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.797845 17183 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.799743 15744 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.800380 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.800879 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:31.770735 17256 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.801513 17257 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:31.802335 15750 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.802165 17190 consensus_queue.cc:1059] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.802778 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:31.803551 15601 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:17:31.803440 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.804390 15751 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:31.804632 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.804431 15565 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:17:31.808995 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 43549.6us
W20260709 13:17:31.812690 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 67009.6us
I20260709 13:17:31.805244 15595 raft_consensus.cc:2376] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3. Re-sending same reply.
W20260709 13:17:31.817170 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 65647.8us
I20260709 13:17:31.804483 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:31.875690 17202 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:31.941087 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 136738us
I20260709 13:17:31.941854 15565 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.942101 17256 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.943493 15565 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:31.944707 17178 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:31.945555 17178 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:31.902758 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.950237 17178 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:31.950971 17178 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.951617 17196 consensus_queue.cc:1059] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:31.952987 17217 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:31.953390 17217 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.954211 17217 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.955085 17178 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:31.883682 17183 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:31.955843 17217 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:31.744335 17175 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
W20260709 13:17:31.925968 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 125652us
W20260709 13:17:31.926805 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.958643 17175 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.959546 17175 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:31.960253 17175 consensus_queue.cc:1059] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:31.961567 17196 consensus_queue.cc:1059] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.962551 17196 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:31.963954 17196 raft_consensus.cc:3055] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.964340 17196 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:31.965175 17196 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.966660 17196 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:31.970134 17202 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.971120 17202 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:31.971658 17178 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:31.937825 17181 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:31.938261 17239 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.939914 17189 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:31.973083 17178 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:31.836148 15598 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:31.805162 17220 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:31.934541 15640 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:31.977885 17263 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.978267 17263 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:31.979724 17263 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:31.981447 17263 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:31.937320 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.989293 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.978024 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 43608us
I20260709 13:17:31.990464 17025 raft_consensus.cc:3055] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:31.990895 17025 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:17:31.989056 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 178687us
I20260709 13:17:31.998716 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:17:32.001596 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 175391us
I20260709 13:17:32.002008 17269 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:32.004287 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45737.2us
W20260709 13:17:32.008010 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 64571.7us
I20260709 13:17:32.005115 17025 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:31.978399 17256 raft_consensus.cc:3055] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:17:32.024022 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 53911.6us
W20260709 13:17:32.025648 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.031765 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:32.035881 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:32.004101 17239 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:32.048498 15750 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:32.053380 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:32.019773 17256 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.058537 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:32.066534 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:32.018755 17181 consensus_queue.cc:1059] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:17:32.047261 17150 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.070465 17025 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:32.071056 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.087029 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.009771 17202 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.089529 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:32.057224 17189 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.052889 17175 consensus_queue.cc:1059] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:17:32.101022 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 93222.9us
I20260709 13:17:32.054833 17180 consensus_queue.cc:1059] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:17:32.104241 15640 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:32.105141 17259 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.105548 17259 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:32.105711 15750 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.105993 17259 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.107399 17267 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.108224 17267 consensus_queue.cc:1243] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:17:32.108676 17267 consensus_queue.cc:1059] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:32.109571 17267 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:32.110073 17267 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.112226 17267 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:32.112790 17262 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.113279 17262 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.112984 17272 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:32.113713 17259 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.035881 17269 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:17:32.041523 17271 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:17:32.123560 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 62226.7us
I20260709 13:17:32.072937 17266 consensus_queue.cc:1059] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
W20260709 13:17:32.141459 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.139084 17259 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:32.151829 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.097927 17241 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:17:32.122417 17256 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.114298 17262 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.099865 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:32.162168 17262 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.173285 17256 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:32.174459 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 119354us
W20260709 13:17:32.195658 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 188419us
I20260709 13:17:32.141412 17257 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.198598 15565 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.204659 15744 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:32.162472 17269 consensus_queue.cc:1243] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:17:32.163250 17267 raft_consensus.cc:3055] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:17:32.207640 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 145741us
I20260709 13:17:32.209121 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.173283 17202 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.213164 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:32.184001 17150 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:32.174129 17217 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:32.217576 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.220005 16307 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.220086 16309 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:32.221683 17025 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:32.225874 15744 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.210425 17263 raft_consensus.cc:3055] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.230610 15742 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.162048 17239 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.232292 15749 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:32.234418 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:32.237102 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:32.210883 17267 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.245270 17144 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:32.240228 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.252269 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:32.254858 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.255388 15746 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
W20260709 13:17:32.255564 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.257391 17025 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.258293 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:32.261037 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:32.263541 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:32.265422 15671 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:32.267994 15674 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.237716 17273 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:32.268810 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:32.237414 17263 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.272765 15675 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.275564 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.251307 17187 raft_consensus.cc:3055] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.256549 17277 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.232329 17274 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.279402 15750 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:32.278904 17270 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 13:17:32.267001 17271 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.286347 17150 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.226938 17217 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.266155 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:32.271024 17273 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.285346 17144 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.288623 17259 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:32.281855 17187 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:32.338013 17216 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:32.340090 17216 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:32.342555 15748 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.344074 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:32.279973 17267 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.351132 15746 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:32.352638 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:32.340456 17216 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:32.331672 17259 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.376791 15500 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.384503 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:32.388737 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:32.388836 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 125502us
I20260709 13:17:32.388942 15674 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:32.389868 15565 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.394804 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:32.397086 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:32.401294 15751 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:32.406919 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:32.407972 17255 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.408516 17255 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.409601 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.410593 17255 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:32.411208 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.393712 17187 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.412981 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:32.413290 17025 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.414212 15746 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:32.414554 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:32.413076 17283 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:32.417732 17271 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:32.418883 15672 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.419384 17259 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.420871 17259 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.374457 17220 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:32.422756 17248 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:17:32.425352 17268 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.397s	user 0.003s	sys 0.002s
I20260709 13:17:32.392777 17267 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.422144 17220 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:32.434832 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 197788us
I20260709 13:17:32.441781 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.446530 15642 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:32.450405 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:32.403870 17280 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.415398 17274 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.454231 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:32.460031 15751 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.370533 17263 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.418905 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:32.463969 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.464118 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:32.468535 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.470275 15751 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.470965 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:32.471844 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:32.471633 17280 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.472357 15744 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.472471 15602 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.473227 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.473683 15744 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.473752 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.474498 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.474725 15602 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:32.475528 15749 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.477555 15598 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:17:32.471903 15596 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:32.475080 15597 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:32.475072 15601 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:32.484699 15673 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:32.486084 15599 raft_consensus.cc:2393] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:32.469277 15595 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
W20260709 13:17:32.488816 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 72326.9us
W20260709 13:17:32.494051 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.494128 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.494885 15600 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:32.493449 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:32.496614 15751 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:32.462950 17266 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.456947 17217 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:32.464756 17271 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.509290 15677 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:32.500061 17263 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.521696 15677 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.514776 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:32.510434 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 56886.2us
I20260709 13:17:32.487160 17289 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.523874 17025 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:32.504972 17283 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:32.415632 17273 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.534917 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.535205 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.535894 15595 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:32.509418 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.510126 17202 consensus_queue.cc:1059] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:17:32.462724 17216 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.545130 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:32.543730 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:32.554441 15748 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:32.548108 15565 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.537377 15602 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.550868 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:32.558921 15676 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:32.551182 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:32.559724 15601 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:32.560472 15673 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:32.563136 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.541456 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.566666 15600 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:32.569352 15670 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:17:32.572007 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.579517 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:32.522619 17271 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:32.551422 17187 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.551923 17083 raft_consensus.cc:3055] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:32.552820 17273 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.531414 17266 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.559111 15593 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.543301 17280 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:32.585960 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:32.601907 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 166561us
I20260709 13:17:32.544461 17295 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:32.605259 15602 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:32.606266 17238 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:32.583892 17083 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:32.587654 15677 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.580055 17283 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.594805 17266 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.596797 17282 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:32.584430 17278 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.598601 17257 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.565227 17196 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.584551 15596 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:32.603641 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.614464 17083 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.615784 17083 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.603328 15567 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.543426 17269 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:17:32.610164 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.610589 15595 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:32.585763 16304 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.621800 15672 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:32.621054 15640 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:32.619443 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:32.625372 15642 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:32.630276 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:32.631419 17202 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.631616 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:32.632347 15593 raft_consensus.cc:2376] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3. Re-sending same reply.
I20260709 13:17:32.638226 15746 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:32.642997 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:32.622296 17217 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:32.612627 17278 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:32.643703 15602 raft_consensus.cc:2376] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3. Re-sending same reply.
I20260709 13:17:32.611423 17259 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:17:32.652547 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:32.625178 17183 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.640730 17238 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:32.665445 17269 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:32.608969 17271 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.649883 17202 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.628485 17189 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:17:32.653780 17278 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.644234 17196 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:32.661103 17259 consensus_queue.cc:1243] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:17:32.696406 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 69073.4us
I20260709 13:17:32.669176 17238 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:32.702726 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 61085.3us
I20260709 13:17:32.703536 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:32.676839 17289 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:32.625703 17282 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.705474 17238 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.726204 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.728073 15640 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:32.734576 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.714775 17202 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:32.736887 15596 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:32.700811 17266 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 13:17:32.737578 17294 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
W20260709 13:17:32.797364 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 112473us
I20260709 13:17:32.740265 17281 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:32.789850 17299 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
I20260709 13:17:32.760952 17256 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:32.761358 17202 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:17:32.831687 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 266651us
I20260709 13:17:32.790992 17144 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.790223 17269 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.711885 17289 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.759835 17257 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.699146 17283 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.801076 17267 consensus_queue.cc:1059] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:32.842736 15671 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.831278 17297 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:32.839231 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.836764 17190 raft_consensus.cc:3055] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:17:32.846174 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 111715us
I20260709 13:17:32.850196 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.846194 17256 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.856276 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.852921 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.848739 17190 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.861315 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:32.863039 15602 raft_consensus.cc:2393] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:17:32.854079 17300 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:17:32.853341 17314 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.852415 17311 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.867655 16263 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:32.868454 17272 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.892867 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:32.865481 17255 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:32.895766 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.887802 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.892923 17311 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.892478 17202 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:32.900465 17277 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.004s
I20260709 13:17:32.905225 17277 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.901261 17272 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:32.900532 17301 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:32.903146 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:32.902163 17302 consensus_queue.cc:1059] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:17:32.904101 17314 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.906031 17267 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:17:32.849980 17281 consensus_queue.cc:1059] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:17:32.921597 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:32.855700 17297 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.853914 17256 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:32.913269 17255 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:32.890617 17282 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:32.945221 17316 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:32.920845 17144 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:32.946676 15674 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:32.914988 17301 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:32.962653 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.970363 17311 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:32.971235 15747 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.971344 15746 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.979945 15742 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.921947 17190 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:32.956353 17273 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:33.016664 15744 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:32.959347 17301 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.020377 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 68985.4us
I20260709 13:17:32.950278 17289 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:32.942330 17263 consensus_queue.cc:1059] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:17:32.942745 17277 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:17:33.039824 17238 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.041024 17190 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:33.041497 17296 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:17:33.047722 17139 raft_consensus.cc:3055] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.048195 17139 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:33.041359 17262 raft_consensus.cc:3055] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.049610 17297 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.051529 17262 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:32.916415 17269 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.042408 17311 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:33.061164 17311 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.063951 17311 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.052846 17262 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.057590 17263 consensus_queue.cc:1243] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:33.066958 17311 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.034363 17273 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.080513 17282 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:33.149775 17264 log.cc:927] Time spent T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:17:33.054973 17255 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:33.151844 17187 consensus_meta.cc:287] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.001s
I20260709 13:17:33.149816 17279 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:33.168277 15745 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:33.104393 17311 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.093180 17282 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.159348 17262 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.166644 17217 consensus_meta.cc:287] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.004s
I20260709 13:17:33.195629 17190 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.196194 17190 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.171411 17271 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:33.194557 17187 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:17:33.176828 17279 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:33.156914 17293 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:33.197173 17241 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.198276 17217 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:33.212196 17190 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.214064 17241 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.246114 17319 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.214571 17297 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:17:33.261953 17238 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.168344 17272 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.265352 16307 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:33.267886 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.269531 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:33.270259 16306 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:33.168588 17313 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.252283 17241 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.271757 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:33.265360 17083 consensus_meta.cc:287] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.647s	user 0.013s	sys 0.000s
I20260709 13:17:33.279953 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:33.212486 17271 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.301929 15677 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:33.213282 17293 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.309104 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:33.309204 15594 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:33.319192 17257 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:33.270327 17319 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.325160 17267 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.307402 17313 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.353598 17301 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.355801 17313 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.338795 17190 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:33.367092 17293 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.333140 17279 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.373093 17301 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.373265 15669 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:33.376502 17267 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.342561 17257 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.376955 15677 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:33.387471 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:33.412339 17318 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:33.412788 17186 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:17:33.413017 17318 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.386029 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:33.406344 17321 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:17:33.389169 17262 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.382925 17319 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.392385 17271 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.417771 17279 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:33.381393 17190 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.415024 15602 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:17:33.416023 17262 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.431586 17262 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:33.437553 17278 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.735s	user 0.010s	sys 0.003s
I20260709 13:17:33.433677 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1518) took 1034 ms. Trace:
I20260709 13:17:33.438736 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1223) took 1056 ms. Trace:
I20260709 13:17:33.422957 17216 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:33.390141 17282 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.439236 15745 rpcz_store.cc:276] 0709 13:17:32.382321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.393766 (+ 11445us) service_pool.cc:224] Handling call
0709 13:17:33.438541 (+1044775us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b540002b054. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:33.438661 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772013440}
I20260709 13:17:33.439116 15674 rpcz_store.cc:276] 0709 13:17:32.398965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.406587 (+  7622us) service_pool.cc:224] Handling call
0709 13:17:33.433444 (+1026857us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54003a4654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:33.433595 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239296256}
I20260709 13:17:33.380996 17313 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:33.438125 17278 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.441622 17318 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.499343 17313 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.500882 15597 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:33.519042 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1481) took 1004 ms. Trace:
W20260709 13:17:33.455085 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 431693us
I20260709 13:17:33.473973 17291 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.488238 17271 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:33.537240 17271 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.542223 17271 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.489140 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:33.553548 15668 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:33.391098 17144 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:33.545730 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.543427 17239 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:17:33.524260 15597 rpcz_store.cc:276] 0709 13:17:32.514496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.515462 (+   966us) service_pool.cc:224] Handling call
0709 13:17:33.387328 (+871866us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:33.518977 (+131649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3659008}
I20260709 13:17:33.554944 17291 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.557448 17319 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.557958 17291 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.558135 17319 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.561690 17319 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.564739 17319 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.565562 17279 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.565469 17319 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.566336 17279 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.569043 17271 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:33.569541 17279 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.545701 17220 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:17:33.574599 17284 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.003s	sys 0.030s
I20260709 13:17:33.575004 17190 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:33.575966 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.576264 17313 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.577603 17269 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.578011 17313 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:33.578166 17269 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.578780 17313 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:33.575122 17284 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.004s	sys 0.030s
I20260709 13:17:33.544719 17311 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:33.570755 17318 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.583736 17309 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:33.584427 17139 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.586896 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.589061 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.610606 15748 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:33.592043 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.592867 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:33.612262 15746 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:33.611388 15745 raft_consensus.cc:2393] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:33.591200 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.569891 17271 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.558859 17291 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:33.548144 17301 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:17:33.581815 17304 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.582263 17282 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:33.639380 16264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.036s	sys 0.040s
I20260709 13:17:33.639019 17223 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:33.612623 17278 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.640681 17319 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.641366 17139 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.642705 15750 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:33.635465 17309 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:17:33.653271 15751 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.012s	sys 0.016s
W20260709 13:17:33.654546 15672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.024s
I20260709 13:17:33.649024 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:17:33.656525 16264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.037s	sys 0.040s
I20260709 13:17:33.653522 17257 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.657840 17273 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:33.662122 15672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.014s	sys 0.024s
W20260709 13:17:33.651087 17274 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.024s	sys 0.020s
W20260709 13:17:33.662582 15751 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.012s	sys 0.016s
I20260709 13:17:33.643759 17267 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:33.664438 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.013s
I20260709 13:17:33.611510 17318 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:33.668021 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.014s	sys 0.013s
W20260709 13:17:33.673962 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 641268us
W20260709 13:17:33.681610 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.692098 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:33.694105 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:33.694538 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:33.694796 16308 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:33.695408 16305 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:33.676060 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:33.698818 15714 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:33.700070 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:33.664220 17281 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.667938 17223 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:33.667615 17202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.024s
I20260709 13:17:33.655054 17282 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:33.713070 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.668212 17311 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:33.695982 17267 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.690487 17274 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.703224 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:33.699157 17180 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:33.711529 17202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.025s
I20260709 13:17:33.702459 17280 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.713956 17325 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:33.715358 17248 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:33.721822 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:33.714548 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:33.747340 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.748008 15597 raft_consensus.cc:2376] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5. Re-sending same reply.
I20260709 13:17:33.750850 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 231) took 1478 ms. Trace:
I20260709 13:17:33.751345 15671 rpcz_store.cc:276] 0709 13:17:32.269370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.269486 (+   116us) service_pool.cc:224] Handling call
0709 13:17:32.282006 (+ 12520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.846793 (+564787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.725382 (+878589us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b54002ccc54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:33.748046 (+ 22664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286684928}
I20260709 13:17:33.718482 17269 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.717628 17267 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.760926 17324 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:33.761868 17291 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.761965 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.762653 17291 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.776225 17288 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.721455 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:33.756814 17248 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:33.777136 17288 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.713631 17311 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.713804 17281 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.721181 17274 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.824235 17302 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.661051 17304 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.829381 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.788304 17189 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.830674 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.783149 17324 raft_consensus.cc:697] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:33.836056 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.836706 15742 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:33.837435 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.838210 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.839747 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.759013 17280 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.828943 17302 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.827816 17267 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:33.853924 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.829578 17325 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:33.840966 17256 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.022s	sys 0.054s
I20260709 13:17:33.722664 17309 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.839455 17257 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.833886 17282 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.829342 17274 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:33.877776 17311 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:33.867524 17256 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.023s	sys 0.054s
W20260709 13:17:33.888062 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50055.8us
W20260709 13:17:33.890192 15640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.023s	sys 0.023s
W20260709 13:17:33.894039 15640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.023s	sys 0.023s
I20260709 13:17:33.894639 15640 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:33.896106 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.846524 17189 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.896106 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:33.900068 17267 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.900817 17181 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:33.900614 17267 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.901296 17181 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.901526 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.902719 17267 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:33.895628 17150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.025s	sys 0.044s
I20260709 13:17:33.903290 17181 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:33.903918 17267 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:33.904354 17267 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.905078 17267 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:33.897341 17318 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:33.903501 17150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.026s	sys 0.044s
I20260709 13:17:33.897068 17282 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:33.906319 15748 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:33.903076 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.914484 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.915235 15602 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:33.839453 17324 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.876094 17257 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:33.925408 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.929664 15597 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:33.926877 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.878129 17325 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.934157 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.926630 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.936422 15602 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:33.928582 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.931690 15599 raft_consensus.cc:2393] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:33.945511 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 51318.3us
I20260709 13:17:33.945627 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:33.946331 15748 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:33.909201 17332 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:33.875424 17248 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:33.950579 15675 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:33.926769 17282 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.982672 15676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.022s
I20260709 13:17:33.983608 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:34.002717 15676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.007s	sys 0.022s
I20260709 13:17:33.986187 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.986419 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.948125 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:33.996739 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:34.003604 15745 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:34.017400 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.983323 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:34.018255 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:33.948877 17302 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:33.986465 17255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.007s	sys 0.023s
I20260709 13:17:34.023389 15745 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:33.992551 17318 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.026221 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 78186.1us
W20260709 13:17:34.025506 17255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.024s
I20260709 13:17:34.034493 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:34.082784 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:34.028847 17318 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.026384 15594 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:34.043495 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:34.054785 17178 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.056622 17341 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:17:34.037643 17280 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.023248 17180 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.134030 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:33.952889 17332 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.023753 17274 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:34.065318 15593 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:34.135512 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:34.043463 17181 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:34.136205 15594 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:34.110347 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:34.024865 17282 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:34.121869 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 87433.4us
I20260709 13:17:34.139412 15748 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:34.115943 17304 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.133646 17190 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:34.065845 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:17:34.144980 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 79229.2us
I20260709 13:17:34.150842 17325 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:34.150123 15597 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
W20260709 13:17:34.155782 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.127278 17333 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:34.157939 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:34.136705 17181 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.163386 15745 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:34.137035 17178 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.157085 17272 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:34.455219 17272 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.455906 17272 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:34.431262 17343 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:17:34.248673 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.140017 17180 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:34.146659 15593 raft_consensus.cc:1240] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:34.225953 17338 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:17:34.156328 17339 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.288723 17336 log.cc:927] Time spent T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 13:17:34.474721 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 222) took 1199 ms. Trace:
I20260709 13:17:34.218849 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:34.162833 17333 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.169222 17308 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.315752 17309 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:34.146204 17190 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.312327 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:34.311491 17342 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:17:34.397071 17196 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.304893 15498 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46324 (request call id 311) took 2646 ms. Trace:
I20260709 13:17:34.488248 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:34.334602 17257 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.242904 17334 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.518735 17318 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:34.519219 17340 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
W20260709 13:17:34.520807 17267 consensus_meta.cc:287] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.003s
I20260709 13:17:34.521029 17313 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.480978 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:34.522149 17223 consensus_meta.cc:287] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.002s
I20260709 13:17:34.522536 17282 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.139768 17274 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.561232 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:34.485833 15600 rpcz_store.cc:276] 0709 13:17:33.258372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.258754 (+   382us) service_pool.cc:224] Handling call
0709 13:17:33.262425 (+  3671us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.262804 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.262836 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.267713 (+  4877us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.663132 (+395419us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:33.663190 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.663257 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.396076 (+732819us) raft_consensus.cc:1685] finished
0709 13:17:34.396098 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.457746 (+ 61648us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":943,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3461,"thread_start_us":358204,"threads_started":1,"wal-append.queue_time_us":613340}
I20260709 13:17:34.311932 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:34.481873 17181 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:34.479631 17283 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:34.540144 15598 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:34.502131 17202 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.524345 17333 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.503223 17288 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:34.482725 17304 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:17:34.483887 17180 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.502476 17339 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.170202 17189 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:34.573413 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 111893us
W20260709 13:17:34.662555 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 284435us
W20260709 13:17:34.732473 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.652138 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.773849 17025 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:34.774489 17025 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.586656 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1522) took 1515 ms. Trace:
I20260709 13:17:34.787303 15597 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:34.788275 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:34.571965 15747 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:34.775401 15672 rpcz_store.cc:276] 0709 13:17:33.071306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.071507 (+   201us) service_pool.cc:224] Handling call
0709 13:17:33.071861 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.075224 (+  3363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.075257 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.077494 (+  2237us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.663998 (+586504us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:33.664063 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.664343 (+   280us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.586419 (+922076us) raft_consensus.cc:1685] finished
0709 13:17:34.586437 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.586587 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":4250,"thread_start_us":516751,"threads_started":1,"wal-append.queue_time_us":855048}
I20260709 13:17:34.736261 17360 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.599898 15594 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:34.803258 17025 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.805156 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:34.768266 17355 log.cc:927] Time spent T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:17:34.814039 15671 raft_consensus.cc:1240] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.558928 17308 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.574018 17267 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.815416 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:34.816269 15672 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:34.816779 17308 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:34.817271 17139 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:34.817682 17139 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:34.818058 17139 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:34.818250 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:34.819339 16295 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:34.819761 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 522) took 1125 ms. Trace:
I20260709 13:17:34.592166 17223 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:34.601500 17178 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.592276 17269 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.586643 17313 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.571028 17196 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.621922 17366 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.600009 17344 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.873574 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:34.938009 15677 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:34.938066 15597 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:34.836645 15742 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:34.938855 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:34.846313 15673 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:34.929761 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.872854 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:34.940279 15674 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:34.556965 15498 rpcz_store.cc:276] 0709 13:17:31.658653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.658827 (+   174us) service_pool.cc:224] Handling call
0709 13:17:34.304803 (+2645976us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:32.043514 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:32.044077 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:32.044108 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:17:32.044126 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:32.044435 (+   309us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:32.044477 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:32.044507 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:32.044716 (+   209us) tablet.cc:701] Row locks acquired
0709 13:17:32.044733 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:17:32.044862 (+   129us) write_op.cc:270] Start()
0709 13:17:32.044986 (+   124us) write_op.cc:276] Timestamp: P: 1783603052044819 usec, L: 0
0709 13:17:32.045009 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:17:32.045616 (+   607us) log.cc:844] Serialized 538 byte log entry
0709 13:17:32.917871 (+872255us) op_driver.cc:464] REPLICATION: finished
0709 13:17:33.046287 (+128416us) write_op.cc:301] APPLY: starting
0709 13:17:33.046355 (+    68us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:33.046457 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:33.046547 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:33.046778 (+   231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:33.046910 (+   132us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:33.046952 (+    42us) write_op.cc:312] APPLY: finished
0709 13:17:33.047142 (+   190us) log.cc:844] Serialized 23 byte log entry
0709 13:17:33.047309 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.047370 (+    61us) write_op.cc:454] Released schema lock
0709 13:17:33.047400 (+    30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":319810,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":126163,"apply.run_cpu_time_us":1450,"apply.run_wall_time_us":10800,"num_ops":1,"prepare.queue_time_us":355942,"prepare.run_cpu_time_us":2375,"prepare.run_wall_time_us":2375,"replication_time_us":869528,"thread_start_us":655375,"threads_started":1}]]}
I20260709 13:17:34.871377 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:34.931464 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.798040 17189 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.805136 17181 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.792618 17318 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:17:34.806397 16302 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:34.820081 16295 rpcz_store.cc:276] 0709 13:17:33.694258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.713752 (+ 19494us) service_pool.cc:224] Handling call
0709 13:17:34.818031 (+1104279us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:34.819677 (+  1646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451200}
I20260709 13:17:34.797746 17302 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.846560 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:34.797962 17257 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.872161 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:34.939388 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:34.899603 17365 log.cc:927] Time spent T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:17:34.573046 17334 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.911927 17187 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.894001 17139 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:34.896991 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:34.869915 17190 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:34.793805 17283 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.797869 17202 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.870645 17274 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.827739 17360 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.960487 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:35.348587 15641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.015s
W20260709 13:17:35.580324 15641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.010s	sys 0.017s
W20260709 13:17:35.162101 15676 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.001s	sys 0.009s
W20260709 13:17:35.581672 15676 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.008s	sys 0.019s
I20260709 13:17:35.582441 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1632) took 2501 ms. Trace:
I20260709 13:17:35.582854 15676 rpcz_store.cc:276] 0709 13:17:33.081488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.082010 (+   522us) service_pool.cc:224] Handling call
0709 13:17:33.085014 (+  3004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.304073 (+219059us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b48001d2458. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:17:33.440867 (+136794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.440903 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.453677 (+ 12774us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.003095 (+549418us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:34.474251 (+471156us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180032dd60. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb603522 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:17:34.529125 (+ 54874us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.582073 (+1052948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.582161 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.582207 (+    46us) raft_consensus.cc:1685] finished
0709 13:17:35.582218 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.582351 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127650,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":233808,"raft.run_cpu_time_us":3395,"raft.run_wall_time_us":226810,"spinlock_wait_cycles":28949504,"thread_start_us":2408652,"threads_started":4,"wal-append.queue_time_us":690654}
I20260709 13:17:35.139844 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:35.578019 15597 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:34.959669 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:35.109578 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:35.587993 15750 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:35.585736 15677 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
W20260709 13:17:35.381460 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 362987us
I20260709 13:17:35.177177 17368 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:35.593142 17368 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:35.595892 17368 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:35.141253 17328 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.135617 17304 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.102247 17314 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:34.845973 17370 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.898450 17239 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.167795 16265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.000s	sys 0.010s
I20260709 13:17:34.895368 17180 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.871495 17339 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:34.822614 17282 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:35.615664 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.938949 17313 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:34.938176 17269 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:35.676472 17187 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:35.186641 17311 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.596561 17368 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.678577 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 718937us
I20260709 13:17:36.139596 17368 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:35.846356 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 83116.4us
I20260709 13:17:36.141036 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:17:36.141245 15565 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.056s (SENT) [suppressed 16 similar messages]
I20260709 13:17:36.141713 16299 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:36.141827 17368 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:35.676964 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:35.620918 17257 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.144069 15747 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:35.679950 16265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.133s	user 0.000s	sys 0.016s
I20260709 13:17:35.675405 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:35.906944 15671 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:36.013386 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1501) took 1972 ms. Trace:
W20260709 13:17:34.980258 17272 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:17:35.626315 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:34.975082 17302 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:36.158921 15716 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.060s	sys 0.108s
I20260709 13:17:35.627684 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 236) took 2310 ms. Trace:
W20260709 13:17:36.165723 15716 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.060s	sys 0.112s
I20260709 13:17:35.622133 15673 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:35.597922 17328 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:34.985659 17371 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 13:17:36.167706 15675 rpcz_store.cc:276] 0709 13:17:33.260503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.339785 (+ 79282us) service_pool.cc:224] Handling call
0709 13:17:33.340099 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.001464 (+661365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.570318 (+1568854us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b5400083ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:35.570529 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403551488}
I20260709 13:17:36.169032 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:35.105406 17281 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:35.170076 17286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.005s	sys 0.005s
I20260709 13:17:36.171005 15670 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:36.132014 17309 consensus_meta.cc:287] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 1.569s	user 0.009s	sys 0.003s
I20260709 13:17:36.153332 15599 rpcz_store.cc:276] 0709 13:17:34.040879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.138443 (+ 97564us) service_pool.cc:224] Handling call
0709 13:17:34.146538 (+  8095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.146959 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.146994 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.162305 (+ 15311us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.650277 (+487972us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:34.650339 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.650436 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.013055 (+1362619us) raft_consensus.cc:1685] finished
0709 13:17:36.013087 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.013297 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":147,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":27725,"thread_start_us":190650,"threads_started":1,"wal-append.queue_time_us":580848}
I20260709 13:17:34.975014 16305 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:36.182372 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:36.183386 15675 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 2: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:36.184012 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:35.110112 17196 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:35.019249 17259 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:36.190667 15674 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:35.601112 17273 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:35.371956 17220 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:36.163848 17339 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:35.599763 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:35.929883 17190 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:36.198617 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:36.222956 17190 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.191634 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:36.224591 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:36.225018 17190 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.225961 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1719) took 2336 ms. Trace:
I20260709 13:17:36.226336 15746 rpcz_store.cc:276] 0709 13:17:33.889310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.070148 (+180838us) service_pool.cc:224] Handling call
0709 13:17:34.070551 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.134613 (+ 64062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.134643 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:34.134682 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:34.134710 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.225729 (+2091019us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b5400216954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:36.225775 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.225886 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146875648}
I20260709 13:17:36.227505 16299 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:35.916393 17377 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:36.034417 17267 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:35.907270 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:36.159206 17183 raft_consensus.cc:3055] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:17:36.206353 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.012s	sys 0.060s
W20260709 13:17:36.246789 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.012s	sys 0.060s
I20260709 13:17:36.246592 17186 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:36.246896 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1507) took 1255 ms. Trace:
I20260709 13:17:36.247257 17186 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:36.248006 17328 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:36.246649 17183 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:36.249213 17334 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.249594 17257 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:35.994531 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1531) took 1112 ms. Trace:
I20260709 13:17:36.249853 17183 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:35.677675 17318 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:36.181917 17286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.596s	user 0.009s	sys 0.013s
W20260709 13:17:36.253422 15641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.006s	sys 0.035s
W20260709 13:17:36.253742 15641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.006s	sys 0.035s
I20260709 13:17:35.993104 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1238) took 1130 ms. Trace:
I20260709 13:17:35.601920 17314 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:36.254248 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.192778 17291 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.948485 17344 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:36.323132 16309 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:36.168707 17381 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:36.174202 17223 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.177469 17274 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.247429 15594 rpcz_store.cc:276] 0709 13:17:34.991728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.991866 (+   138us) service_pool.cc:224] Handling call
0709 13:17:36.246808 (+1254942us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:36.216506 17139 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:35.888520 17239 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.217952 17313 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.218328 17269 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:35.847479 17370 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.219086 17360 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:36.219411 17332 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:36.219506 17273 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.106839 17239 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.107100 17370 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.107198 17273 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:36.169955 17282 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.109239 17282 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:36.221028 17339 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.221566 16305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 527) took 1744 ms. Trace:
I20260709 13:17:38.109851 16305 rpcz_store.cc:276] 0709 13:17:34.476842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.479798 (+  2956us) service_pool.cc:224] Handling call
0709 13:17:34.519054 (+ 39256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.182286 (+1663232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.221234 (+ 38948us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b5400702bd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:36.221474 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001184128}
I20260709 13:17:38.111167 17339 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.111459 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.112171 16305 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:34.975340 17189 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:38.112722 16305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 445) took 1488 ms (client timeout 1648 ms). Trace:
I20260709 13:17:38.113122 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 288) took 6616 ms. Trace:
W20260709 13:17:38.113116 16305 rpcz_store.cc:269] 0709 13:17:36.624662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.111144 (+1486482us) service_pool.cc:224] Handling call
0709 13:17:38.112660 (+  1516us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:36.222370 15743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1236) took 1424 ms (client timeout 1528 ms). Trace:
I20260709 13:17:38.114553 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:38.114985 15743 rpcz_store.cc:269] 0709 13:17:34.798513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.802273 (+  3760us) service_pool.cc:224] Handling call
0709 13:17:35.599544 (+797271us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:36.222304 (+622760us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122056960}
I20260709 13:17:38.115422 16305 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:35.599937 17304 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:38.115940 16305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 444) took 1491 ms (client timeout 1782 ms). Trace:
W20260709 13:17:38.116407 16305 rpcz_store.cc:269] 0709 13:17:36.624264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.114276 (+1490012us) service_pool.cc:224] Handling call
0709 13:17:38.115885 (+  1609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.117609 17304 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.238072 17202 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.250540 17283 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.155721 17187 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:36.252269 15717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.022s	sys 0.020s
I20260709 13:17:35.608510 17256 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.255820 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:38.118759 15717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.529s	user 0.022s	sys 0.020s
W20260709 13:17:38.119222 16310 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 526) took 3653 ms (client timeout 1528 ms). Trace:
I20260709 13:17:38.118970 17256 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:38.119578 16310 rpcz_store.cc:269] 0709 13:17:34.465436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.465573 (+   137us) service_pool.cc:224] Handling call
0709 13:17:36.255672 (+1790099us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:38.119129 (+1863457us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4157184}
I20260709 13:17:38.120641 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.121029 17187 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:38.121176 17256 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:34.944105 17366 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.205860 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.121551 17187 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:38.122246 16295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 477) took 1956 ms (client timeout 1518 ms). Trace:
W20260709 13:17:38.122661 16295 rpcz_store.cc:269] 0709 13:17:36.165929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.169335 (+  3406us) service_pool.cc:224] Handling call
0709 13:17:38.122171 (+1952836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.123347 17366 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.123654 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:36.139622 17311 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.298810 17334 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:38.124493 17334 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.125736 17311 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:36.321147 17391 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.126266 17139 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.126435 17391 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.127036 17334 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.126793 17139 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:38.128414 17391 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.321651 17183 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:36.228987 17284 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.016s	sys 0.061s
I20260709 13:17:36.230463 17196 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:38.129179 17196 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.129292 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 208) took 6357 ms. Trace:
I20260709 13:17:38.129591 17196 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:36.175585 17272 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.129678 15500 rpcz_store.cc:276] 0709 13:17:31.772205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.777815 (+  5610us) service_pool.cc:224] Handling call
0709 13:17:32.044269 (+266454us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe65a090 00007faefe6f8f3a 00007faf044af1cc 00007faf045ad37e 00007faf02a6e2a4 00007faf02a6e232 00007faf02a6e161 00007faf02a6e0dc 00007faf02a6d392 00007faefca2b48c 00007faefca2a8c6
0709 13:17:38.129226 (+6084957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:32.381509 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:32.382228 (+   719us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:32.382252 (+    24us) write_op.cc:435] Acquired schema lock
0709 13:17:32.382267 (+    15us) tablet.cc:662] Decoding operations
0709 13:17:32.382642 (+   375us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:32.382721 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:32.382776 (+    55us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:32.383011 (+   235us) tablet.cc:701] Row locks acquired
0709 13:17:32.383037 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:17:32.383216 (+   179us) write_op.cc:270] Start()
0709 13:17:32.383381 (+   165us) write_op.cc:276] Timestamp: P: 1783603052383162 usec, L: 0
0709 13:17:32.383425 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:17:32.906190 (+522765us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b54003e5420. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf033d65c4 00007faefe6675ab 00007faefe6672fa 00007faefe6eb965 00007faefe6ebe09 00007faf02126581 00007faf02125d58 00007faf0212a9f1 00007faf0212a9a9 00007faf0212a939 00007faf0212a901
0709 13:17:32.909067 (+  2877us) log.cc:844] Serialized 533 byte log entry
0709 13:17:33.431038 (+521971us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ebe28 00007faf02126581 00007faf02125d58 00007faf0212a9f1 00007faf0212a9a9 00007faf0212a939 00007faf0212a901 00007faf02129b2d 000000000038f354 000000000038f199
0709 13:17:35.140394 (+1709356us) op_driver.cc:464] REPLICATION: finished
0709 13:17:36.396452 (+1256058us) write_op.cc:301] APPLY: starting
0709 13:17:36.397767 (+  1315us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:36.406317 (+  8550us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:36.406357 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:36.406798 (+   441us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:36.407022 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:36.407092 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:36.407363 (+   271us) log.cc:844] Serialized 23 byte log entry
0709 13:17:36.430501 (+ 23138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:36.430588 (+    87us) write_op.cc:454] Released schema lock
0709 13:17:36.430637 (+    49us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":517477120,"child_traces":[["op",{"apply.queue_time_us":1233269,"apply.run_cpu_time_us":7251,"apply.run_wall_time_us":37729,"num_ops":1,"prepare.queue_time_us":142,"prepare.run_cpu_time_us":29371,"prepare.run_wall_time_us":1049719,"replication_time_us":2756805,"spinlock_wait_cycles":62112384,"thread_start_us":22664,"threads_started":2,"wal-append.queue_time_us":27556,"wal-append.run_cpu_time_us":1380,"wal-append.run_wall_time_us":1002864}]]}
I20260709 13:17:38.113796 15497 rpcz_store.cc:276] 0709 13:17:31.497107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.497258 (+   151us) service_pool.cc:224] Handling call
0709 13:17:38.113032 (+6615774us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:31.733023 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:31.753387 (+ 20364us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:31.753440 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:17:31.753476 (+    36us) tablet.cc:662] Decoding operations
0709 13:17:31.753898 (+   422us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:31.754000 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:31.754032 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:31.754384 (+   352us) tablet.cc:701] Row locks acquired
0709 13:17:31.754433 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:17:31.754592 (+   159us) write_op.cc:270] Start()
0709 13:17:31.754756 (+   164us) write_op.cc:276] Timestamp: P: 1783603051754525 usec, L: 0
0709 13:17:31.754799 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:17:31.755624 (+   825us) log.cc:844] Serialized 595 byte log entry
0709 13:17:32.376103 (+620479us) op_driver.cc:464] REPLICATION: finished
0709 13:17:32.924504 (+548401us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18001b6400. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:17:32.950084 (+ 25580us) write_op.cc:301] APPLY: starting
0709 13:17:32.959342 (+  9258us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:32.979635 (+ 20293us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:33.024152 (+ 44517us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:33.044505 (+ 20353us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:33.044781 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:33.044851 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:33.045148 (+   297us) log.cc:844] Serialized 23 byte log entry
0709 13:17:33.045320 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.045390 (+    70us) write_op.cc:454] Released schema lock
0709 13:17:33.045450 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:33.045874 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.045931 (+    57us) write_op.cc:454] Released schema lock
0709 13:17:33.586736 (+540805us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:33.586777 (+    41us) write_op.cc:454] Released schema lock
0709 13:17:35.139901 (+1553124us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ed32a 00007faefe672f14 00007faefe672ec3 00007faefe672e38 00007faefe672df3 00007faefe6720dc 00007faefe69be16 00007faefe683cbb 00007faefe66e39d 00007faefe671d75
Metrics: {"mutex_wait_us":945333,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":32331,"apply.run_cpu_time_us":2353,"apply.run_wall_time_us":102294,"num_ops":1,"prepare.queue_time_us":119468,"prepare.run_cpu_time_us":118128,"prepare.run_wall_time_us":277167,"raft.queue_time_us":2400993,"raft.run_cpu_time_us":64267,"raft.run_wall_time_us":2766534,"replication_time_us":618266,"spinlock_wait_cycles":1150335488,"thread_start_us":467550,"threads_started":4,"wal-append.queue_time_us":340670,"wal-append.run_cpu_time_us":26306,"wal-append.run_wall_time_us":2030711}]]}
I20260709 13:17:36.321400 15496 catalog_manager.cc:5697] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:34.958513 17181 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.137066 17181 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:36.231175 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:36.231911 17377 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:38.137765 17377 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.138321 17181 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:38.138469 17410 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.138923 17181 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.139068 17410 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.140904 16308 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:38.141113 17181 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.141392 17410 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.123687 17187 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.142596 16308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 480) took 1975 ms. Trace:
I20260709 13:17:38.142982 16308 rpcz_store.cc:276] 0709 13:17:36.167287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.167426 (+   139us) service_pool.cc:224] Handling call
0709 13:17:38.142377 (+1974951us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54004376d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.142530 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4498270592}
I20260709 13:17:38.144191 16308 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:36.322319 17333 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.516s	user 0.011s	sys 0.004s
I20260709 13:17:36.215894 17259 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.144901 17333 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.146387 17259 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:36.256961 17257 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:36.229955 17220 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.147042 17333 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.147146 17257 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.352057 17392 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:36.352802 17186 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.148869 17392 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.149560 17257 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.150146 16304 raft_consensus.cc:1813] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Handling vote request from an unknown peer 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:38.150828 16304 raft_consensus.cc:2410] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:17:38.151060 17392 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:36.339257 17383 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:38.151814 17383 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.258239 15749 rpcz_store.cc:276] 0709 13:17:34.799264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.802323 (+  3059us) service_pool.cc:224] Handling call
0709 13:17:35.930032 (+1127709us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458048}
W20260709 13:17:38.152428 16304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 478) took 1986 ms (client timeout 2056 ms). Trace:
I20260709 13:17:36.344260 17388 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:38.152976 16304 rpcz_store.cc:269] 0709 13:17:36.166420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.169277 (+  2857us) service_pool.cc:224] Handling call
0709 13:17:38.152194 (+1982917us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400740254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.152357 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28428544}
I20260709 13:17:38.153203 17388 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.155875 17388 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:36.369035 15745 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.006s	sys 0.016s
W20260709 13:17:38.156633 15745 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.951s	user 0.007s	sys 0.016s
I20260709 13:17:38.159600 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1728) took 4261 ms. Trace:
I20260709 13:17:36.341884 17223 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.161206 17139 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.162670 17223 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:36.341706 17274 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.164587 17196 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:36.320027 17318 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:36.417737 15751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.001s	sys 0.009s
W20260709 13:17:38.174085 15751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.554s	user 0.002s	sys 0.009s
I20260709 13:17:38.174963 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 282) took 4502 ms. Trace:
I20260709 13:17:36.398813 17394 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:38.175787 17318 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.176090 17394 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.175336 15751 rpcz_store.cc:276] 0709 13:17:33.672105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.672668 (+   563us) service_pool.cc:224] Handling call
0709 13:17:33.673161 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.673433 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:33.699407 (+ 25974us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.619485 (+1920078us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b18000bac40. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe29023a 00007faefe6faa2a
0709 13:17:38.174560 (+2555075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.174619 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:38.174669 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.174749 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.174877 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25227,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3454,"spinlock_wait_cycles":2942720,"thread_start_us":2554708,"threads_started":1,"wal-append.queue_time_us":2734102,"wal-append.run_cpu_time_us":1125,"wal-append.run_wall_time_us":1001155}
I20260709 13:17:38.178640 17394 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.179250 17180 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.179853 17180 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:36.323770 15640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.027s	sys 0.049s
W20260709 13:17:38.250649 15640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.682s	user 0.030s	sys 0.049s
W20260709 13:17:36.429086 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 196767us
I20260709 13:17:38.254920 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:17:38.258432 15640 connection.cc:256] RPC call timeout handler was delayed by -2.6564518969998971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 13:17:38.259335 15640 connection.cc:256] RPC call timeout handler was delayed by -2.6348518969998622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
W20260709 13:17:38.259925 15640 connection.cc:256] RPC call timeout handler was delayed by -2.6114518969998244s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:17:36.428643 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.261063 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.265184 17223 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:36.409745 17286 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.433064 17399 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.267189 17286 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.267433 17399 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:36.433542 17314 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.434113 17401 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.269640 17286 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:36.434742 17344 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:36.435917 17396 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.270452 17396 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.271275 17399 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.272873 17396 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:36.238590 15670 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:36.250706 15669 rpcz_store.cc:276] 0709 13:17:34.871725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.871863 (+   138us) service_pool.cc:224] Handling call
0709 13:17:35.984393 (+1112530us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:38.283053 15672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1538) took 2660 ms (client timeout 1990 ms). Trace:
W20260709 13:17:38.283506 15672 rpcz_store.cc:269] 0709 13:17:35.623409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.282838 (+2659429us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:38.282962 (+   124us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:36.230013 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1537) took 1064 ms. Trace:
I20260709 13:17:36.917254 17406 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:38.286927 15598 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:38.288586 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 227) took 3484 ms (client timeout 2222 ms). Trace:
W20260709 13:17:38.288995 15598 rpcz_store.cc:269] 0709 13:17:34.804752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.804889 (+   137us) service_pool.cc:224] Handling call
0709 13:17:38.288314 (+3483425us) spinlock_profiling.cc:243] Waited 3.48 s on lock 0x7b54001ca2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.288476 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8000078720}
I20260709 13:17:37.266695 17302 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:37.273483 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 524) took 3005 ms. Trace:
I20260709 13:17:37.309994 17271 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:37.334511 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1727) took 3441 ms. Trace:
I20260709 13:17:38.290426 16309 rpcz_store.cc:276] 0709 13:17:34.267787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.268614 (+   827us) service_pool.cc:224] Handling call
0709 13:17:34.488255 (+219641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.323661 (+1835406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.273067 (+949406us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b5400483354. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:37.273363 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4219286144}
W20260709 13:17:37.305655 15716 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.005s	sys 0.041s
W20260709 13:17:38.292013 15716 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.653s	user 0.006s	sys 0.041s
I20260709 13:17:38.290743 15748 rpcz_store.cc:276] 0709 13:17:33.893529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.144917 (+251388us) service_pool.cc:224] Handling call
0709 13:17:34.197923 (+ 53006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.228024 (+ 30101us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:34.489926 (+261902us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.718284 (+228358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:34.718362 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:34.718428 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.334279 (+2615851us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5400276ad4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:37.334319 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:37.334455 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":338672,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":124,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":68327168,"thread_start_us":430747,"threads_started":2,"wal-append.queue_time_us":320617,"wal-append.run_cpu_time_us":1415,"wal-append.run_wall_time_us":1035825}
W20260709 13:17:38.078583 15567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.904s	user 0.007s	sys 0.058s
W20260709 13:17:38.293165 15567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.119s	user 0.008s	sys 0.058s
W20260709 13:17:38.293486 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 2.12437e+06us
I20260709 13:17:38.286085 15673 rpcz_store.cc:276] 0709 13:17:35.242546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.621570 (+379024us) service_pool.cc:224] Handling call
0709 13:17:35.621973 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.229693 (+607720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.229721 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.229763 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:36.229796 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.229864 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.229962 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17822,"raft.queue_time_us":16385,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":22098}
I20260709 13:17:38.295073 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.295665 15673 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.086386 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.117797 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.114674 17189 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:38.280311 15669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1640) took 2046 ms (client timeout 1723 ms). Trace:
I20260709 13:17:38.134099 17272 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:38.297895 16305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 446) took 1672 ms (client timeout 2080 ms). Trace:
I20260709 13:17:38.297958 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.298768 16307 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
W20260709 13:17:38.299250 16307 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 523) took 4031 ms (client timeout 1569 ms). Trace:
W20260709 13:17:38.299546 16307 rpcz_store.cc:269] 0709 13:17:34.267436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.288089 (+ 20653us) service_pool.cc:224] Handling call
0709 13:17:38.297814 (+4009725us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:38.299192 (+  1378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592000}
W20260709 13:17:38.298488 16305 rpcz_store.cc:269] 0709 13:17:36.624996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.117512 (+1492516us) service_pool.cc:224] Handling call
0709 13:17:38.297831 (+180319us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:38.129184 17284 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 2.989s	user 0.016s	sys 0.061s
W20260709 13:17:36.370306 15715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.196s	user 0.003s	sys 0.020s
W20260709 13:17:38.302675 15715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.129s	user 0.003s	sys 0.020s
I20260709 13:17:36.340209 17381 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.305912 17381 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.306528 17314 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.307152 17314 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.309506 17314 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.310024 17314 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:38.310127 17180 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.310738 17180 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.310535 17314 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.311255 17180 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.170464 17383 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.171628 16308 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:38.172009 17274 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.172755 17220 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.313103 16308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 483) took 2136 ms. Trace:
I20260709 13:17:38.313484 16308 rpcz_store.cc:276] 0709 13:17:36.176878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.143799 (+1966921us) service_pool.cc:224] Handling call
0709 13:17:38.144098 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.312802 (+168704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.313042 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.172583 17377 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.160023 15745 rpcz_store.cc:276] 0709 13:17:33.898127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.176524 (+278397us) service_pool.cc:224] Handling call
0709 13:17:34.213019 (+ 36495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.837163 (+624144us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:34.869630 (+ 32467us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.157008 (+3287378us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.157074 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:38.157127 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.159278 (+  2151us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400259ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:38.159344 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.159518 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32229,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":1049641,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":32680,"spinlock_wait_cycles":1434851584,"thread_start_us":3286875,"threads_started":2,"wal-append.queue_time_us":1289557,"wal-append.run_cpu_time_us":1191,"wal-append.run_wall_time_us":1064607}
I20260709 13:17:38.183053 15668 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.203312 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1634) took 2579 ms. Trace:
I20260709 13:17:38.635303 15677 rpcz_store.cc:276] 0709 13:17:35.624643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.202321 (+2577678us) service_pool.cc:224] Handling call
0709 13:17:38.202745 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.202941 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.202968 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.203011 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:38.203042 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.203110 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.203249 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.636863 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.637596 15677 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.638708 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:38.208029 15674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1535) took 3248 ms (client timeout 1533 ms). Trace:
W20260709 13:17:38.640549 15674 rpcz_store.cc:269] 0709 13:17:34.959567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.960155 (+   588us) service_pool.cc:224] Handling call
0709 13:17:38.207755 (+3247600us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54000825d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.207913 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403712384}
I20260709 13:17:38.641855 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.642637 15674 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.643636 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:38.218098 15600 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:17:38.647620 15600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 226) took 4335 ms (client timeout 1635 ms). Trace:
I20260709 13:17:38.228914 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1498) took 4194 ms. Trace:
I20260709 13:17:38.648579 15593 rpcz_store.cc:276] 0709 13:17:34.034501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.135993 (+101492us) service_pool.cc:224] Handling call
0709 13:17:34.136298 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.485319 (+349021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.228512 (+3743193us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b540012c854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:38.228813 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6561664}
I20260709 13:17:38.650542 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.651381 15593 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
W20260709 13:17:38.243263 15484 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:38.652878 15484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 409852us
W20260709 13:17:38.236347 15671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1527) took 3399 ms (client timeout 1532 ms). Trace:
W20260709 13:17:38.653759 15671 rpcz_store.cc:269] 0709 13:17:34.836472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.836623 (+   151us) service_pool.cc:224] Handling call
0709 13:17:38.236120 (+3399497us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400002dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.236262 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224654592}
I20260709 13:17:38.655020 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.655885 15671 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 2: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:17:36.258702 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.269237 17401 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.661578 17401 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.286365 17406 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.663973 17406 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.295586 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:38.664884 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 369341us
I20260709 13:17:38.296689 16299 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:38.668649 16299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 482) took 2492 ms (client timeout 1723 ms). Trace:
W20260709 13:17:38.669114 16299 rpcz_store.cc:269] 0709 13:17:36.176586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.228305 (+ 51719us) service_pool.cc:224] Handling call
0709 13:17:38.086187 (+1857882us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:38.668546 (+582359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6749440}
I20260709 13:17:38.670300 17271 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.670800 17271 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.671216 17271 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:37.338186 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.675860 16302 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:38.676532 16302 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 487) took 2497 ms (client timeout 2043 ms). Trace:
W20260709 13:17:38.676997 16302 rpcz_store.cc:269] 0709 13:17:36.179069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.337867 (+1158798us) service_pool.cc:224] Handling call
0709 13:17:38.676447 (+1338580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.209674 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.678793 16306 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:38.679471 16306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 486) took 2500 ms (client timeout 1664 ms). Trace:
W20260709 13:17:38.679888 16306 rpcz_store.cc:269] 0709 13:17:36.178810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.223471 (+ 44661us) service_pool.cc:224] Handling call
0709 13:17:38.209467 (+1985996us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:38.679381 (+469914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17540352}
W20260709 13:17:38.292337 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 1.65389e+06us
I20260709 13:17:38.121215 16310 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:38.701627 16310 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 485) took 2523 ms (client timeout 2550 ms). Trace:
W20260709 13:17:38.702095 16310 rpcz_store.cc:269] 0709 13:17:36.178506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.120399 (+1941893us) service_pool.cc:224] Handling call
0709 13:17:38.701548 (+581149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.187409 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 484) took 2010 ms. Trace:
W20260709 13:17:38.297179 15669 rpcz_store.cc:269] 0709 13:17:36.233461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.280085 (+2046624us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:38.280225 (+   140us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:38.705803 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.706676 15669 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:38.707743 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.709082 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:38.276324 15670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1635) took 2651 ms (client timeout 1672 ms). Trace:
W20260709 13:17:38.709868 15670 rpcz_store.cc:269] 0709 13:17:35.625693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.625936 (+   243us) service_pool.cc:224] Handling call
0709 13:17:38.276244 (+2650308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.710678 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.710875 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.711434 16310 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:38.711560 15670 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:38.712568 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.713331 15670 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.705147 16304 rpcz_store.cc:276] 0709 13:17:36.177134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.154177 (+1977043us) service_pool.cc:224] Handling call
0709 13:17:38.154571 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.154952 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.154984 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.155909 (+   925us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.182780 (+ 26871us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:38.186218 (+  3438us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.187048 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.187154 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.187198 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:38.187211 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.187348 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3343,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":8540,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":197,"thread_start_us":29302,"threads_started":2,"wal-append.queue_time_us":27234}
I20260709 13:17:38.714270 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.714944 15670 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.715852 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.284545 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.338550 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.716868 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:38.717175 15673 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:38.718128 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.718258 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.718943 15671 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.719354 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.719802 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:38.340780 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 80318.3us
I20260709 13:17:38.490772 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.716920 15672 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.720929 15598 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:38.721408 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.721956 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.722627 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.723206 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.723781 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.181581 17196 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.220635 17318 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:38.733507 17318 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.735796 17318 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:36.248579 17328 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.739687 17328 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.339937 15642 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:38.221249 17333 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:38.328325 17314 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:36.434520 17324 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:38.744493 17309 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:38.097189 17359 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.186s	user 0.049s	sys 0.034s
I20260709 13:17:38.747129 17328 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:38.747684 17359 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.858s	user 0.051s	sys 0.036s
I20260709 13:17:38.316325 17377 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.248306 17384 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.750113 17384 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.752490 17384 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.252775 17369 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.753858 17369 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.754465 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:36.433188 17397 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:38.757536 17397 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:38.759630 17397 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.497779 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.760381 15594 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.761485 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.762723 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.644258 15674 raft_consensus.cc:2376] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4. Re-sending same reply.
I20260709 13:17:38.763339 15594 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:38.763798 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.499122 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.764639 15674 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.764930 15601 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:38.765587 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.765854 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.767099 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.768179 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.500511 15596 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:38.769532 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.770797 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.771905 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.505697 15599 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:38.506742 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.798067 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.798518 15602 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.799431 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.799539 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.800225 15602 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:38.507889 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.801143 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.801697 15597 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 5 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:17:38.801838 16307 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.517299 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 240) took 3497 ms. Trace:
I20260709 13:17:38.801144 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.802693 15676 rpcz_store.cc:276] 0709 13:17:35.019904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.300838 (+3280934us) service_pool.cc:224] Handling call
0709 13:17:38.301212 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.301574 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.301607 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.302085 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:17:38.501059 (+198974us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:38.501106 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.501169 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.517056 (+ 15887us) raft_consensus.cc:1685] finished
0709 13:17:38.517077 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.517231 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":446,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":198584,"threads_started":1,"wal-append.queue_time_us":198926}
I20260709 13:17:38.803871 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:38.518968 15643 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48144 dropped due to backpressure: service queue is full with 50 items
I20260709 13:17:38.804543 15602 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.805459 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:38.806197 15602 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:38.804806 15643 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:48144 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 246)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1657)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1648)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1653)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 249)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1646)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 253)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1652)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1665)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1642)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1655)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1656)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1658)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 243)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 248)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 250)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 251)
I20260709 13:17:38.329298 17180 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.557524 16295 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:38.809777 16295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 481) took 2642 ms (client timeout 2953 ms). Trace:
W20260709 13:17:38.810199 16295 rpcz_store.cc:269] 0709 13:17:36.167754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.123370 (+1955616us) service_pool.cc:224] Handling call
0709 13:17:38.809577 (+686207us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54004a60d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.809714 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996389632}
I20260709 13:17:38.570235 15565 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:38.811404 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 241285us
W20260709 13:17:38.601562 16263 connection.cc:256] RPC call timeout handler was delayed by -2.4760080399998969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:17:38.602732 15714 connection.cc:256] RPC call timeout handler was delayed by -2.5876572920001308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:17:38.812781 16263 connection.cc:256] RPC call timeout handler was delayed by -2.2312080399999559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1907s for a response
W20260709 13:17:38.812835 15714 connection.cc:256] RPC call timeout handler was delayed by -2.5876572920001308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:17:38.813226 16263 connection.cc:256] RPC call timeout handler was delayed by -2.2006080399999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260709 13:17:38.813254 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:38.813581 16263 connection.cc:256] RPC call timeout handler was delayed by -2.2006080399999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:17:38.813959 16263 connection.cc:256] RPC call timeout handler was delayed by -2.1799080400001003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 13:17:38.813992 15602 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
W20260709 13:17:38.814428 16263 connection.cc:256] RPC call timeout handler was delayed by -2.1799080400001003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:17:38.814826 16263 connection.cc:256] RPC call timeout handler was delayed by -1.9477080399999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 13:17:38.814865 17180 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.814988 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:37.340374 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1240) took 2540 ms. Trace:
W20260709 13:17:38.813521 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3041572920001272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
W20260709 13:17:38.816567 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3041572920001272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 13:17:38.802532 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.816431 15747 rpcz_store.cc:276] 0709 13:17:34.799965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.807677 (+  7712us) service_pool.cc:224] Handling call
0709 13:17:34.910855 (+103178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.144517 (+1233662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.340143 (+1195626us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002cf6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:37.340319 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2835029248}
I20260709 13:17:38.817214 17397 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.683225 17344 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.818043 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.817960 17344 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.818626 15597 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
I20260709 13:17:38.819404 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.820008 17344 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:38.685189 15668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1530) took 3814 ms (client timeout 1829 ms). Trace:
W20260709 13:17:38.820643 15668 rpcz_store.cc:269] 0709 13:17:34.870914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.871040 (+   126us) service_pool.cc:224] Handling call
0709 13:17:38.684909 (+3813869us) spinlock_profiling.cc:243] Waited 3.23 s on lock 0x7b54001a6654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.685081 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7423095552}
I20260709 13:17:38.821861 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.823002 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.824155 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.687582 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1639) took 2457 ms. Trace:
I20260709 13:17:38.720021 15673 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
W20260709 13:17:38.817040 15714 connection.cc:256] RPC call timeout handler was delayed by -2.2992675360001158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:17:38.824898 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.825151 17397 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.825713 15676 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.826571 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.827270 17397 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.827584 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.492440 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:38.824756 15675 rpcz_store.cc:276] 0709 13:17:36.233064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.254790 (+ 21726us) service_pool.cc:224] Handling call
0709 13:17:38.685686 (+2430896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.685906 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.685939 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.685990 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:38.686029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.686097 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.687342 (+  1245us) spinlock_profiling.cc:243] Waited 2.43 s on lock 0x7b54001a6650. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.687512 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5589589888}
I20260709 13:17:38.828390 15595 raft_consensus.cc:2368] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:38.828819 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.829276 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.829681 16295 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.829877 15595 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
W20260709 13:17:38.729925 15640 connection.cc:256] RPC call timeout handler was delayed by -2.4557518969998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
W20260709 13:17:38.830494 15640 connection.cc:256] RPC call timeout handler was delayed by -1.7590869650000514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:17:38.743664 17333 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.830834 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.831446 15595 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:38.716414 15670 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:38.832515 17333 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.832590 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.833247 17333 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.833299 15670 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:38.833761 17333 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:38.834188 17333 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.834234 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.744966 17309 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:38.835161 17309 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.835347 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.836014 15670 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:38.320941 17311 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:38.744977 17324 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.841658 17324 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:38.830859 15640 connection.cc:256] RPC call timeout handler was delayed by -1.6807629469999483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 13:17:38.745179 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:38.743119 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 403259us
I20260709 13:17:38.845988 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.846648 15673 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.847537 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.848114 15673 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:38.692296 15496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 320) took 4773 ms. Trace:
I20260709 13:17:38.639953 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.723861 15598 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:38.854184 15677 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:38.854806 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1642) took 2620 ms. Trace:
I20260709 13:17:38.855118 15677 rpcz_store.cc:276] 0709 13:17:36.234011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.853377 (+2619366us) service_pool.cc:224] Handling call
0709 13:17:38.853694 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.854554 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.854755 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.772660 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.793007 17314 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.857102 17314 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:38.859573 17314 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.861230 15599 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:38.756296 17369 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.772456 15596 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
W20260709 13:17:38.753398 15600 rpcz_store.cc:269] 0709 13:17:34.312218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.771799 (+459581us) service_pool.cc:224] Handling call
0709 13:17:38.647310 (+3875511us) spinlock_profiling.cc:243] Waited 3.25 s on lock 0x7b5400248954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:38.647528 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7486310656}
I20260709 13:17:38.763032 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.786070 15669 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.779891 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.848992 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.869787 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.870594 15670 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
I20260709 13:17:38.870745 17309 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.844496 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:38.872794 15668 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.873647 15640 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:38.789377 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.785532 15601 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.795774 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.875694 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:38.876086 17423 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:38.808287 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:38.815201 16263 connection.cc:256] RPC call timeout handler was delayed by -1.9477080399999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 13:17:38.764326 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:38.815485 17180 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.878422 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:38.879129 17180 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.879292 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:38.879823 15594 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.628880 17339 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:38.725422 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.880990 15672 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.880880 17339 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.882951 17339 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.883234 15672 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:38.828882 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:38.825026 15714 connection.cc:256] RPC call timeout handler was delayed by -2.274955127000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
I20260709 13:17:38.851323 15496 rpcz_store.cc:276] 0709 13:17:33.919057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.919278 (+   221us) service_pool.cc:224] Handling call
0709 13:17:38.692213 (+4772935us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:38.142010 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:38.142653 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:38.142705 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:17:38.142725 (+    20us) tablet.cc:662] Decoding operations
0709 13:17:38.143076 (+   351us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:38.143150 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:38.143176 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:17:38.143354 (+   178us) tablet.cc:701] Row locks acquired
0709 13:17:38.143375 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:38.143511 (+   136us) write_op.cc:270] Start()
0709 13:17:38.143614 (+   103us) write_op.cc:276] Timestamp: P: 1783603058143466 usec, L: 0
0709 13:17:38.143634 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:17:38.326887 (+183253us) log.cc:844] Serialized 538 byte log entry
0709 13:17:38.608397 (+281510us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ebe28 00007faf02126581 00007faf02125d58 00007faf0212a9f1 00007faf0212a9a9 00007faf0212a939 00007faf0212a901 00007faf02129b2d 000000000038f354 000000000038f199
0709 13:17:38.614077 (+  5680us) op_driver.cc:464] REPLICATION: finished
0709 13:17:38.616402 (+  2325us) write_op.cc:301] APPLY: starting
0709 13:17:38.616505 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:38.616667 (+   162us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:38.616694 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:38.617122 (+   428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:38.617317 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:17:38.617372 (+    55us) write_op.cc:312] APPLY: finished
0709 13:17:38.617645 (+   273us) log.cc:844] Serialized 23 byte log entry
0709 13:17:38.617820 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:38.617911 (+    91us) write_op.cc:454] Released schema lock
0709 13:17:38.617952 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:38.618350 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:38.618381 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":443415,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1467,"apply.run_cpu_time_us":1783,"apply.run_wall_time_us":1926,"num_ops":1,"prepare.queue_time_us":4516,"prepare.run_cpu_time_us":20799,"prepare.run_wall_time_us":466584,"raft.queue_time_us":97093,"raft.run_cpu_time_us":1486,"raft.run_wall_time_us":1487,"replication_time_us":470286,"spinlock_wait_cycles":419109120,"thread_start_us":213682,"threads_started":3,"wal-append.queue_time_us":187765}]]}
I20260709 13:17:38.852324 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1641) took 2618 ms. Trace:
I20260709 13:17:38.796964 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:38.794207 15716 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:38.880452 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:38.884657 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1643) took 2622 ms. Trace:
I20260709 13:17:38.884904 17406 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.894766 17423 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:38.884475 15672 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:38.895588 15677 rpcz_store.cc:276] 0709 13:17:36.234271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.855846 (+2621575us) service_pool.cc:224] Handling call
0709 13:17:38.856130 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.856296 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.856323 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.856365 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:38.856399 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.856453 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.856552 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.895877 17423 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.887360 17339 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.899451 17339 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.790467 16302 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:38.899936 17339 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.900236 17311 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:38.877107 17369 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:17:38.888082 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:38.903843 17311 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.904275 17311 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.887885 17328 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:38.904624 17311 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.909343 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:38.910218 17377 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:38.910607 17377 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.910954 17377 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.911689 17328 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:38.911759 15594 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:38.913025 17271 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.891738 15676 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:38.820369 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:38.937114 15597 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:38.938865 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.894850 17406 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.939574 17406 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.940793 17271 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.920186 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.942730 15677 raft_consensus.cc:2393] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 2: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:17:38.884837 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1202050690001215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
W20260709 13:17:38.943624 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1089822700000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:17:38.944083 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1089822700000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 13:17:38.885886 15673 rpcz_store.cc:276] 0709 13:17:36.233767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.851551 (+2617784us) service_pool.cc:224] Handling call
0709 13:17:38.851846 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.852014 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.852043 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.852085 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:38.852117 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.852172 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.852270 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:38.943601 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.945261 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:38.915508 17339 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.946040 15673 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:38.947301 17339 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:38.908401 17333 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:38.891079 17344 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:38.948069 17344 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.948462 17344 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:38.950909 15676 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:38.922163 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:38.887446 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 93317.9us
I20260709 13:17:38.952373 17406 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:38.958412 17333 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.958709 17406 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:38.960117 15669 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:38.961791 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:38.963178 17180 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.963558 17180 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.963923 17180 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.968212 15496 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:38.970357 15496 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:38.980195 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 155621us
I20260709 13:17:38.875752 15671 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:38.929198 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 262819us
I20260709 13:17:38.981582 15565 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:38.983116 17333 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:38.983510 17333 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.983836 17333 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.934719 17311 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:38.939073 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 65495.9us
W20260709 13:17:38.944387 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7787246560001222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:17:38.984951 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7517246560000785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:17:38.985307 15714 connection.cc:256] RPC call timeout handler was delayed by -1.5645246560002306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 13:17:38.985603 15714 connection.cc:256] RPC call timeout handler was delayed by -1.5645246560002306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 13:17:38.987422 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.987963 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:38.989854 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:38.990491 15745 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.991531 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:38.992142 15746 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:38.993273 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:38.993938 15748 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
W20260709 13:17:38.994074 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 118455us
I20260709 13:17:38.995311 15642 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:38.995931 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:38.996110 17424 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:38.996622 15749 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:38.997253 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:38.997632 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:38.998277 15743 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.997453 17421 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:38.945367 15677 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:38.914522 17309 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:38.856508 15598 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:38.926229 17377 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.000037 17309 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.001011 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.001362 17377 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:39.001631 15745 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.894279 17425 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:39.003620 17424 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:39.006273 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 44540.7us
I20260709 13:17:39.006978 15716 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:38.972011 17180 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.010488 17314 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.010958 17314 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.011330 17314 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.011739 17180 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.012446 17180 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.012871 17180 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.013480 17180 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.015939 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:39.016851 17401 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.017269 17401 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.017488 17311 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:39.017620 17401 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.019588 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.020370 16302 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:38.983722 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:39.021992 17271 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:39.023387 15565 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.024190 17271 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.024546 17271 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.024899 17271 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:38.978786 17344 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.030046 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.031764 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.032403 15743 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:39.032109 17271 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.034124 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.034759 15745 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:39.034827 17271 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.035820 17344 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.035756 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.036948 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.037289 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.038712 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:39.039325 15749 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:39.039815 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:39.038429 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.040441 15745 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.041003 15743 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:39.041522 17333 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.039326 15751 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:39.042351 17271 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.050357 17421 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48120 (request call id 80) took 7817 ms. Trace:
I20260709 13:17:39.050763 17271 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.051258 17271 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.050948 17421 rpcz_store.cc:276] 0709 13:17:31.232670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.236304 (+  3634us) service_pool.cc:224] Handling call
0709 13:17:31.326956 (+ 90652us) log.cc:844] Serialized 494 byte log entry
0709 13:17:31.595041 (+268085us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b2c00010828. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefcfe9a11 00007faefcff8a0a 00007faefcff8693 00007faefcff8631 00007faefe72cb52 00007faefe72ccf5 00007faefe669691 00007faefe649eaa 00007faefe650d53 00007faefe650cd9 00007faefe650c69
0709 13:17:31.599509 (+  4468us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b1800103680. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe72cd01 00007faefe669691 00007faefe649eaa 00007faefe650d53 00007faefe650cd9 00007faefe650c69 00007faefe650c31 00007faefe64fdfd 000000000038f354 000000000038f199
0709 13:17:39.050248 (+7450739us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18172,"raft.run_cpu_time_us":5282,"raft.run_wall_time_us":83757,"spinlock_wait_cycles":175177856,"thread_start_us":113433,"threads_started":1,"wal-append.queue_time_us":185142,"wal-append.run_cpu_time_us":2429,"wal-append.run_wall_time_us":1040797}
I20260709 13:17:39.053156 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.053911 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea2d5bac8fb54783a1f420061d08067f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:39.038389 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:39.040768 17344 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:39.055651 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.043586 17333 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.053879 16302 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:39.055830 17344 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.046742 17433 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:39.056979 17423 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.058872 17423 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.058784 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.059366 17423 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:39.060737 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 44876us
I20260709 13:17:39.062469 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:39.064435 17324 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.064872 17324 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.065219 17324 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.069057 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:39.069882 17397 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.070276 17397 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.070621 17397 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.074249 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:39.043769 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.075440 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:38.766213 15674 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:39.076200 15565 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:39.078727 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.084715 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.086738 15751 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:39.088778 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.088063 15496 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.090065 15496 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:39.091641 17433 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.091286 15496 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.093091 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.093492 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.094172 16308 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:39.095067 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.095345 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.096158 15746 raft_consensus.cc:2410] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:39.086481 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.096849 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.252173 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.271219 16306 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:39.271349 16302 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:39.272955 15565 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.274609 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.275691 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.098424 15742 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:17:39.185962 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:39.279784 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 204388us
I20260709 13:17:39.155594 15745 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:39.281836 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:39.282913 15745 raft_consensus.cc:2368] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3.
I20260709 13:17:39.279258 15744 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
W20260709 13:17:39.284353 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 197957us
I20260709 13:17:39.285352 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.097193 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.099946 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.110817 15496 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 2 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.289808 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:39.290787 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:39.289196 15565 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.303519 15745 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:39.092130 17433 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:39.306921 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.088652 17396 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:39.088867 17333 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.138535 17334 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:39.249790 17311 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.317263 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.096982 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.183775 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.105067 17274 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.323768 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:39.360400 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.322431 17309 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.135152 17419 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.092438 17339 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.228s
I20260709 13:17:39.339489 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:39.347904 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:39.338634 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.306090 17318 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.335666 17311 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.337505 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.336813 17440 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:39.309857 17420 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.305492 17344 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.339092 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:39.373548 16307 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.089671 17421 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.345963 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.328928 17425 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:39.316843 17433 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.353801 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.316373 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.318641 17396 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:39.281656 17196 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.322647 17333 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:39.396730 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.370857 17440 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.405892 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:39.347512 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:39.424824 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:39.425527 16309 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.360154 17384 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.362569 17309 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.329264 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.365214 17314 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.370996 16295 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:17:39.393072 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 103351us
I20260709 13:17:39.363627 16304 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:39.366616 17419 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.364450 16308 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:39.397661 15742 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:39.364858 17423 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.373775 17274 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.365765 17359 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:39.425182 17440 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:39.433239 17309 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:39.450562 15567 connection.cc:256] RPC call timeout handler was delayed by -4.0974770630002695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
I20260709 13:17:39.442353 17334 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:39.452129 17334 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.455372 17397 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:39.451126 15567 connection.cc:256] RPC call timeout handler was delayed by -3.9588770630002728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
W20260709 13:17:39.464069 15567 connection.cc:256] RPC call timeout handler was delayed by -3.9366282770001817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:17:39.464473 15567 connection.cc:256] RPC call timeout handler was delayed by -3.7862485940001989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260709 13:17:39.464915 15567 connection.cc:256] RPC call timeout handler was delayed by -3.6132770630001687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 13:17:39.465214 15567 connection.cc:256] RPC call timeout handler was delayed by -3.344563958000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:17:39.465674 15567 connection.cc:256] RPC call timeout handler was delayed by -3.0465282770001068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2635s for a response
W20260709 13:17:39.466061 15567 connection.cc:256] RPC call timeout handler was delayed by -3.0034639580001112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:17:39.466423 15567 connection.cc:256] RPC call timeout handler was delayed by -2.788960649000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.255s for a response
W20260709 13:17:39.466773 15567 connection.cc:256] RPC call timeout handler was delayed by -2.7603282770000988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2953s for a response
I20260709 13:17:39.470774 16307 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:39.440124 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:39.425527 16306 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.365926 17318 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.432874 16310 raft_consensus.cc:2368] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4.
I20260709 13:17:39.402051 17396 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:39.403918 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 50217.3us
I20260709 13:17:39.438254 16309 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:39.403496 17333 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.373090 17401 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.403151 17196 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:39.518177 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 229045us
I20260709 13:17:39.445070 17274 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.474934 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.446879 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.545414 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.577219 16307 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:39.577343 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.555447 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:39.551578 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:39.579311 15674 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:39.558151 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:39.557533 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:39.580478 15676 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 1.
W20260709 13:17:39.582705 15748 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.002s
W20260709 13:17:39.583096 15748 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.009s	sys 0.002s
I20260709 13:17:39.555028 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:39.560289 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:39.556218 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:39.570195 16309 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:39.475277 17189 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.593348 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:39.593834 15670 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:39.578014 16310 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:39.537036 17422 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.556748 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:39.557869 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:39.647740 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.567793 17274 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:39.663887 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 226029us
I20260709 13:17:39.686465 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.573371 17271 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.566291 17401 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:39.684927 16310 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:39.565071 17196 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.698969 16310 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:17:39.573088 15698 debug-util.cc:398] Leaking SignalData structure 0x7b08001321e0 after lost signal to thread 14504
I20260709 13:17:39.642254 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.536720 17444 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:39.704977 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 338794us
I20260709 13:17:39.536836 17318 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.652413 17422 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.569362 17333 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.719475 17422 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:39.722102 15698 debug-util.cc:398] Leaking SignalData structure 0x7b080015d040 after lost signal to thread 15534
I20260709 13:17:39.721962 17377 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:39.722934 16265 leader_election.cc:400] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3.
I20260709 13:17:39.741441 16265 leader_election.cc:403] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:39.651901 17448 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.744560 16306 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:39.748383 16265 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:39.651173 17189 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.713442 17444 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:39.739266 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 264404us
I20260709 13:17:39.723711 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.536868 17441 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.340s
I20260709 13:17:39.755255 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.739634 17419 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:39.777551 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 91115.8us
I20260709 13:17:39.743371 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.747905 17447 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:39.786712 17401 consensus_queue.cc:1059] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:39.787405 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:39.788506 17453 raft_consensus.cc:3055] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:39.788640 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:39.788935 17453 raft_consensus.cc:740] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:39.789134 17324 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.000s
I20260709 13:17:39.789539 17324 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.790037 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:39.789989 17453 consensus_queue.cc:260] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.791924 17453 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.782548 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:39.748540 17314 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:39.761152 17189 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:39.793052 17314 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.786614 17397 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.786285 15675 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:39.793751 17314 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.794142 17454 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.793785 17433 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.794309 17314 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.794577 17454 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:39.795135 17454 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.795297 17397 consensus_queue.cc:1059] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:39.796178 17433 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:39.786320 17446 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:17:39.796432 17397 raft_consensus.cc:3055] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:39.793092 17339 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:39.796916 17397 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:39.797084 17339 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:39.797572 17339 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.798180 17397 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.799486 17397 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:39.792152 17318 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.802235 17314 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:39.803194 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 236334us
I20260709 13:17:39.804256 15565 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:39.756554 17180 consensus_meta.cc:287] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.743s	user 0.006s	sys 0.004s
I20260709 13:17:39.808547 17311 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:39.810132 17324 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:39.810963 17449 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:39.811822 17189 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.812263 17189 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.751519 17448 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.812676 17189 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.815191 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:39.765902 17460 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.820938 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.812274 15565 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.754716 17444 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.777299 17334 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:39.835279 17318 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.777926 17423 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.757028 17456 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3.
I20260709 13:17:39.857067 17318 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:39.857998 17318 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:39.858765 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.859130 17318 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.860498 16309 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:17:39.862413 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:39.827840 15698 debug-util.cc:398] Leaking SignalData structure 0x7b0800365300 after lost signal to thread 15626
I20260709 13:17:39.836791 17419 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.879858 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:39.880847 16308 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:39.837634 17447 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:39.883911 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:39.885784 16307 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:39.855652 15675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:39.886950 15675 raft_consensus.cc:606] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:39.887393 15675 raft_consensus.cc:614] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:39.836957 17460 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:39.892534 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 71672.4us
I20260709 13:17:39.828521 17180 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:39.894444 17333 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:39.900313 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 108313us
I20260709 13:17:39.884814 17419 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.895809 15642 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.875901 17423 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.875618 17344 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:39.885293 17447 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:39.897584 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 350775us
W20260709 13:17:39.898414 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 60294.8us
I20260709 13:17:39.909466 15565 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:39.897419 17460 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.901882 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:39.894235 17448 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.900728 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:39.894883 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 144306us
I20260709 13:17:39.885174 17424 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:39.906548 17419 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.996492 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:39.889637 17420 consensus_queue.cc:1059] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:17:39.915911 15750 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:39.915560 17196 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.916877 17180 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.915163 17396 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:39.910135 17447 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:39.903251 17462 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:39.911350 15640 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.890087 17271 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:39.910058 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.911406 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:40.020006 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 108649us
I20260709 13:17:40.021034 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:40.014887 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:39.991806 15484 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:39.993023 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.028012 15675 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:39.993438 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:40.029300 15671 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:39.997649 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:39.997911 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.030632 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:40.031139 15597 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:39.998315 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:40.032223 15673 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:40.000445 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.000578 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:40.033824 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.001609 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:39.998340 16307 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:39.999104 15598 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:40.035369 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:40.035704 15565 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:39.904991 17423 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.945914 17333 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.006860 17450 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.007421 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.007598 17420 raft_consensus.cc:3055] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:17:39.908053 15698 debug-util.cc:398] Leaking SignalData structure 0x7b08002897a0 after lost signal to thread 15701
I20260709 13:17:39.904747 17421 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.007994 15748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:39254
I20260709 13:17:40.006938 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.008265 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.008049 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.010751 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:39.988327 17461 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:17:40.021947 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:40.020006 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 110010us
I20260709 13:17:40.054105 15748 raft_consensus.cc:606] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:40.037575 17359 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:40.022812 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 111531us
I20260709 13:17:40.038228 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.015172 17443 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:40.040788 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:40.042946 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.040966 17333 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:40.045279 15674 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:40.049584 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.044454 17450 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.047864 17420 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:39.971617 17440 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.022734 17462 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:39.950476 17444 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.037966 17334 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.061237 15602 raft_consensus.cc:2368] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:40.061508 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:40.096187 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 74308.3us
I20260709 13:17:40.096853 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:40.040992 17441 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.064841 15597 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:40.043483 17423 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.072192 15716 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:40.080354 15598 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:40.039808 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:40.053802 17421 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.063001 17359 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.093338 15596 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:40.054158 16304 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:39.988384 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 86567.1us
I20260709 13:17:40.102425 15675 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:40.103279 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:40.058736 17344 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:40.108275 17467 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.063572 15669 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.063784 17271 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:40.109316 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.079833 17333 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.109627 17377 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:40.109766 17420 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.169101 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:40.105078 17441 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.155035 17359 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.029115 17274 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:40.122052 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 49990us
W20260709 13:17:40.177261 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72441.1us
I20260709 13:17:40.181308 15745 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.181522 15746 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:17:40.054663 17476 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.042615 17189 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.080755 17443 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:40.155128 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.157318 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:40.166816 17271 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.193691 15714 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:40.158735 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:40.158871 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:40.089687 17396 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:40.126047 17421 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.095741 17440 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.091144 17462 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.081303 17475 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:40.156776 15698 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8460 after lost signal to thread 15775
I20260709 13:17:40.171136 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.174806 17441 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.115439 17450 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:40.160159 17309 consensus_meta.cc:287] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.685s	user 0.005s	sys 0.005s
I20260709 13:17:40.120075 17448 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:40.173542 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 109679us
I20260709 13:17:40.122514 17314 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.185417 15716 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:40.165190 17467 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.205754 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.126883 15594 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:40.189639 17476 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:40.190152 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:40.158008 15668 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:40.195283 15595 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:40.166445 17344 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:40.225199 17344 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.201414 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:40.096166 17334 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.165315 17469 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:40.199534 16263 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:40.206519 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:40.205542 17475 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.208178 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.191188 17339 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.106063 17454 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:40.205608 15698 debug-util.cc:398] Leaking SignalData structure 0x7b080012e4a0 after lost signal to thread 15776
I20260709 13:17:40.217479 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:40.202433 17420 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.217448 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.198793 17271 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:40.189742 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:40.218861 15640 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:40.199355 17443 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:40.300403 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 82998.8us
I20260709 13:17:40.192297 17456 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:17:40.202765 17180 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:17:40.308723 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 89914.5us
I20260709 13:17:40.231319 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:40.213414 17384 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:40.208756 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.215794 17457 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.219194 17448 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.269992 17314 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.222666 17453 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.310690 15744 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:40.220475 15596 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:17:40.314079 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 82835us
W20260709 13:17:40.315312 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 115827us
I20260709 13:17:40.220696 17467 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.202962 17477 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:17:40.443782 16263 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:40.261179 15673 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:40.229739 17476 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.216501 17309 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.433892 15567 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:40.301082 17401 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:40.269671 17475 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.319993 15716 leader_election.cc:400] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4.
I20260709 13:17:40.371608 16305 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.301291 15593 raft_consensus.cc:2368] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:40.361639 17448 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.248883 17334 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.479030 15716 leader_election.cc:403] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:40.445763 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:40.454663 15596 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.316803 17425 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.361999 17397 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.316475 17384 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:40.404933 15743 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:40.301832 17274 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:40.431741 15698 debug-util.cc:398] Leaking SignalData structure 0x7b080037d320 after lost signal to thread 16334
W20260709 13:17:40.480170 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 46364.3us
W20260709 13:17:40.487282 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 43627.7us
I20260709 13:17:40.446702 17314 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:40.493356 17422 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.003s
I20260709 13:17:40.447775 17453 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:40.490739 15672 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:17:40.486025 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.429642 17444 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.494521 17488 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:40.511780 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.514612 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:40.514911 17462 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.515460 17489 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:40.515848 17489 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:40.516191 17489 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.376974 17359 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.487767 17425 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:40.497248 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 51550.9us
W20260709 13:17:40.486267 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 176281us
I20260709 13:17:40.361811 17457 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:40.496868 17469 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.359172 17424 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260709 13:17:40.501353 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.501550 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.502108 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.528065 15674 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.528124 15675 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.503065 17189 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:40.317507 17180 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:40.486140 17401 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:40.487694 17474 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.490316 17396 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4.
I20260709 13:17:40.509186 15565 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:40.491433 17397 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:40.538146 17189 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:40.538702 17189 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:40.538898 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:40.539737 15747 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:40.539573 17189 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.517369 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:40.491677 17328 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.518332 15601 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:40.520316 16263 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:40.486025 17447 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.527099 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.526394 15716 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:40.506196 17314 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.527029 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:40.527438 17457 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.532896 15673 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:40.536502 15675 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:40.510236 17453 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.543244 15565 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:40.527284 17469 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:40.529012 17425 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.554867 17423 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.555953 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.553855 17420 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:40.510033 17422 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.581056 16310 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:40.558782 17333 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.560781 17441 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.561122 15674 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:40.568444 16308 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:17:40.569727 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52400.7us
W20260709 13:17:40.571053 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50839.1us
I20260709 13:17:40.572806 17339 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:40.400131 17419 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.576020 15600 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:17:40.536113 17180 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.537159 17474 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.547276 17397 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.552345 15669 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:40.610910 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:40.562575 17328 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:40.552497 16305 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:40.528476 17480 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:17:40.614365 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.574069 17482 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:40.618628 15670 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:17:40.615130 16310 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:40.615341 15677 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:40.581261 17469 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.583472 17396 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:40.617924 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 262) took 1060 ms. Trace:
I20260709 13:17:40.579898 17440 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.620051 15597 raft_consensus.cc:2368] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3.
I20260709 13:17:40.610601 16263 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:40.621301 15602 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:40.621575 15672 rpcz_store.cc:276] 0709 13:17:39.557137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.557279 (+   142us) service_pool.cc:224] Handling call
0709 13:17:40.617740 (+1060461us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54003007d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:40.617870 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091052416}
I20260709 13:17:40.622946 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:40.628822 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:40.607335 17271 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.609241 17474 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.607547 17454 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:40.610958 17463 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.607898 17420 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.657938 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.658663 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:40.643314 15673 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:40.616295 17328 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.662957 16310 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:17:40.665050 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 87032.4us
I20260709 13:17:40.632681 17440 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:40.632458 17196 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:40.634379 17456 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.657761 17470 raft_consensus.cc:2764] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:40.646309 17476 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:40.684979 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 158007us
I20260709 13:17:40.652765 17463 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:40.632761 17424 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:40.612722 17489 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.691830 17440 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.705598 17463 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.697214 17456 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:40.614147 17401 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.701714 17271 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:40.701685 17419 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.702543 17441 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.660912 17462 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.684762 17454 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.683698 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.684655 17309 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.701617 17420 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:40.705827 17490 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:17:40.696513 17447 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.717975 17456 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.719782 17359 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:40.699824 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:40.723320 17454 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.710143 17424 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:40.755518 17467 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.757458 17467 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:40.743350 17444 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:40.760000 17444 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.744180 17454 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.748235 17423 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.769531 16304 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:40.770045 17422 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:40.750058 17333 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:40.760509 17444 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.768509 17443 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:40.786432 17492 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:40.792061 17489 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:40.784972 17476 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:40.791842 17475 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:40.797577 17475 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:40.705451 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 76501.7us
W20260709 13:17:40.828281 15640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.010s
W20260709 13:17:40.829214 15640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.000s	sys 0.011s
W20260709 13:17:40.829732 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 502814us
I20260709 13:17:40.830277 15567 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:40.836120 15640 leader_election.cc:400] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:40.836576 15640 leader_election.cc:403] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:40.850087 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.857496 15714 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:40.857846 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:40.850046 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.861291 17339 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.863059 17423 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.851426 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.865948 17396 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:40.847996 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:40.852056 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:40.854064 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 186256us
I20260709 13:17:40.869417 17339 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:40.850812 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:40.879076 15675 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:40.879194 17502 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:40.878813 17333 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:40.875983 17339 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:40.882799 17396 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.887662 15673 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:40.898123 15750 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:40.919767 17484 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:40.924134 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:40.915099 15669 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:40.938211 17328 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.941098 17189 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:40.949079 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 113290us
I20260709 13:17:40.914585 17423 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.957739 17328 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:40.960688 17443 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:40.964747 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:40.965134 17314 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:40.966571 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 48915.5us
W20260709 13:17:40.970238 17460 consensus_meta.cc:287] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.958s	user 0.013s	sys 0.003s
I20260709 13:17:40.970080 15673 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:17:40.974618 17453 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:40.967324 17189 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:40.976852 17460 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.003304 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1270) took 1006 ms. Trace:
I20260709 13:17:41.019023 15594 rpcz_store.cc:276] 0709 13:17:39.996986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.999354 (+  2368us) service_pool.cc:224] Handling call
0709 13:17:41.002823 (+1003469us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b540012c354. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.003052 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164486528}
I20260709 13:17:41.020033 17460 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.005584 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 242) took 1002 ms. Trace:
I20260709 13:17:41.020730 15597 rpcz_store.cc:276] 0709 13:17:40.002789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.164612 (+161823us) service_pool.cc:224] Handling call
0709 13:17:41.005058 (+840446us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540020ba54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.005359 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030886656}
W20260709 13:17:41.005594 17421 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.797s	user 0.004s	sys 0.012s
I20260709 13:17:41.022202 17421 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:41.005718 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 319560us
I20260709 13:17:41.025185 16306 raft_consensus.cc:1240] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.026036 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.027132 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 541) took 1168 ms. Trace:
I20260709 13:17:41.028630 17311 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.027205 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.030778 17510 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.027668 16306 rpcz_store.cc:276] 0709 13:17:39.858913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.861094 (+  2181us) service_pool.cc:224] Handling call
0709 13:17:39.861337 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:41.025797 (+1164460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.026686 (+   889us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400740254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:41.027011 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675598592}
I20260709 13:17:41.002724 17469 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.033371 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.034345 16295 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.034701 17469 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.006711 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 247) took 1001 ms. Trace:
I20260709 13:17:41.000507 17425 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.031018 15671 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:41.006122 17483 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:40.978467 17443 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.018411 17453 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.037070 15602 rpcz_store.cc:276] 0709 13:17:40.005017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.189916 (+184899us) service_pool.cc:224] Handling call
0709 13:17:41.006297 (+816381us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54001473d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.006519 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917166976}
I20260709 13:17:40.979677 17189 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.032310 17384 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.027318 16302 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.006124 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:41.024251 17397 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.011977 17314 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:41.058176 17424 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.058826 17421 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.060408 17384 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:41.083870 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.065863 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1277) took 1064 ms. Trace:
I20260709 13:17:41.064215 17454 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:41.068073 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:41.070142 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 64232.9us
I20260709 13:17:41.070433 17423 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.070856 17510 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.085018 15600 rpcz_store.cc:276] 0709 13:17:40.000977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.001234 (+   257us) service_pool.cc:224] Handling call
0709 13:17:40.007183 (+  5949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:40.608964 (+601781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.065272 (+456308us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54002d78d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:41.065655 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301974912}
W20260709 13:17:41.077718 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 96527.2us
I20260709 13:17:41.076357 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.071946 17453 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:41.090307 17453 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:41.090801 17453 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.089599 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.093557 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1276) took 1092 ms. Trace:
I20260709 13:17:41.094064 15593 rpcz_store.cc:276] 0709 13:17:40.000688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.003778 (+  3090us) service_pool.cc:224] Handling call
0709 13:17:41.093077 (+1089299us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540012b454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.093349 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388877056}
I20260709 13:17:41.095427 17484 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:41.096006 17484 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.095628 17481 consensus_queue.cc:1059] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:41.096977 17481 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.097373 17481 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:17:41.097601 15677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 259) took 1542 ms (client timeout 1919 ms). Trace:
W20260709 13:17:41.098031 15677 rpcz_store.cc:269] 0709 13:17:39.554986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.555133 (+   147us) service_pool.cc:224] Handling call
0709 13:17:41.097219 (+1542086us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001a6b54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.097417 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383313664}
I20260709 13:17:41.098409 17481 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.100046 17481 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.102516 15496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 209) took 2181 ms. Trace:
I20260709 13:17:41.102777 16309 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:41.105212 17425 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.105954 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.076052 17483 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.106997 16309 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:41.109064 17483 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:41.109333 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 62372.9us
I20260709 13:17:41.109597 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.110294 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.110502 17333 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.105041 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:17:41.111322 17457 consensus_meta.cc:287] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.002s
I20260709 13:17:41.111855 16299 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.111174 17344 raft_consensus.cc:3055] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.111650 17510 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.119227 17510 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:41.117252 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:41.117972 17339 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:41.118557 17334 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.010s
I20260709 13:17:41.111954 17457 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.111394 15565 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:41.137158 17425 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:41.139144 17425 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:41.141889 17448 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.003s
I20260709 13:17:41.142547 17448 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.143296 15567 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.143690 15743 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.144973 17440 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.145360 17510 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.146513 15747 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.146806 17510 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.120044 17344 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:17:41.149809 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 99711.3us
I20260709 13:17:41.151459 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.151291 17474 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.158957 15598 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.136276 17460 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.100243 17444 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:17:41.162712 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 82216.8us
I20260709 13:17:41.147346 17440 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.168159 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.164731 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:41.171415 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 61274.8us
I20260709 13:17:41.104421 17180 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.168821 17333 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.170854 17421 consensus_queue.cc:1059] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:41.179046 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.194007 15668 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:41.180163 17397 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:41.181516 15642 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.564s (SENT) [suppressed 19 similar messages]
I20260709 13:17:41.194818 15497 catalog_manager.cc:5697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.196382 16302 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:41.196920 15497 catalog_manager.cc:5697] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.198819 15497 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 3, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:17:41.199895 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 240) took 1197 ms. Trace:
I20260709 13:17:41.200416 15598 rpcz_store.cc:276] 0709 13:17:40.002312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.154859 (+152547us) service_pool.cc:224] Handling call
0709 13:17:41.199613 (+1044754us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54001009d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.199826 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196820736}
I20260709 13:17:41.137367 17334 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.202713 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1682) took 1203 ms. Trace:
I20260709 13:17:41.203199 15671 rpcz_store.cc:276] 0709 13:17:39.999644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.030292 (+ 30648us) service_pool.cc:224] Handling call
0709 13:17:40.049431 (+ 19139us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:41.202444 (+1153013us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400364f54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.202643 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212230656}
I20260709 13:17:41.181468 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.204643 17196 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.204718 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 61545.4us
I20260709 13:17:41.102932 15496 rpcz_store.cc:276] 0709 13:17:38.920819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.920971 (+   152us) service_pool.cc:224] Handling call
0709 13:17:41.102189 (+2181218us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:39.475030 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:39.748806 (+273776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:39.750142 (+  1336us) write_op.cc:435] Acquired schema lock
0709 13:17:39.752079 (+  1937us) tablet.cc:662] Decoding operations
0709 13:17:39.764355 (+ 12276us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:39.764458 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:39.764499 (+    41us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:17:39.765207 (+   708us) tablet.cc:701] Row locks acquired
0709 13:17:39.765234 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:17:39.765434 (+   200us) write_op.cc:270] Start()
0709 13:17:39.765576 (+   142us) write_op.cc:276] Timestamp: P: 1783603059765368 usec, L: 0
0709 13:17:39.765617 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:17:39.790358 (+ 24741us) log.cc:844] Serialized 2434 byte log entry
0709 13:17:40.528577 (+738219us) op_driver.cc:464] REPLICATION: finished
0709 13:17:40.717256 (+188679us) write_op.cc:301] APPLY: starting
0709 13:17:40.719477 (+  2221us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:40.724458 (+  4981us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:40.739039 (+ 14581us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:40.788403 (+ 49364us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:40.788954 (+   551us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:17:40.789011 (+    57us) write_op.cc:312] APPLY: finished
0709 13:17:40.789233 (+   222us) log.cc:844] Serialized 53 byte log entry
0709 13:17:40.789434 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:40.789536 (+   102us) write_op.cc:454] Released schema lock
0709 13:17:40.789585 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:40.789888 (+   303us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:40.789917 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":162344,"apply.run_cpu_time_us":3852,"apply.run_wall_time_us":74853,"num_ops":6,"prepare.queue_time_us":130345,"prepare.run_cpu_time_us":26055,"prepare.run_wall_time_us":451053,"raft.queue_time_us":528280,"raft.run_cpu_time_us":18025,"raft.run_wall_time_us":135974,"replication_time_us":742797,"thread_start_us":687849,"threads_started":4,"wal-append.queue_time_us":115009}]]}
I20260709 13:17:41.205250 17334 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:41.206046 15601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 241) took 1203 ms (client timeout 1564 ms). Trace:
I20260709 13:17:41.187803 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1760) took 1086 ms. Trace:
W20260709 13:17:41.206529 15601 rpcz_store.cc:269] 0709 13:17:40.002545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.033513 (+ 30968us) service_pool.cc:224] Handling call
0709 13:17:41.205565 (+1172052us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54002d73d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.205809 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109224832}
I20260709 13:17:41.207278 15750 rpcz_store.cc:276] 0709 13:17:40.101344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.118785 (+ 17441us) service_pool.cc:224] Handling call
0709 13:17:40.119172 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.899091 (+779919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.187316 (+288225us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b5400276ad4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:41.187685 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762571008}
I20260709 13:17:41.188802 15748 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.208578 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1685) took 1201 ms. Trace:
I20260709 13:17:41.208745 17463 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.211014 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51462 (request call id 81) took 1107 ms. Trace:
I20260709 13:17:41.211714 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:41.212046 17463 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.209447 17425 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.213193 15599 raft_consensus.cc:2368] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:41.205292 17196 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.215319 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1272) took 1217 ms. Trace:
I20260709 13:17:41.215711 15599 rpcz_store.cc:276] 0709 13:17:39.997584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.997693 (+   109us) service_pool.cc:224] Handling call
0709 13:17:41.215100 (+1217407us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001ca2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:41.215263 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2718090112}
I20260709 13:17:41.217917 17456 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.222178 17444 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:41.189356 17499 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:41.189222 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.167307 17474 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.159554 17423 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:17:41.193078 17421 raft_consensus.cc:3055] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.209141 15670 rpcz_store.cc:276] 0709 13:17:40.006542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.057487 (+ 50945us) service_pool.cc:224] Handling call
0709 13:17:40.077623 (+ 20136us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:40.619036 (+541413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.207982 (+588946us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54001ce3d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:41.208378 (+   396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1236514560}
I20260709 13:17:41.211516 15596 rpcz_store.cc:276] 0709 13:17:40.103744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.486837 (+383093us) service_pool.cc:224] Handling call
0709 13:17:41.210504 (+723667us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54001ca2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f6735 00007faefe6ee9fa 00007faf036b64c9 00007faefcc32c54 00007faefcc32be2 00007faefcc32b11 00007faefcc32a8c 00007faefcc31d42 00007faefca2b48c 00007faefca2a8c6
0709 13:17:41.210794 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656546048}
I20260709 13:17:41.226227 15497 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 3, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.231119 15565 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:41.230785 17421 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:17:41.240062 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.215329 17196 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.244643 16263 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:41.225164 16295 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:41.246472 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.249167 17470 consensus_queue.cc:1059] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.249883 17339 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.250128 17359 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.250402 17460 consensus_queue.cc:1059] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.239408 17421 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.251677 17180 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.252319 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.251732 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.253676 16310 raft_consensus.cc:1240] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.254096 15669 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:41.256031 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.257165 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.257999 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.180004 17344 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.265518 15748 raft_consensus.cc:2393] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.206748 17334 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:17:41.265076 17311 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.233836 17453 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.261348 17456 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.277647 16306 raft_consensus.cc:2393] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:41.276475 15497 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 3 to 4, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:41.312522 15750 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.277415 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 543) took 1281 ms. Trace:
I20260709 13:17:41.303953 17457 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:41.323741 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 88411.2us
W20260709 13:17:41.326011 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 154580us
I20260709 13:17:41.317086 17328 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.316803 17454 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:41.351442 17518 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:17:41.320770 17448 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.314325 17499 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.330035 15497 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 2, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.358187 15565 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:41.361145 15745 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:41.362831 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:41.366987 17514 log.cc:927] Time spent T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:17:41.367558 17377 raft_consensus.cc:3055] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.367962 17377 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:41.368140 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.368913 17377 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.369627 15744 raft_consensus.cc:2393] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.370215 17377 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:41.370697 15640 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.838s (SENT)
I20260709 13:17:41.371227 15640 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:41.372871 15497 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 3, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:41.377414 17196 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.380671 17424 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:41.312479 15675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
new_leader_uuid: "558532223b984cf796cb6b98ddd6c9f2"
 from {username='slave'} at 127.0.0.1:58156
I20260709 13:17:41.383255 17196 raft_consensus.cc:697] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.386130 17447 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.386826 17447 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.387225 17196 consensus_queue.cc:237] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.389070 15675 raft_consensus.cc:606] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Received request to transfer leadership to TS 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:41.391456 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:41.329149 17488 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:17:41.317433 16295 rpcz_store.cc:276] 0709 13:17:39.989230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.999876 (+ 10646us) service_pool.cc:224] Handling call
0709 13:17:40.213031 (+213155us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:41.033097 (+820066us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbf8c 00007faefb5cbef6 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:41.270669 (+237572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6553216}
W20260709 13:17:41.400662 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 44217.2us
I20260709 13:17:41.401242 15565 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:41.402555 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.403744 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:41.417878 17440 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.418428 17440 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.419487 17440 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.418340 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.422771 16263 leader_election.cc:400] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 2 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3.
I20260709 13:17:41.422860 17470 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.414191 17457 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.423378 17470 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:41.423719 17457 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.423908 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.426038 17457 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:41.426055 17328 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.388085 17447 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.424862 17440 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.434767 17499 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.437966 17453 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:41.441814 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.436883 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.460448 15744 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:41.460863 17525 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:17:41.432821 17334 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:41.424401 17470 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.465762 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.469305 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.470285 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.473345 15748 raft_consensus.cc:2393] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.477253 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.477952 15565 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:41.461422 17456 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.488858 17456 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:41.460454 17484 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.489787 17456 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.491442 17456 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.491530 17484 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.493635 17421 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.498386 17454 consensus_queue.cc:1059] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.499563 17454 raft_consensus.cc:3055] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.499914 17454 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:41.479339 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.479691 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.501523 15750 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.480736 15744 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.482393 15745 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.506826 17454 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.508301 17454 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:41.511391 17521 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:17:41.484079 17470 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.516146 17333 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:41.484803 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.467367 17334 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.486085 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:41.467367 16299 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:41.525190 15742 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.532562 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.558588 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:41.530645 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.535549 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.525596 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:41.562470 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 87821.1us
W20260709 13:17:41.566232 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 80234.5us
W20260709 13:17:41.527417 17519 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.211s	user 0.000s	sys 0.004s
I20260709 13:17:41.524359 15743 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.570655 15744 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:41.522528 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.562188 17453 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.569386 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:41.565680 15714 connection.cc:256] RPC call timeout handler was delayed by -1.3099630839999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:17:41.577951 16304 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.577898 17488 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:17:41.577790 15714 connection.cc:256] RPC call timeout handler was delayed by -1.2019630839999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260709 13:17:41.579190 15672 raft_consensus.cc:2410] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:41.581331 15671 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:41.583478 15676 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:41.584457 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.584318 17453 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.586422 17453 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:41.571632 17484 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:41.586910 17339 consensus_queue.cc:1059] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:41.588058 17339 raft_consensus.cc:3055] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.588455 17339 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:41.589505 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:41.591611 17448 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.592170 17448 raft_consensus.cc:697] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.593195 17448 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.593701 17484 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.594724 17484 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:41.600831 15484 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:41.602924 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.602756 17384 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:41.603418 17488 raft_consensus.cc:697] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:41.604342 17384 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:41.604946 17384 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:41.604650 17488 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.606033 17384 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.607509 15743 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.609615 17510 consensus_queue.cc:1059] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.610644 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.610922 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.607535 17384 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:41.611210 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.589502 17339 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.612962 17339 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.614732 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.615367 15742 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:41.602452 17344 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.625087 15748 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:41.628082 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.629879 15744 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:41.646891 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 57469.2us
I20260709 13:17:41.649811 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.610982 17510 raft_consensus.cc:3055] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.657256 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.662025 15671 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.662047 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.662307 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.666136 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.666976 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.667713 15744 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:41.669855 15670 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:41.665930 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.674966 15596 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.676187 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.664289 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.679227 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.679311 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.657042 17510 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:41.683553 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.681784 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:41.682371 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.682448 17424 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:41.683636 15674 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:41.704306 15672 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:17:41.686704 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.702322 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.707230 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.707226 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.707538 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.709632 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.711126 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.712010 15596 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.712580 17510 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.713941 17510 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.685688 17196 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:17:41.728927 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.729480 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.669278 17334 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.730384 15600 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.731729 15593 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:17:41.733079 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.733170 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.734319 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.735061 15602 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.729655 17318 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.736239 15602 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:17:41.738296 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.736356 15673 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.742426 15670 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:41.743389 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 61721.5us
I20260709 13:17:41.745441 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.738909 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.739197 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.747785 15593 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.718628 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.748755 15675 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.749157 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.753785 15600 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:41.752030 15601 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:41.753121 15595 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.736722 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.706576 15669 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:17:41.756995 15599 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.757054 15748 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:41.759649 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:41.756492 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 129388us
I20260709 13:17:41.763460 15594 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.764415 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.760985 15671 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.767225 15602 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.764329 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.768469 15595 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:41.769433 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.770809 15748 raft_consensus.cc:2393] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.771448 17328 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.771749 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.771603 15677 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.772070 17328 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.781843 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.783253 15567 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.783339 17328 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:41.784019 17318 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.784914 17318 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.788249 17425 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.765456 15598 raft_consensus.cc:2376] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2. Re-sending same reply.
I20260709 13:17:41.788883 17425 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.790407 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.776656 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.791281 17425 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.776785 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.777472 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.794500 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.794569 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.773051 17333 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.795392 15598 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.792079 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.796871 15668 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:41.797281 15744 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.784780 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.798377 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.795475 15600 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.801497 15675 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:41.793943 15677 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:41.805419 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:41.805977 15670 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:41.805424 15596 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:41.775487 15749 raft_consensus.cc:2393] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.820884 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:41.809499 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.809696 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.810313 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.826011 15745 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.826093 15742 raft_consensus.cc:1240] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:17:41.826961 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.827466 15744 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:41.829988 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.830668 15750 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.831522 17450 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:41.775328 17424 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:41.832085 17450 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.833032 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:41.833660 15743 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.834319 17450 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:41.835006 17424 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.837370 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:41.838850 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.839084 15747 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.840574 15676 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:41.807444 17470 consensus_queue.cc:1059] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:41.846189 15670 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:41.847908 15673 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:41.859416 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.861410 15748 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.863013 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:41.868517 16309 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:41.824505 15593 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:41.874333 15674 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:41.878378 15716 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:41.878890 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.886607 17453 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:41.894891 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.895843 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.902570 17456 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.902382 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.910280 15744 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:41.903959 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.886520 15669 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.905215 15596 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:17:41.905905 15750 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:41.903668 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:41.913703 16304 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:41.916218 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.917047 15600 raft_consensus.cc:2410] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:41.918094 15746 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:41.919099 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.919829 15597 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.920621 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.921160 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:41.921377 15598 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.912683 17453 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:41.921756 15595 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:41.922720 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.922580 17453 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.923058 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.924176 15594 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.916899 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.910570 17456 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:41.925285 15601 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.925359 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.926064 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.926780 15601 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 2: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.925675 17456 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.911075 17450 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:17:41.926951 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.929785 15601 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.912511 15742 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.933545 17328 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:41.936780 17450 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:41.937162 17450 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:41.937284 15599 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:41.937980 17450 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:41.939136 17450 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:41.941222 15596 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.945103 15593 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.945144 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.947283 15750 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.950454 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.950877 17456 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.951647 15600 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:41.952021 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.957916 15595 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:41.958231 15598 raft_consensus.cc:2393] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:41.961526 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.961890 17377 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:41.962430 15748 raft_consensus.cc:2393] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:41.963208 17460 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:41.963558 17460 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:41.964497 17460 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:41.965781 17460 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:41.969574 16263 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:41.970682 17470 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:41.971503 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:41.972915 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.977521 17424 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:41.978749 17531 log.cc:927] Time spent T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:41.982215 16263 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:41.986642 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 55920.9us
I20260709 13:17:41.997659 15640 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.005314 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:42.006204 16304 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:42.007103 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:41.999778 17328 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.013164 17328 raft_consensus.cc:697] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:42.014226 17424 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.014153 17328 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.010080 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.022816 15672 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:42.028453 17377 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:42.028645 17424 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:42.029094 17377 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.029484 17424 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.031349 17377 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:42.032230 17424 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.032305 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.032675 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:42.033655 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.035009 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.035102 17424 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.035933 16295 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:42.035750 17424 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.036470 17424 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.037302 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.038090 16295 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.039330 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.046661 16295 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:42.047406 17424 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.049651 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.050478 16299 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:17:42.053640 17537 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:42.009009 17333 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:17:42.059643 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.060472 17425 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.061177 17425 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:42.061524 15640 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.062034 17425 raft_consensus.cc:3055] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.062376 17425 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.062812 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:42.063659 16304 raft_consensus.cc:2393] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.063489 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.064349 16309 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:42.065714 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 64998us
I20260709 13:17:42.063203 17425 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.069979 17425 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.070704 15743 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:42.077364 16309 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:42.080878 17384 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.080731 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.090449 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:42.093900 15567 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.112517 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.112819 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.113843 16295 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:42.114439 17541 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
I20260709 13:17:42.115231 17333 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.115393 16309 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:42.115983 17333 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:42.118079 17334 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.119141 17476 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.119280 17447 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.119695 17447 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.119745 17476 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.120759 17476 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.120355 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:42.122941 15672 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:42.120770 17447 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.124817 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 289) took 2131 ms. Trace:
I20260709 13:17:42.078747 17424 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.125214 15496 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.129011 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.130062 15748 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:42.125212 15497 rpcz_store.cc:276] 0709 13:17:39.993813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.994019 (+   206us) service_pool.cc:224] Handling call
0709 13:17:42.124753 (+2130734us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:41.656978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:41.679210 (+ 22232us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:41.679261 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:17:41.679280 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:41.681514 (+  2234us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:41.681632 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:41.681668 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:17:41.682366 (+   698us) tablet.cc:701] Row locks acquired
0709 13:17:41.682416 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:17:41.682565 (+   149us) write_op.cc:270] Start()
0709 13:17:41.682738 (+   173us) write_op.cc:276] Timestamp: P: 1783603061682514 usec, L: 0
0709 13:17:41.682776 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:17:41.757107 (+ 74331us) log.cc:844] Serialized 2839 byte log entry
0709 13:17:41.893060 (+135953us) op_driver.cc:464] REPLICATION: finished
0709 13:17:42.081611 (+188551us) write_op.cc:301] APPLY: starting
0709 13:17:42.081708 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:42.081900 (+   192us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:42.082028 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:42.082999 (+   971us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:42.083289 (+   290us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:17:42.083349 (+    60us) write_op.cc:312] APPLY: finished
0709 13:17:42.083663 (+   314us) log.cc:844] Serialized 59 byte log entry
0709 13:17:42.083860 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.083962 (+   102us) write_op.cc:454] Released schema lock
0709 13:17:42.084018 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:42.084427 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.084458 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37870,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":188270,"apply.run_cpu_time_us":2790,"apply.run_wall_time_us":2790,"num_ops":7,"prepare.queue_time_us":183767,"prepare.run_cpu_time_us":5081,"prepare.run_wall_time_us":188916,"replication_time_us":210129,"thread_start_us":156053,"threads_started":2}]]}
I20260709 13:17:42.133370 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.134235 17456 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.128347 15496 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.135535 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.136394 17456 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.137784 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:42.138545 17456 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.138924 17456 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:42.139364 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 77914.5us
I20260709 13:17:42.135793 15496 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 4 to 5, term changed from 2 to 3, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to <none>, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 3 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:42.140853 15640 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.145665 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:42.146801 16263 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:42.139365 17456 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.151342 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:42.152839 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 149748us
I20260709 13:17:42.140838 15496 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65), VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66), VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67), VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:42.165886 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.166600 15748 raft_consensus.cc:2393] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.147089 17344 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.169528 15567 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:42.170442 15496 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:42.152261 17421 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:42.184922 17421 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.185874 17421 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.187367 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:42.188014 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.188169 15743 raft_consensus.cc:2368] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:42.159261 17510 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.172736 17460 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.188933 17510 raft_consensus.cc:697] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:42.189128 17460 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.189913 17510 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.191188 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.191392 17460 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.191550 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.191937 15744 raft_consensus.cc:2393] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.192239 15750 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:42.147192 17488 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:42.192838 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.193542 15745 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.194324 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:42.195647 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.195559 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.147745 17424 consensus_queue.cc:1059] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:17:42.196913 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.197451 17424 raft_consensus.cc:3055] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:42.197512 15744 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:42.197890 17424 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.198952 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:42.198732 17424 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.199865 17424 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.183642 17344 consensus_queue.cc:1059] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.173066 17318 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:42.202817 17425 raft_consensus.cc:3055] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.192895 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.203363 17425 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.203094 17318 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.192175 15749 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:42.202312 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.203758 15742 raft_consensus.cc:2393] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.205777 15751 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.208194 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.210013 15601 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:42.207863 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.221457 15746 raft_consensus.cc:2393] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:42.221573 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 71733.4us
W20260709 13:17:42.222856 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.220893 15745 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:42.222121 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.224243 15744 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:42.202911 17470 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:42.225236 15748 raft_consensus.cc:1240] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:42.225934 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.149562 17450 consensus_queue.cc:1059] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:17:42.206784 15743 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:17:42.205631 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.232326 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.233556 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.234540 15750 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.209095 17447 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.204572 17425 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:42.237299 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 71317.6us
I20260709 13:17:42.207142 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.205400 17318 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.238780 15565 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.239825 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.241070 15751 raft_consensus.cc:2368] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:42.245151 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.243319 15746 raft_consensus.cc:2376] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2. Re-sending same reply.
I20260709 13:17:42.231313 17470 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.243198 15640 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:42.261888 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.264511 15751 raft_consensus.cc:2393] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.265451 15565 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.266909 15500 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 1 to 2, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:42.267788 16299 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:42.230830 17440 consensus_queue.cc:1059] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:17:42.250783 17189 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:42.252686 17470 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.251081 17328 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.271835 17328 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.274005 17328 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.283427 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:42.283238 15567 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:42.287040 15565 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.262813 17425 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:42.290683 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.281190 17488 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.293721 15742 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.283332 17450 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.285004 17476 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.290514 17189 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.281069 17474 consensus_queue.cc:1059] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:17:42.290750 17318 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.307399 17554 consensus_queue.cc:1059] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:17:42.308823 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.308728 17440 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:42.305064 17450 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.309348 17555 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:42.310735 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.314970 17470 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.316780 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.320266 17189 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.332368 17470 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.299520 17484 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.333817 17484 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.334249 17484 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.316036 17384 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:42.343242 17544 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:42.304564 17476 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.300230 17488 raft_consensus.cc:697] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.346213 15672 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:42.353107 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.355837 15751 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.356869 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.357736 15742 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.358454 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.359324 15751 raft_consensus.cc:2393] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.366477 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.367282 15749 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:42.368707 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.369992 17470 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.370410 17470 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.370764 17470 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.354553 17499 raft_consensus.cc:3055] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.372800 17499 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.373726 17499 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.374900 17499 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:42.376804 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 81381.7us
I20260709 13:17:42.377584 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:42.359829 16299 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:17:42.380964 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72801.2us
I20260709 13:17:42.361718 17384 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:42.379896 17318 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.387292 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.391502 15750 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:42.404659 16308 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:42.401734 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:42.405683 16306 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:42.412358 17470 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.414161 15747 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.404068 17424 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:42.384876 17554 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:17:42.403157 17333 raft_consensus.cc:3055] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.415351 17333 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.416194 17333 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.417197 16304 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:42.417467 17333 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.418435 17334 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.418817 17334 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.419696 17334 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.420029 17488 consensus_queue.cc:237] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.397480 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.389133 17328 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:42.422044 17328 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.422432 17328 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:42.422627 17421 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:42.382715 17474 consensus_queue.cc:1059] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:17:42.423211 17421 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.423399 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.423470 17328 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.424328 15750 raft_consensus.cc:2393] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.414681 15747 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:42.392760 17384 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.425592 15747 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.426685 15747 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.427763 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.431043 17328 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.401566 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:42.433406 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:42.434516 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.434716 16307 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:42.435648 15747 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:42.435750 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.436411 15750 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.436501 15748 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:42.437120 17470 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.438541 17476 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.439311 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.438537 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.440462 15749 raft_consensus.cc:2393] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.440343 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:42.440990 16307 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:42.442276 17555 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:42.442397 15642 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:42.442709 17555 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.443403 17476 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:42.443827 17476 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.444223 17476 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.443656 17555 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.445271 17555 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.445799 17421 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.414929 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.447358 15745 raft_consensus.cc:2393] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.449028 17440 raft_consensus.cc:3055] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:42.449585 17440 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.450766 17440 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.422508 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:42.455116 17384 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.430011 17484 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.459681 17484 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.469072 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:42.470039 15748 raft_consensus.cc:2376] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3. Re-sending same reply.
I20260709 13:17:42.430765 17456 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.473338 17456 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.474261 16309 raft_consensus.cc:1240] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:42.477110 17453 consensus_queue.cc:1059] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:42.477944 17453 raft_consensus.cc:3055] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.478245 17453 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:42.479079 17453 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.480155 17453 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.487787 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:42.488534 16307 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:42.439373 15714 leader_election.cc:400] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:42.489284 15714 leader_election.cc:403] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:17:42.489583 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.490091 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:42.490155 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50960.2us
I20260709 13:17:42.487555 15496 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 3 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:42.492081 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.493124 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.498845 15750 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:42.492547 15496 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 5 to 4, leader changed from <none> to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68), VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) added, now has a pending config: VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66), VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67), VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 3 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:42.508087 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.500548 15742 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:42.509145 17424 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.512140 17424 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:42.520448 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.522172 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:42.452579 17440 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:17:42.532665 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 138435us
I20260709 13:17:42.527598 17460 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:42.537341 17460 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:42.538278 17460 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.542268 17476 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:42.543725 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.545027 17424 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.545181 17334 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.546185 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:42.547180 16304 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:42.548627 15642 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:42.549798 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.550500 16304 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.528435 17456 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:42.553901 17456 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:42.554870 17456 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.556799 17424 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.557313 17424 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.557737 17424 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:42.561321 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.562803 15567 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.564327 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:42.565012 17334 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.566357 16304 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:42.567752 15642 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:42.568527 17488 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:42.568696 17189 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.569370 17488 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.570057 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.570384 17488 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.571410 17189 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.572743 17476 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.575342 15500 catalog_manager.cc:5697] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 2, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.577564 17334 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.572772 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:42.579510 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 88002.7us
I20260709 13:17:42.583581 15674 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:42.583863 15670 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:42.585479 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:42.586287 15673 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:42.580021 15500 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 4 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:42.598253 15672 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:42.598080 15500 catalog_manager.cc:5697] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 3 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:42.606125 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.611667 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.612668 15601 raft_consensus.cc:2393] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:42.612730 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.618103 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:42.602474 17318 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.614063 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:42.621663 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.609289 17454 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:42.611394 17559 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.614543 17334 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:42.632341 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 92565.2us
I20260709 13:17:42.650288 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.652994 15672 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.656989 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.656911 15598 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
W20260709 13:17:42.665992 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 47964.8us
I20260709 13:17:42.667042 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:42.627529 17424 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:42.683240 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.687789 15600 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:42.687904 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.623284 17564 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:17:42.695837 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.696784 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.697423 15593 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:42.697600 15599 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:42.698701 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:42.698750 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.699266 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.699613 15599 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:42.699939 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:42.701040 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2d5bac8fb54783a1f420061d08067f with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:42.703084 15669 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.733198 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:42.724252 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.656206 17560 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.742089 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.745496 15673 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:42.745697 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54014.5us
W20260709 13:17:42.746803 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.748363 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 118922us
I20260709 13:17:42.753283 15750 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.753882 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:42.754626 15601 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:42.691911 17567 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.705395 17559 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:42.691993 15594 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:42.767905 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.761405 15600 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:42.769369 15597 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:42.740214 17333 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.759415 17450 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.781209 15595 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:42.693239 17334 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.748015 17460 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:17:42.783715 17554 consensus_queue.cc:1059] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:42.767536 17470 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:42.784140 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.743465 17318 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.761224 17425 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.784475 17553 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:42.784554 17333 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.768082 17474 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.785285 17447 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:42.758260 17556 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:17:42.786546 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.788574 15601 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
W20260709 13:17:42.789475 17561 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:17:42.796427 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.782866 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 135688us
I20260709 13:17:42.753049 17484 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:17:42.793013 17450 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:42.792474 17559 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:17:42.813112 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.821000 15748 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:42.822146 15750 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.839823 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.836162 15751 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:42.808457 16304 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:42.840808 15751 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:42.824501 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:42.841732 15601 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:42.844677 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:42.845518 15597 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.846544 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:42.847357 15746 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.823518 17568 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.805152 17499 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:42.837673 17450 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.809755 17470 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.820499 17425 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.825646 17328 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:17:42.831295 17421 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:17:42.875276 17573 tablet_replica.cc:333] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:17:42.867447 17576 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:42.861918 17460 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:42.881358 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.864950 17560 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:17:42.877808 17488 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:42.886065 17424 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.875918 15751 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.859522 17377 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:17:42.865427 17476 consensus_queue.cc:1059] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:17:42.881060 16295 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:17:42.899859 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 67009.5us
I20260709 13:17:42.896660 15747 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:42.901079 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:42.879359 17440 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:17:42.881511 17579 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:42.903383 15751 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.903573 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:17:42.904817 17572 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:17:42.860944 17568 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.909611 15597 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:42.917466 17476 raft_consensus.cc:3055] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:42.917918 17476 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:42.918895 17568 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.918700 17476 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.919929 17476 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.920909 15594 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:42.921114 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.921960 15742 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:17:42.922693 15714 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:42.923467 17571 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.924331 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:42.890064 17554 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:17:42.936790 15746 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:42.908946 17510 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.935700 17564 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:42.914713 17328 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:42.957871 17328 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:42.958305 17328 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:42.961220 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:42.962237 15668 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:42.964617 15749 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:42.965044 15749 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:42.965871 15749 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:42.966254 17328 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.966920 15749 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:42.971343 17571 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:42.976673 17564 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:42.977504 17564 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:42.979579 17328 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:42.985489 17334 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:42.987143 17470 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:42.987680 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.988206 17425 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:42.988517 15600 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:42.989854 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:42.992149 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:42.905450 17559 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:42.992962 16295 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:42.996133 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.940699 17555 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:42.998812 17555 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:42.999313 15600 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:42.953016 15751 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:17:42.999897 15751 pending_rounds.cc:85] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 2
I20260709 13:17:43.000242 15751 pending_rounds.cc:107] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:17:43.000634 15751 raft_consensus.cc:2889] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.952878 15596 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:43.002597 17555 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:42.957080 17563 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.336s	user 0.001s	sys 0.003s
I20260709 13:17:43.009181 16263 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:43.016981 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 176088us
I20260709 13:17:43.018258 17328 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:43.019013 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 63742.8us
I20260709 13:17:43.021660 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:43.024858 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 172467us
I20260709 13:17:43.013156 17555 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:43.018764 17328 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.031924 15567 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:43.040642 15751 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:43.041337 15595 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:43.049700 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:43.049988 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:43.050381 16307 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:17:43.043540 17556 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:17:43.053479 17570 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.296s	user 0.001s	sys 0.002s
W20260709 13:17:43.063069 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.034217 17328 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.034385 17568 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.070171 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:43.070477 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.081559 15744 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:43.073838 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:43.027606 17453 consensus_queue.cc:1059] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:17:43.047224 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:43.065444 17450 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.067202 17454 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:17:43.061268 17424 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.045449 17576 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:17:43.066257 17556 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:43.032900 17189 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:17:43.096167 15668 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:43.105940 17450 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:43.080881 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.106304 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:43.084926 17460 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.107822 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:43.120424 15567 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:43.120708 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:43.122556 15744 raft_consensus.cc:2393] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:43.107147 15669 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:43.076414 17567 consensus_queue.cc:1059] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:17:43.127676 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.089819 17568 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.130626 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:43.134976 15601 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:43.123145 17470 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:43.127471 17450 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.107350 17424 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.123081 17558 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:17:43.137353 17470 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:43.163249 16295 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
W20260709 13:17:43.164731 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.165858 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.158987 17454 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.169050 17454 raft_consensus.cc:3055] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:43.169502 17454 raft_consensus.cc:740] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:43.157694 17556 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:43.170446 17454 consensus_queue.cc:260] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:43.153578 17573 raft_consensus.cc:2243] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:17:43.172317 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.157768 17470 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:43.174244 15642 leader_election.cc:336] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.552s (SENT)
I20260709 13:17:43.174710 15642 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:43.175768 15642 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.564s (SENT)
I20260709 13:17:43.176153 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:43.144510 17567 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:43.203269 16306 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:43.212184 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:43.214176 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.221244 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 45520us
W20260709 13:17:43.221481 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.176218 17564 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:43.222010 15642 leader_election.cc:336] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.566s (SENT)
I20260709 13:17:43.225927 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:43.210708 17384 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.210268 17421 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.217566 17454 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.218516 17558 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:17:43.233583 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 127358us
I20260709 13:17:43.238343 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:43.238571 17567 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:43.239606 17567 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:43.240387 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:43.241150 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:43.242151 15595 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:17:43.242666 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:43.243527 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:43.244082 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:43.244815 15600 raft_consensus.cc:2393] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 3: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:43.245581 15594 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:43.246630 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.246850 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:43.247160 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.248392 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.249557 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.250665 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.251255 15674 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.252068 15642 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:43.254293 15595 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:43.256961 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.257455 15595 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:43.257685 15675 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.259356 17567 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:43.260178 17567 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:43.260813 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:43.261070 17567 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:43.259606 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:43.269456 15677 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:43.269690 15673 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.271217 15595 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:17:43.271756 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:43.232332 17425 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:43.274861 15595 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:17:43.277489 15595 pending_rounds.cc:85] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 5
I20260709 13:17:43.277753 15595 pending_rounds.cc:107] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:17:43.278002 15595 raft_consensus.cc:2889] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.276007 15674 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
W20260709 13:17:43.280318 17598 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:43.263420 17558 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:43.295823 15675 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
W20260709 13:17:43.275403 17594 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:43.283746 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:43.284482 17488 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:43.286201 17592 raft_consensus.cc:3055] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:17:43.287113 17593 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:43.296101 15677 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:43.296546 17609 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.282552 17610 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.304201 15601 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:43.288132 16295 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:43.311256 17592 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:43.295454 17425 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.327268 17424 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:43.337297 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 53660.5us
I20260709 13:17:43.329231 17488 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:43.331951 17568 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:43.364763 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.546744 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.340055 15749 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:17:43.547482 15749 pending_rounds.cc:85] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 4
I20260709 13:17:43.547839 15749 pending_rounds.cc:107] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:17:43.548127 15749 raft_consensus.cc:2889] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.326717 17609 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:43.551983 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.553164 17609 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:43.381845 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.555045 15497 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 4 to 5, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.556915 15749 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:43.508417 17560 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:43.509037 17577 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.607s	user 0.008s	sys 0.000s
I20260709 13:17:43.508559 17470 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.558462 17560 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.558277 15497 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 3, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:43.559496 15746 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:43.559788 17470 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:43.358865 17558 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.363436 17601 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.510174 17425 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:43.338794 15714 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:43.568310 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 229585us
I20260709 13:17:43.569083 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:43.570374 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:43.571497 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:43.572899 17571 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.573668 17571 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:43.573976 17571 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:43.574331 17571 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.576263 17606 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.577123 17602 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:43.582121 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.584698 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.585822 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.587335 16304 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:43.572495 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:43.593205 15496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 211) took 1113 ms. Trace:
I20260709 13:17:43.594626 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:43.595278 17470 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.595932 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:43.361933 17488 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.506139 17328 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.596803 17602 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:43.597332 17602 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:43.597761 17602 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:43.598485 17328 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:43.518929 17573 raft_consensus.cc:2272] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:43.519784 15745 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:17:43.520180 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.521567 16265 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:43.522234 17586 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.601038 17601 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.511152 17564 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:43.528908 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:43.601434 17586 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.602274 15750 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:43.529425 15642 leader_election.cc:336] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.620s (SENT)
W20260709 13:17:43.535167 17597 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.269s	user 0.000s	sys 0.007s
I20260709 13:17:43.541858 15747 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:43.603618 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:43.543503 17476 consensus_meta.cc:287] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.623s	user 0.008s	sys 0.009s
I20260709 13:17:43.595804 17470 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:43.609673 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 88196us
W20260709 13:17:43.610235 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 80842.8us
I20260709 13:17:43.524940 17592 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:43.669080 15673 raft_consensus.cc:2410] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:43.671159 17470 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:43.665180 17560 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:43.665570 17586 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:43.612260 17421 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:43.665696 17606 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:43.666224 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:43.668753 17328 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:43.673180 17571 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.676005 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 322) took 1123 ms. Trace:
I20260709 13:17:43.593820 15496 rpcz_store.cc:276] 0709 13:17:42.479595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.479784 (+   189us) service_pool.cc:224] Handling call
0709 13:17:43.593099 (+1113315us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:42.588012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:42.653730 (+ 65718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:42.657797 (+  4067us) write_op.cc:435] Acquired schema lock
0709 13:17:42.660138 (+  2341us) tablet.cc:662] Decoding operations
0709 13:17:42.785030 (+124892us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:42.785089 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:42.785128 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:42.785403 (+   275us) tablet.cc:701] Row locks acquired
0709 13:17:42.785432 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:17:42.785590 (+   158us) write_op.cc:270] Start()
0709 13:17:42.785735 (+   145us) write_op.cc:276] Timestamp: P: 1783603062785523 usec, L: 0
0709 13:17:42.785761 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:17:42.786402 (+   641us) log.cc:844] Serialized 1160 byte log entry
0709 13:17:42.878508 (+ 92106us) op_driver.cc:464] REPLICATION: finished
0709 13:17:42.885561 (+  7053us) write_op.cc:301] APPLY: starting
0709 13:17:42.885636 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:42.885749 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:42.885859 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:42.886197 (+   338us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:42.886388 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:42.886432 (+    44us) write_op.cc:312] APPLY: finished
0709 13:17:42.886620 (+   188us) log.cc:844] Serialized 29 byte log entry
0709 13:17:42.886787 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.886864 (+    77us) write_op.cc:454] Released schema lock
0709 13:17:42.886902 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:42.887246 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.887284 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43719,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":2730,"apply.run_cpu_time_us":1657,"apply.run_wall_time_us":1658,"num_ops":2,"prepare.queue_time_us":120,"prepare.run_cpu_time_us":3918,"prepare.run_wall_time_us":206393,"replication_time_us":79424}]]}
I20260709 13:17:43.683346 16306 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:43.675578 15484 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:43.679087 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:43.685274 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:43.672204 17602 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:43.748318 16307 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:44.012465 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 345700us
I20260709 13:17:43.689860 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:44.118152 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.800836 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.748162 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 56623.1us
W20260709 13:17:44.329000 15484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 653429us
W20260709 13:17:43.925920 15748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.028s
W20260709 13:17:44.301196 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.919344 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:44.345230 15748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.003s	sys 0.037s
I20260709 13:17:44.242847 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:44.346578 15745 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:43.703326 15677 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:43.758373 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:43.801088 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:43.743140 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.349282 15750 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:44.349584 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.244707 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 441760us
W20260709 13:17:44.126276 17624 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:17:43.688746 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:44.344633 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.345824 15746 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:43.988456 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.224303 17499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.004s	sys 0.028s
W20260709 13:17:43.865370 17556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.000s	sys 0.025s
I20260709 13:17:44.331368 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1812) took 1183 ms. Trace:
W20260709 13:17:44.350801 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 684674us
I20260709 13:17:43.805485 16295 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:17:44.374123 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:44.343490 15751 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:43.684374 17559 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.242060 17628 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.780725 17568 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.608s
W20260709 13:17:44.371863 17499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.007s	sys 0.031s
W20260709 13:17:44.361173 15642 leader_election.cc:336] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.656s (SENT)
I20260709 13:17:44.399561 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:43.870954 17558 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.797768 17592 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:44.370970 17582 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:17:44.288638 17605 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.251576 17631 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.800565 17474 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.799561 17553 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.373710 15744 rpcz_store.cc:276] 0709 13:17:43.147888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.150399 (+  2511us) service_pool.cc:224] Handling call
0709 13:17:43.150670 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.156244 (+  5574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.156274 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.208583 (+ 52309us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.332050 (+123467us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:43.332091 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.332160 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:43.689104 (+356944us) raft_consensus.cc:1685] finished
0709 13:17:43.689132 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.331308 (+642176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68863,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":9514,"thread_start_us":105511,"threads_started":1,"wal-append.queue_time_us":140324}
I20260709 13:17:44.322822 17447 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.377887 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1815) took 1134 ms. Trace:
I20260709 13:17:44.379997 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:44.312305 17476 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.444842 17476 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:44.341738 17586 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.349472 17567 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:44.446184 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 85083.6us
W20260709 13:17:44.446825 15642 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.674s (SENT)
I20260709 13:17:44.447280 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:44.442584 15748 rpcz_store.cc:276] 0709 13:17:43.243177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.243329 (+   152us) service_pool.cc:224] Handling call
0709 13:17:43.243841 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.265453 (+ 21612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.265480 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:43.275238 (+  9758us) log.cc:844] Serialized 26 byte log entry
0709 13:17:43.531587 (+256349us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4800150258. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:17:44.345963 (+814376us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:44.346004 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.346067 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.369865 (+ 23798us) raft_consensus.cc:1685] finished
0709 13:17:44.369884 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.377816 (+  7932us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29231,"raft.run_cpu_time_us":2577,"raft.run_wall_time_us":256839,"spinlock_wait_cycles":24863616,"thread_start_us":1070172,"threads_started":2,"wal-append.queue_time_us":1067738}
I20260709 13:17:43.806200 17555 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.571s
I20260709 13:17:43.807811 17484 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.570s
I20260709 13:17:44.329552 15500 rpcz_store.cc:276] 0709 13:17:42.553000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.553353 (+   353us) service_pool.cc:224] Handling call
0709 13:17:42.567207 (+ 13854us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5400002490. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cc0b2 00007faf04545a89 00007faf044ddda6 00007faf044af088 00007faf045ad37e 00007faf02a6e2a4 00007faf02a6e232 00007faf02a6e161 00007faf02a6e0dc
0709 13:17:43.624418 (+1057211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:42.786854 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:42.787423 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:42.787455 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:17:42.787475 (+    20us) tablet.cc:662] Decoding operations
0709 13:17:42.788014 (+   539us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:42.788068 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:42.788124 (+    56us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:17:42.788433 (+   309us) tablet.cc:701] Row locks acquired
0709 13:17:42.788454 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:42.788583 (+   129us) write_op.cc:270] Start()
0709 13:17:42.799681 (+ 11098us) write_op.cc:276] Timestamp: P: 1783603062788536 usec, L: 0
0709 13:17:42.803020 (+  3339us) op_driver.cc:348] REPLICATION: starting
0709 13:17:42.854269 (+ 51249us) log.cc:844] Serialized 1303 byte log entry
0709 13:17:43.047666 (+193397us) op_driver.cc:464] REPLICATION: finished
0709 13:17:43.094251 (+ 46585us) write_op.cc:301] APPLY: starting
0709 13:17:43.096756 (+  2505us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:43.117490 (+ 20734us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:43.124938 (+  7448us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:43.146253 (+ 21315us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:43.160426 (+ 14173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:17:43.160488 (+    62us) write_op.cc:312] APPLY: finished
0709 13:17:43.160729 (+   241us) log.cc:844] Serialized 35 byte log entry
0709 13:17:43.160899 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.160988 (+    89us) write_op.cc:454] Released schema lock
0709 13:17:43.161028 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:43.161376 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.161402 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":224081,"reported_tablets":3,"spinlock_wait_cycles":25158016,"child_traces":[["op",{"apply.queue_time_us":8310,"apply.run_cpu_time_us":2509,"apply.run_wall_time_us":72030,"num_ops":3,"prepare.queue_time_us":170217,"prepare.run_cpu_time_us":3612,"prepare.run_wall_time_us":67802,"replication_time_us":240467}]]}
W20260709 13:17:44.373602 17556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.006s	sys 0.034s
I20260709 13:17:44.454847 15751 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:44.385752 17454 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.404711 17488 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.451414 17631 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.446106 17553 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:44.450614 17421 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:44.464157 17553 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:44.451894 17474 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:44.465214 17618 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:44.452193 17447 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:44.461452 17488 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:44.471410 15642 leader_election.cc:336] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.730s (SENT)
I20260709 13:17:44.406585 17425 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.528338 15642 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:44.442072 17558 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:44.398847 17628 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.481812 17476 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:44.472088 17470 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:44.484166 17454 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:44.459960 17586 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.489418 17602 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:44.468122 17421 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:44.459370 17573 ts_tablet_manager.cc:1916] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:44.383394 17559 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.474874 17606 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.464347 17631 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:44.529549 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 58193.9us
I20260709 13:17:44.480872 17553 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.547493 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 190390us
I20260709 13:17:44.472417 17499 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:44.445919 17605 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:44.543334 17616 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:17:44.568464 15642 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.751s (SENT)
I20260709 13:17:44.571439 16265 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:44.560534 17568 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:44.585206 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 896505us
I20260709 13:17:44.539552 17425 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.587577 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:44.588577 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.590183 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.600795 16308 raft_consensus.cc:2393] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:17:44.600826 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.601706 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.601109 15642 connection.cc:256] RPC call timeout handler was delayed by -1.1036377469999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:17:44.604012 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0556152799999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:17:44.605804 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 245397us
W20260709 13:17:44.608788 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0424377470001218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
W20260709 13:17:44.611971 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0379377470001145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 13:17:44.570323 17606 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.610090 17454 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:44.615072 17586 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:44.631594 17454 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:44.633627 17474 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:44.633814 17454 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:44.635432 17447 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:44.636827 17510 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:44.637387 17470 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:44.637817 17470 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.638188 17470 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.637996 17586 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:44.638602 17558 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:44.640717 17488 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:44.637411 17510 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.579593 17553 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:44.643268 17510 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:44.643416 17553 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:44.643812 17510 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.630666 17559 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:44.615676 17334 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:44.647565 17334 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:44.648308 17622 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:17:44.649596 17626 log.cc:927] Time spent T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:17:44.649911 17334 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:44.615854 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:44.654042 17555 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:44.654508 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:44.654663 17631 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.580792 17556 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.741824 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 82505.4us
I20260709 13:17:44.749125 15640 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:44.747233 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.742065 15673 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.587256 17450 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.584447 17568 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.579355 17636 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.752319 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:44.659489 15742 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:17:44.765702 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.753760 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 373636us
W20260709 13:17:44.782423 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.644369 17510 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.654548 17555 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:44.781086 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 199796us
W20260709 13:17:44.881995 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 132379us
I20260709 13:17:44.946056 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:45.130393 15671 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:44.832749 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.874502 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:44.965708 15673 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:45.134047 15745 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:45.134142 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:44.629076 17567 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.628731 17476 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:44.786741 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:44.745291 17488 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:44.629729 17638 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:45.015664 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:44.615286 17605 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:45.135310 15673 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:44.657037 17616 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.736676 17421 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.141664 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:44.807703 17568 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:44.968381 17425 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.152683 15672 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 2.
I20260709 13:17:45.025990 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:45.136161 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:44.922755 17484 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:45.135416 17625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.000s	sys 0.011s
I20260709 13:17:44.775780 17328 raft_consensus.cc:697] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:44.786249 17558 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.062808 16295 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:44.823205 17450 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:44.933606 17559 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.179404 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:45.137578 17474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.003s	sys 0.007s
I20260709 13:17:45.023188 17499 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.968386 15747 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:44.774081 17334 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.181589 15742 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:45.140915 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:45.345470 15745 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:44.745160 17571 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.063439 17586 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:44.967294 17647 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:45.147852 17582 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.003s	sys 0.007s
I20260709 13:17:45.139707 15750 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:44.993956 17640 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:45.381934 17640 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:45.383291 17640 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.384903 17640 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.063439 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:45.389271 15749 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:45.170830 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.150431 17567 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.390687 15668 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:45.205683 17641 log.cc:927] Time spent T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:17:45.392431 17567 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:45.171048 17653 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.393357 17653 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.395284 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1739) took 1708 ms. Trace:
I20260709 13:17:45.152696 17476 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.398690 17476 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.138151 17650 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:17:45.182570 17447 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.176255 15676 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:45.173885 17645 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:45.400653 17447 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.403680 17447 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:44.749185 17554 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.435s
I20260709 13:17:44.741465 17631 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.395804 15674 rpcz_store.cc:276] 0709 13:17:43.686485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.686616 (+   131us) service_pool.cc:224] Handling call
0709 13:17:43.686887 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.748012 (+ 61125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.748047 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.293481 (+545434us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.369305 (+ 75824us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b48001d2458. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:17:44.569260 (+199955us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:44.569311 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.569380 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.394869 (+825489us) raft_consensus.cc:1685] finished
0709 13:17:45.394899 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.395200 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92511,"raft.queue_time_us":60846,"raft.run_cpu_time_us":17400,"raft.run_wall_time_us":611584,"spinlock_wait_cycles":166205312,"thread_start_us":226607,"threads_started":1,"wal-append.queue_time_us":684829}
I20260709 13:17:45.406939 17631 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:45.178916 17642 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.051580 17639 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.279330 15671 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
W20260709 13:17:45.279811 15596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.033s	sys 0.032s
W20260709 13:17:45.408629 15596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.034s	sys 0.033s
I20260709 13:17:44.744885 17556 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.076696 17646 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.262071 17625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.000s	sys 0.016s
W20260709 13:17:45.293715 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 321534us
I20260709 13:17:45.366159 15743 raft_consensus.cc:2410] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:45.316005 15748 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:45.299348 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:45.323156 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 173076us
I20260709 13:17:45.423398 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:45.263188 17655 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.330440 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.421125 15744 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:45.319813 17474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.003s	sys 0.008s
I20260709 13:17:45.186757 17488 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.188228 17421 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:45.362792 15640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.005s	sys 0.007s
W20260709 13:17:45.451447 15640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.005s	sys 0.007s
I20260709 13:17:45.299685 17558 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:45.350962 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 215417us
I20260709 13:17:45.312971 17454 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:17:45.352451 17649 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.139s	user 0.000s	sys 0.006s
I20260709 13:17:45.280920 17425 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:17:45.170997 17636 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:45.415702 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 279430us
I20260709 13:17:45.470001 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:45.281533 17484 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.426427 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.426614 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.185155 17616 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:45.408931 17582 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.004s	sys 0.008s
I20260709 13:17:45.446110 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:45.446022 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.351795 17499 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:45.451907 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 701208us
I20260709 13:17:45.495561 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.314122 17652 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.415726 17612 log.cc:927] Time spent T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:45.417521 17571 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.325205 17559 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.407722 17642 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.365484 17647 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:45.458328 16265 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:45.467846 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.515892 15673 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:45.421124 17476 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.359800 17334 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.490517 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:45.449836 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:45.492616 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.494097 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.522490 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.496275 15672 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 1.
I20260709 13:17:45.378580 17586 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.460410 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:45.503182 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:45.538498 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:45.504096 15602 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:17:45.539517 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 49124.5us
I20260709 13:17:45.503926 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.407961 17639 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.481216 17644 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:45.523103 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.497617 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.500739 17567 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.507853 15594 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:45.560501 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1737) took 1884 ms. Trace:
I20260709 13:17:45.502318 17651 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.543203 15597 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:45.482621 17454 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.543802 15676 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:45.430181 17646 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.544807 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.518667 17647 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:45.557605 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.480621 17328 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.544916 15593 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
W20260709 13:17:45.577154 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.579496 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 121218us
I20260709 13:17:45.565771 15672 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:45.567998 15567 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:45.561760 15675 rpcz_store.cc:276] 0709 13:17:43.676282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.676547 (+   265us) service_pool.cc:224] Handling call
0709 13:17:43.743899 (+ 67352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:43.870748 (+126849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.870795 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.244800 (+374005us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.365603 (+120803us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b18001fb040. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1 00007faefe6aba0f
0709 13:17:44.582938 (+217335us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:44.583015 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.583119 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.547537 (+964418us) raft_consensus.cc:1685] finished
0709 13:17:45.547565 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.560425 (+ 12860us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4001,"raft.queue_time_us":495214,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":31003,"spinlock_wait_cycles":54435712,"thread_start_us":203848,"threads_started":1,"wal-append.queue_time_us":860828}
I20260709 13:17:45.541699 17628 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.542187 17606 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.452776 17655 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.590143 16265 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:45.591435 15714 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:45.580333 17470 consensus_meta.cc:287] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.942s	user 0.015s	sys 0.000s
W20260709 13:17:45.583024 17592 consensus_meta.cc:287] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.170s	user 0.010s	sys 0.007s
I20260709 13:17:45.561177 17571 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:45.566373 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:45.567022 15668 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:45.600176 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:45.628921 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:45.616920 15484 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:45.583911 17651 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:45.617753 17663 log.cc:927] Time spent T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Append to log took a long time: real 0.326s	user 0.001s	sys 0.001s
I20260709 13:17:45.617614 17684 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.618273 17450 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.619400 17659 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:45.620074 17646 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.604826 17671 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:45.602301 17632 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.536363 17476 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.579078 17560 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.507460 17652 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.599560 17668 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:45.620134 17681 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:45.659584 17659 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.712970 17659 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.714684 17639 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.715018 17674 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:45.715579 17674 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.715978 17674 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.683235 17671 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.716979 17671 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.718236 17652 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:45.719312 17421 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:45.682962 17684 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:45.720854 17664 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:17:45.608937 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.626268 16265 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:45.584744 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:45.617797 17665 log.cc:927] Time spent T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:17:45.606487 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 492) took 1996 ms. Trace:
I20260709 13:17:45.623521 17470 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:45.631739 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 128626us
I20260709 13:17:45.633100 17673 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:17:45.637328 15567 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:45.587991 17510 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:45.665443 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 64052.5us
I20260709 13:17:45.621703 17556 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:45.622849 17606 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.583724 17425 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:17:45.631783 17662 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:17:45.608065 17454 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.624243 17602 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.692021 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 112374us
I20260709 13:17:45.609511 17558 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.610145 17677 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.610641 17499 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.611423 17555 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.609210 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:45.560155 17644 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.608717 17658 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.722770 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 96619.8us
I20260709 13:17:45.592888 17567 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:45.686205 17450 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.737833 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 100570us
I20260709 13:17:45.799175 15567 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:45.722609 15675 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:45.661432 17474 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:45.765134 15674 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:45.661621 15747 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:45.690454 17582 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:45.769174 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 246296us
I20260709 13:17:45.628091 17571 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.610841 17657 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:17:45.773514 15642 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:45.769126 17646 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:45.842682 17646 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.843152 17646 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:45.787387 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.786945 15600 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:45.765427 17488 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:45.790622 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 252386us
I20260709 13:17:45.846627 15671 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:45.712042 17560 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.777029 17484 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.769219 17672 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:45.780061 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.808945 17682 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:45.732568 17668 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.774677 17606 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.709009 17632 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.807616 17499 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 13:17:45.806710 17567 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.812566 17586 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:45.952399 17646 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.807245 17582 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.969677 17582 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:45.971058 17567 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.954842 17606 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:45.973675 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.973903 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.974354 15675 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:45.974471 15669 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:45.975378 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.976006 15669 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:45.946372 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 172992us
I20260709 13:17:45.977437 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:45.979305 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:45.981657 17647 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.985843 17655 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:45.986617 17650 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:45.987884 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 187936us
I20260709 13:17:45.946452 17421 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:45.789927 17602 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.994451 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:45.807153 17450 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:45.847947 17616 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:45.854462 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.996755 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:45.956511 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 114447us
I20260709 13:17:45.998407 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:46.012514 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1741) took 1437 ms. Trace:
I20260709 13:17:46.013203 15670 rpcz_store.cc:276] 0709 13:17:44.575388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.575587 (+   199us) service_pool.cc:224] Handling call
0709 13:17:44.576024 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.577097 (+  1073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.577152 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.599934 (+ 22782us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.023376 (+423442us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:45.023416 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.023488 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.012269 (+988781us) raft_consensus.cc:1685] finished
0709 13:17:46.012290 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.012440 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3468,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":14231,"thread_start_us":379098,"threads_started":1,"wal-append.queue_time_us":563705}
I20260709 13:17:45.898217 17555 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:46.016584 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:17:46.018057 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 58775.7us
I20260709 13:17:45.918684 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:45.954879 17668 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:45.956354 17632 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:45.953198 15668 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:45.945593 17651 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:45.804989 17474 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:46.020465 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 101870us
I20260709 13:17:46.023662 15714 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:45.791615 17677 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:45.996888 17328 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.034430 15640 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:45.997004 17682 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:17:46.036868 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 49070us
I20260709 13:17:45.799041 17658 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.016439 17510 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:46.025265 17568 consensus_meta.cc:287] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.830s	user 0.013s	sys 0.000s
I20260709 13:17:46.044831 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:46.021755 17640 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.046487 15642 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:46.021327 17616 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.021880 17586 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.021950 17606 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.025279 17672 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:46.029433 17567 raft_consensus.cc:2764] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:17:46.024804 17687 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.047894 15640 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:46.036310 17474 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.043146 17651 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.083657 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.070094 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:46.042706 17454 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:46.068886 17470 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:46.092813 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45122.8us
I20260709 13:17:46.051728 17425 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:46.095852 15742 raft_consensus.cc:2393] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:46.096340 15642 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:46.039650 17668 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:17:46.099295 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.103667 15746 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:46.102860 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:46.102501 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:46.099849 15751 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:46.110116 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.090544 17650 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:45.735318 16304 rpcz_store.cc:276] 0709 13:17:43.610586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.742422 (+131836us) service_pool.cc:224] Handling call
0709 13:17:44.011837 (+269415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.301733 (+289896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:44.312705 (+ 10972us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:44.381496 (+ 68791us) log.cc:844] Serialized 26 byte log entry
0709 13:17:44.980332 (+598836us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:45.001763 (+ 21431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.018825 (+ 17062us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.606262 (+587437us) raft_consensus.cc:1685] finished
0709 13:17:45.606282 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.606423 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240158,"raft.queue_time_us":266788,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":14642,"thread_start_us":446352,"threads_started":1,"wal-append.queue_time_us":1180178}
I20260709 13:17:46.091828 17652 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:46.098822 17488 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:46.113866 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.114293 17653 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:46.114818 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:46.098624 17672 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:46.124882 17672 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.125083 15747 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:46.125273 17672 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.094285 17606 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:46.043372 17328 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.117416 15642 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:46.118427 17695 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:17:46.120644 17698 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:17:46.120855 17652 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:46.094499 17586 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.121497 17644 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.122280 17476 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:46.084568 17640 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.046954 17659 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.098917 17425 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.132494 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:46.139755 17425 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:46.137193 17488 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.092038 17681 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:46.135068 17682 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.103919 17692 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:46.069141 17568 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.126487 17606 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.091863 17694 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:46.048487 17673 consensus_queue.cc:1059] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:17:46.137112 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:46.159372 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52010.9us
W20260709 13:17:46.149271 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.160271 17706 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:46.160912 17706 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.161437 17568 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.155364 15748 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:46.111606 17651 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:46.069670 17510 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.093217 17687 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.139336 17573 ts_tablet_manager.cc:1929] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:17:46.164054 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.165014 17673 consensus_queue.cc:1243] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:46.163460 17470 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:46.154850 17334 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.165333 17652 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.158190 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:46.386507 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 224050us
I20260709 13:17:46.388108 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:46.152184 17684 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:46.244887 17699 log.cc:927] Time spent T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:17:46.162429 17571 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:46.234208 17672 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:46.385392 17706 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.341728 17677 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:46.209329 17705 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.167102 17582 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.381848 17668 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:46.405550 17672 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.397217 17573 log.cc:1199] T ea2d5bac8fb54783a1f420061d08067f P 558532223b984cf796cb6b98ddd6c9f2: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/wals/ea2d5bac8fb54783a1f420061d08067f
I20260709 13:17:46.406198 17668 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.407169 17582 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.407977 17573 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51462 (request call id 83) took 3710 ms. Trace:
I20260709 13:17:46.408567 17705 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.408489 17573 rpcz_store.cc:276] 0709 13:17:42.697944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.700752 (+  2808us) service_pool.cc:224] Handling call
0709 13:17:42.838224 (+137472us) ts_tablet_manager.cc:1151] Deleting tablet ea2d5bac8fb54783a1f420061d08067f
0709 13:17:42.857256 (+ 19032us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:17:43.518214 (+660958us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54000d2ad4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f8362 00007faf020e334c 00007faf0370660a 00007faf037372d0 00007faf0371d83d 00007faf0371d7e9 00007faf0371d779 00007faf0371d741 00007faf0371c96d 000000000038f354
0709 13:17:45.688751 (+2170537us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:46.132910 (+444159us) tablet_metadata.cc:665] Metadata flushed
0709 13:17:46.407887 (+274977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":633684,"spinlock_wait_cycles":25997056,"tablet-delete.queue_time_us":118195,"thread_start_us":64700,"threads_started":1}
I20260709 13:17:46.399631 17510 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:46.341018 17674 consensus_meta.cc:287] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.625s	user 0.009s	sys 0.003s
I20260709 13:17:46.410898 17474 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:46.229591 17688 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.497s	user 0.004s	sys 0.000s
I20260709 13:17:46.339849 17425 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.461345 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:46.462394 15748 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:46.410840 17705 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:46.462538 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.468871 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 79457.6us
I20260709 13:17:46.469862 17673 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:46.473024 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.473975 16307 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:46.474612 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.475432 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:46.477452 15642 connection.cc:256] RPC call timeout handler was delayed by -1.9361712229999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:17:46.478008 15642 leader_election.cc:336] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.548s (SENT)
W20260709 13:17:46.287595 17696 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:17:46.209168 17658 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.478395 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:46.479156 17679 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:46.470681 17673 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:46.480373 15642 leader_election.cc:336] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.736s (SENT)
I20260709 13:17:46.480444 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:46.480954 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:46.481158 16299 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:46.481801 17679 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:46.481762 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.481145 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.208884 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.462847 17488 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:46.201901 17647 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:46.239127 17692 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:46.483029 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:46.483515 15642 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.818s (SENT)
I20260709 13:17:46.169162 17650 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.460439 17674 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:46.320948 17640 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.408407 17668 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:46.528033 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:46.488770 17703 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.258s	user 0.000s	sys 0.010s
W20260709 13:17:46.515199 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.501084 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:46.647125 15640 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.908s (SENT) [suppressed 28 similar messages]
I20260709 13:17:46.488329 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.299769 17421 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:17:46.573107 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.527720 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:46.400293 17616 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:46.515551 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.341329 17659 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.521862 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:46.239261 17586 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.166989 17651 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.209216 17671 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:46.465291 17470 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:46.665356 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:46.667145 15671 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.666534 15748 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:46.492412 16309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 532) took 2813 ms (client timeout 1940 ms). Trace:
W20260709 13:17:46.671918 16263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.000s	sys 0.024s
I20260709 13:17:46.667778 15744 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:17:46.734537 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 87430.7us
W20260709 13:17:46.929574 16263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.001s	sys 0.027s
I20260709 13:17:46.527231 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:46.930625 16263 connection.cc:256] RPC call timeout handler was delayed by -1.1206553040001381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 13:17:46.396719 17689 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:46.688160 15672 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:46.931483 15742 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:46.934594 16309 rpcz_store.cc:269] 0709 13:17:43.678705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.678830 (+   125us) service_pool.cc:224] Handling call
0709 13:17:46.492157 (+2813327us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400001754. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:46.492306 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3395735936}
I20260709 13:17:46.489784 15749 raft_consensus.cc:2393] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:46.939592 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:46.940127 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 456602us
I20260709 13:17:46.941366 15744 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
W20260709 13:17:46.942598 15642 connection.cc:256] RPC call timeout handler was delayed by -1.6061687999999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:17:46.943203 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0811712229999557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2645s for a response
W20260709 13:17:46.943567 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0730537489998824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3043s for a response
I20260709 13:17:46.945397 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.946319 15742 raft_consensus.cc:2410] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:17:46.941454 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:46.949172 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:46.950245 15748 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:46.688405 17447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.034s	sys 0.040s
I20260709 13:17:46.953766 15671 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:46.957782 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.945437 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.487813 17657 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:46.958997 15744 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:46.514464 17560 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:46.733994 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:46.985889 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:46.501616 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:46.776865 17687 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.988397 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:47.000016 15742 raft_consensus.cc:2410] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:17:46.513614 17328 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:46.483906 16304 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:46.858819 17673 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:46.724797 17571 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:46.944723 17668 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.944684 17647 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:46.983569 15748 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:46.949631 17488 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:47.004189 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:47.042726 15672 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:17:46.994238 16299 consensus_meta.cc:287] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:17:46.961076 17659 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.994483 17425 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:47.024677 17559 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.024883 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.028775 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.029611 17652 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.990952 17421 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
W20260709 13:17:47.004683 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 46091.1us
I20260709 13:17:46.947528 16295 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:46.993142 17657 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.728765 17692 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:46.962424 17447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.042s	sys 0.098s
I20260709 13:17:47.007225 15747 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 1.
W20260709 13:17:47.113624 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.996105 15669 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:47.171293 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:47.172828 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:47.173549 15669 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:47.174401 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1852) took 1048 ms. Trace:
I20260709 13:17:47.174803 15750 rpcz_store.cc:276] 0709 13:17:46.126420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.126656 (+   236us) service_pool.cc:224] Handling call
0709 13:17:46.511222 (+384566us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:46.511528 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.511852 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.511889 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.512721 (+   832us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.805801 (+293080us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:46.805846 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.805929 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.174124 (+368195us) raft_consensus.cc:1685] finished
0709 13:17:47.174144 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.174338 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16241408,"thread_start_us":292678,"threads_started":1,"wal-append.queue_time_us":659615}
I20260709 13:17:47.175704 17646 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:47.117282 15642 leader_election.cc:336] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.695s (SENT)
I20260709 13:17:47.184921 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:47.186041 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 68790.6us
I20260709 13:17:47.118821 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:47.186651 15642 leader_election.cc:336] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.042s (SENT)
I20260709 13:17:47.126909 17673 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:47.128901 17655 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.130363 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.114657 16305 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:47.134574 17636 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:47.137193 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.048691 16299 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:47.171162 17671 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.181453 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1302) took 1012 ms. Trace:
I20260709 13:17:47.042589 17668 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.115664 17674 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.187101 15642 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:46.713994 17650 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.118175 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:47.186728 15672 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:47.188378 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.188680 15673 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:47.048499 17488 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:47.125788 17559 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.159550 17657 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:47.106570 17659 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.101938 17571 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:47.180395 17691 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 1.184s	user 0.005s	sys 0.006s
I20260709 13:17:47.121194 17652 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.273310 17650 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:47.211925 17655 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.274446 17652 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:47.275157 17652 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.275540 17655 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:47.227476 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:17:47.235107 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 48478us
I20260709 13:17:47.276404 16306 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:47.277828 17710 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.389s	user 0.003s	sys 0.000s
I20260709 13:17:47.201066 17721 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.278642 17721 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:47.201422 16304 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:47.281255 15675 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:47.224929 15747 rpcz_store.cc:276] 0709 13:17:46.169603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.501237 (+331634us) service_pool.cc:224] Handling call
0709 13:17:47.181356 (+680119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.287050 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1760) took 1513 ms. Trace:
I20260709 13:17:47.287593 15677 rpcz_store.cc:276] 0709 13:17:45.774062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.774718 (+   656us) service_pool.cc:224] Handling call
0709 13:17:45.775087 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.010376 (+235289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.010425 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:46.010493 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:46.010542 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.286762 (+1276220us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54003af2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:47.286824 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.286972 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540425984}
I20260709 13:17:47.289485 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:47.291150 15642 leader_election.cc:336] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.125s (SENT)
I20260709 13:17:47.291762 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:47.293447 15642 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 3.043s (SENT)
I20260709 13:17:47.293944 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:47.251471 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.192190 17673 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:47.237875 17616 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:47.258404 17659 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.265153 17680 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.239104 17720 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:47.266726 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:47.271507 17602 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:47.379098 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1853) took 1252 ms. Trace:
W20260709 13:17:47.283766 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.246057 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:47.290246 15677 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:47.285109 17328 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:47.411634 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.016s	sys 0.026s
W20260709 13:17:47.412079 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.016s	sys 0.026s
I20260709 13:17:47.412813 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:47.413861 15677 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:47.306767 17650 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:47.415968 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:47.420336 15751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 1848) took 1295 ms (client timeout 1637 ms). Trace:
I20260709 13:17:47.306113 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1858) took 1178 ms. Trace:
I20260709 13:17:47.275702 17652 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:47.390053 16306 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:47.243515 15673 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:47.379662 15745 rpcz_store.cc:276] 0709 13:17:46.126701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.126978 (+   277us) service_pool.cc:224] Handling call
0709 13:17:46.514432 (+387454us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:46.514710 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.514940 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:46.817874 (+302934us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.378731 (+560857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.378787 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:47.378836 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.378905 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.379036 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":444721,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"spinlock_wait_cycles":11421440,"thread_start_us":624611,"threads_started":2}
I20260709 13:17:47.315625 17647 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:47.421227 15751 rpcz_store.cc:269] 0709 13:17:46.125240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.128911 (+  3671us) service_pool.cc:224] Handling call
0709 13:17:47.415814 (+1286903us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:47.420225 (+  4411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10895104}
I20260709 13:17:47.435673 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1863) took 1284 ms. Trace:
I20260709 13:17:47.436115 15751 rpcz_store.cc:276] 0709 13:17:46.151180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.434745 (+1283565us) service_pool.cc:224] Handling call
0709 13:17:47.435077 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.435278 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.435315 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.435370 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:47.435414 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.435481 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.435609 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.437906 15751 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:47.438534 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1303) took 1245 ms. Trace:
I20260709 13:17:47.438905 15751 rpcz_store.cc:276] 0709 13:17:46.193558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.437158 (+1243600us) service_pool.cc:224] Handling call
0709 13:17:47.437488 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.438280 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.438477 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.439805 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.440719 15601 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:47.244437 17642 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.244853 15749 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:47.411417 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:47.444684 16307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.015s	sys 0.030s
I20260709 13:17:47.445503 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:47.461694 16307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.016s	sys 0.030s
I20260709 13:17:47.462379 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:47.463162 15672 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:47.239161 17470 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:47.254109 17559 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.428356 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.448637 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.450011 15596 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:47.432533 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1862) took 1293 ms. Trace:
I20260709 13:17:47.456380 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:47.415354 17719 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:47.379138 17680 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:47.467654 15716 connection.cc:256] RPC call timeout handler was delayed by -1.3285842640002556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18030000000000002s for a response
I20260709 13:17:47.427599 17616 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:47.472236 17689 consensus_meta.cc:287] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.002s
I20260709 13:17:47.416953 17328 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.415386 17720 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.423894 15742 rpcz_store.cc:276] 0709 13:17:46.128182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.019848 (+891666us) service_pool.cc:224] Handling call
0709 13:17:47.020166 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.020392 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:47.065229 (+ 44837us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.305655 (+240426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.305719 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:47.305781 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.305871 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.306034 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17048,"prepare.queue_time_us":44826,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":103,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":67047,"thread_start_us":202775,"threads_started":1}
I20260709 13:17:47.521106 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.416589 15743 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:47.446902 17425 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.639281 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:47.713541 15595 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:47.713797 15742 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
W20260709 13:17:47.714701 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 423069us
I20260709 13:17:47.694576 15600 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:47.716490 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:47.717679 15601 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:47.473302 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.477270 15597 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.695955 16306 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:17:47.691390 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.701957 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:47.702607 15743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1292) took 1620 ms (client timeout 1872 ms). Trace:
I20260709 13:17:47.703523 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.704327 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.691936 15745 rpcz_store.cc:276] 0709 13:17:46.139312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.431765 (+1292453us) service_pool.cc:224] Handling call
0709 13:17:47.432036 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.432218 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.432243 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.432280 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:47.432309 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.432362 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.432463 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:47.473730 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.725221 15598 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:47.713905 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:47.735335 15595 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:47.451233 17602 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:47.610814 17606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.002s	sys 0.050s
I20260709 13:17:47.746481 16307 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:47.749783 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:47.755483 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.675621 17652 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:47.649238 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.474211 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:47.761667 15714 connection.cc:256] RPC call timeout handler was delayed by -1.8687552230001074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:17:47.768292 15601 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:47.652170 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:47.915319 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.803798 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.483397 16295 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:47.948791 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7850552229999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1628s for a response
W20260709 13:17:47.986059 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6626552230000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:17:47.986645 15714 connection.cc:256] RPC call timeout handler was delayed by -1.4115552230000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
I20260709 13:17:47.796885 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.786422 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.894346 15596 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:47.872686 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.958899 17559 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:47.961081 17723 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 13:17:47.987056 15714 connection.cc:256] RPC call timeout handler was delayed by -1.3341552230001525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:17:47.962996 17450 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.963338 15600 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:47.749321 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:47.943048 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:47.962746 15751 raft_consensus.cc:2955] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:47.963966 17555 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.965324 17720 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:47.966830 17680 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:47.769637 15674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1746) took 2329 ms (client timeout 2783 ms). Trace:
W20260709 13:17:48.077782 15674 rpcz_store.cc:269] 0709 13:17:45.425950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.426107 (+   157us) service_pool.cc:224] Handling call
0709 13:17:47.755226 (+2329119us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54000d7854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:47.755326 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661732096}
W20260709 13:17:47.969241 15567 connection.cc:256] RPC call timeout handler was delayed by -1.4621762069998567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:17:47.796852 17647 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.971501 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:48.081063 15671 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:47.973076 17474 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.712970 17689 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:47.712775 17719 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:47.712450 17616 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:47.874390 17673 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:47.716245 17721 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:47.797951 17488 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:47.976715 17652 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:47.891275 17668 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:47.977757 15673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1592) took 1456 ms (client timeout 1803 ms). Trace:
I20260709 13:17:47.853164 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.980530 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1860) took 1844 ms. Trace:
I20260709 13:17:48.130504 15750 rpcz_store.cc:276] 0709 13:17:46.136323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.176370 (+1040047us) service_pool.cc:224] Handling call
0709 13:17:47.178374 (+  2004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.367238 (+188864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.367288 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.367348 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:47.367400 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.980278 (+612878us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002594d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:47.980329 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.980472 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433625472}
I20260709 13:17:47.980250 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.132192 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:47.982075 15599 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:47.949029 16308 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:48.019219 16306 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
W20260709 13:17:47.962014 17731 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:17:48.066212 15714 connection.cc:256] RPC call timeout handler was delayed by -1.3242552230001365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 13:17:48.134496 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:48.135288 17721 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:48.135756 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:48.136476 17721 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:17:48.136906 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:48.138266 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:48.065588 16310 raft_consensus.cc:2393] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:48.139515 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.139941 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1859) took 2008 ms. Trace:
W20260709 13:17:48.129277 15673 rpcz_store.cc:269] 0709 13:17:46.521455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.521598 (+   143us) service_pool.cc:224] Handling call
0709 13:17:47.977551 (+1455953us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400365454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:47.977692 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594758912}
W20260709 13:17:47.935913 17693 log.cc:927] Time spent T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 2.013s	user 0.007s	sys 0.008s
W20260709 13:17:47.757385 15669 consensus_meta.cc:287] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.004s
W20260709 13:17:48.065477 17724 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:17:47.870172 17725 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.065984 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 545) took 1015 ms. Trace:
I20260709 13:17:47.870383 17571 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:47.949194 17606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.205s	user 0.006s	sys 0.055s
I20260709 13:17:48.142848 17689 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.142968 17721 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:48.171065 17606 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:17:48.171622 17721 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:48.171813 17606 raft_consensus.cc:697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:48.173112 17606 consensus_queue.cc:237] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:47.796774 17650 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:47.749253 15743 rpcz_store.cc:269] 0709 13:17:46.081887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.089628 (+  7741us) service_pool.cc:224] Handling call
0709 13:17:47.266549 (+1176921us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:47.702531 (+435982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4310272}
I20260709 13:17:48.176975 17650 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.066444 17602 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.069665 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:47.990682 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.179698 16307 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:47.741871 17425 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.064536 15597 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:48.076776 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.186653 15600 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:48.084138 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:48.187628 15674 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.089587 15746 raft_consensus.cc:3055] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:48.190519 15746 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:48.052131 15594 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:48.107240 15671 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:48.196759 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.197353 15671 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:48.198105 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.198756 15671 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:48.199738 15671 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:48.080073 17555 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:48.097977 15715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.016s
W20260709 13:17:48.204591 15715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.008s	sys 0.016s
I20260709 13:17:48.141259 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.140295 15748 rpcz_store.cc:276] 0709 13:17:46.131217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.034547 (+903330us) service_pool.cc:224] Handling call
0709 13:17:47.034919 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.035244 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.035274 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.046319 (+ 11045us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.465403 (+419084us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:47.465441 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.465509 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.139743 (+674234us) raft_consensus.cc:1685] finished
0709 13:17:48.139763 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.139888 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91450,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":320612,"threads_started":1,"wal-append.queue_time_us":596496}
I20260709 13:17:48.137662 16306 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:48.139560 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:48.142656 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.239280 15595 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:48.205498 17738 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:48.088130 17647 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.177434 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:48.076563 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.242973 15596 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:48.159633 16310 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:48.161248 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.181581 17616 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.181799 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.161686 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.245515 16310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 542) took 1233 ms. Trace:
I20260709 13:17:48.161928 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.162120 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.166172 17719 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:48.169433 17725 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.169642 16295 rpcz_store.cc:276] 0709 13:17:47.037048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.228083 (+191035us) service_pool.cc:224] Handling call
0709 13:17:48.052614 (+824531us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:48.193398 15677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.017s	sys 0.017s
I20260709 13:17:48.170085 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 538) took 1179 ms. Trace:
I20260709 13:17:48.159348 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.194308 16307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 547) took 1146 ms. Trace:
I20260709 13:17:48.164873 15668 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:17:47.989456 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:48.356806 15601 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:48.218930 15597 raft_consensus.cc:1240] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:48.226559 17425 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:48.227815 17692 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:48.182507 17728 raft_consensus.cc:3055] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:48.230050 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:48.185276 17730 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:48.192636 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.214890 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 540) took 1209 ms. Trace:
I20260709 13:17:48.381882 16306 rpcz_store.cc:276] 0709 13:17:47.005889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.136106 (+1130217us) service_pool.cc:224] Handling call
0709 13:17:48.137206 (+  1100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.206113 (+ 68907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.214833 (+  8720us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.170341 17328 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.158954 15669 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:48.191490 15746 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.237212 15674 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
W20260709 13:17:48.237895 16263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.015s	sys 0.046s
I20260709 13:17:48.138428 17652 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.389726 15746 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.170481 17571 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:17:48.170811 17689 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.245714 15750 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:48.244511 15602 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:48.246012 16310 rpcz_store.cc:276] 0709 13:17:47.012130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.142653 (+1130523us) service_pool.cc:224] Handling call
0709 13:17:48.159228 (+ 16575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.243986 (+ 84758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.245440 (+  1454us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:48.250780 15675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1599) took 1722 ms (client timeout 1743 ms). Trace:
I20260709 13:17:48.263233 17719 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:48.277448 17650 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.282877 15593 raft_consensus.cc:2410] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:48.246405 17602 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:48.258669 16309 rpcz_store.cc:276] 0709 13:17:46.990441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.998872 (+  8431us) service_pool.cc:224] Handling call
0709 13:17:47.006797 (+  7925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.023177 (+ 16380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.023229 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.023841 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.308384 (+284543us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:47.308442 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.308538 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.169793 (+861255us) raft_consensus.cc:1685] finished
0709 13:17:48.169821 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.170009 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15848,"raft.queue_time_us":34475,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":65253,"thread_start_us":284096,"threads_started":1,"wal-append.queue_time_us":673599}
W20260709 13:17:48.258622 15677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.017s	sys 0.018s
I20260709 13:17:48.259068 16307 rpcz_store.cc:276] 0709 13:17:47.048309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.990384 (+942075us) service_pool.cc:224] Handling call
0709 13:17:48.194226 (+203842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.245999 15716 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:48.300450 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1861) took 2162 ms. Trace:
I20260709 13:17:48.252640 15743 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.244249 17738 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:48.349542 17657 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.094s	user 0.007s	sys 0.006s
I20260709 13:17:48.341259 15599 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:48.358870 15748 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:48.409255 16299 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:48.380816 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.386528 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1755) took 2816 ms. Trace:
I20260709 13:17:48.426411 17657 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.426748 15676 rpcz_store.cc:276] 0709 13:17:45.565241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.583558 (+ 18317us) service_pool.cc:224] Handling call
0709 13:17:47.296589 (+1713031us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:47.296811 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.299060 (+  2249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.299090 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.304989 (+  5899us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.761425 (+456436us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:48.354670 (+593245us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.360764 (+  6094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.360865 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.360921 (+    56us) raft_consensus.cc:1685] finished
0709 13:17:48.381392 (+ 20471us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.381593 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21255,"raft.queue_time_us":23455,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":110992,"spinlock_wait_cycles":5249920,"thread_start_us":872894,"threads_started":2,"wal-append.queue_time_us":764441}
W20260709 13:17:48.388998 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 309887us
I20260709 13:17:48.428938 17657 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:48.429759 15567 connection.cc:256] RPC call timeout handler was delayed by -1.2039532930000405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:17:48.430757 17746 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.431309 17746 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:48.389762 16263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.015s	sys 0.046s
I20260709 13:17:48.433496 17746 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:48.433934 15567 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:48.434399 17746 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:48.434818 17746 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:48.434870 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:48.435236 17746 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.435566 15567 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:48.140131 16308 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:48.436909 16308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 541) took 1425 ms. Trace:
I20260709 13:17:48.437255 16308 rpcz_store.cc:276] 0709 13:17:47.011769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.139286 (+1127517us) service_pool.cc:224] Handling call
0709 13:17:48.436838 (+297552us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:48.391541 15749 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.049s
I20260709 13:17:48.417426 17738 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:48.440809 15749 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.010s	sys 0.049s
I20260709 13:17:48.441766 17689 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.441679 17328 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:48.443243 17328 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:48.395932 15675 rpcz_store.cc:269] 0709 13:17:46.528871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.941150 (+412279us) service_pool.cc:224] Handling call
0709 13:17:48.250537 (+1309387us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b5400084dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:48.250700 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763526016}
I20260709 13:17:48.443595 17328 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:48.443987 17328 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.372152 17728 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:48.404109 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 461151us
I20260709 13:17:48.407754 16302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 534) took 1476 ms. Trace:
I20260709 13:17:48.388731 17421 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:48.409904 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.410678 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1602) took 1508 ms. Trace:
I20260709 13:17:48.397084 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 315) took 1436 ms. Trace:
I20260709 13:17:48.418340 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:48.353497 17732 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.124s	user 0.001s	sys 0.007s
I20260709 13:17:48.436363 17474 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:48.410640 17647 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.408298 15747 rpcz_store.cc:276] 0709 13:17:46.138086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.443167 (+1305081us) service_pool.cc:224] Handling call
0709 13:17:47.507476 (+ 64309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.798582 (+291106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.866473 (+ 67891us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:47.871808 (+  5335us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:47.874537 (+  2729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.283754 (+409217us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540026b6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:48.285352 (+  1598us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.299785 (+ 14433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559276800}
I20260709 13:17:48.445889 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:48.437495 15567 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:48.450747 16263 connection.cc:256] RPC call timeout handler was delayed by -1.0300188100000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:17:48.480660 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.481272 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.482029 16307 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
W20260709 13:17:48.453282 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 313758us
I20260709 13:17:48.486778 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:48.472479 15677 rpcz_store.cc:276] 0709 13:17:46.902666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.443364 (+540698us) service_pool.cc:224] Handling call
0709 13:17:47.443753 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.459993 (+ 16240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.460041 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.512451 (+ 52410us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.405759 (+893308us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.405799 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.405870 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.410400 (+  4530us) raft_consensus.cc:1685] finished
0709 13:17:48.410425 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.410604 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9480,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":9910,"thread_start_us":726385,"threads_started":1,"wal-append.queue_time_us":717127}
I20260709 13:17:48.425961 17719 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:48.434898 17657 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:48.476011 15748 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:48.451814 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 539) took 1448 ms. Trace:
I20260709 13:17:48.491590 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.490736 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:48.405226 17739 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:17:48.504415 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.510200 16307 raft_consensus.cc:2410] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:48.517134 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.517983 15677 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:48.480976 17474 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.520934 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.521649 16308 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:48.485455 17559 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:48.523548 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:48.475767 15669 rpcz_store.cc:276] 0709 13:17:46.957679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.172515 (+214836us) service_pool.cc:224] Handling call
0709 13:17:48.394242 (+1221727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:48.503870 17650 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.528272 16263 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:48.529784 15675 raft_consensus.cc:1217] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 13:17:48.532433 15675 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:17:48.506152 17657 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.533995 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.534801 15674 raft_consensus.cc:2393] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:48.533293 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.537238 15676 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:48.523396 17474 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.523104 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:48.545893 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.550539 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.525388 17606 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:48.525113 17659 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:48.531601 17647 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.556859 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:48.557611 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.560745 15675 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
W20260709 13:17:48.561175 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 315214us
I20260709 13:17:48.562171 15716 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:48.540274 17645 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.531345 17425 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:48.559195 17659 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.538622 17657 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.589098 17645 raft_consensus.cc:697] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:48.451699 16302 rpcz_store.cc:276] 0709 13:17:46.931804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.944374 (+ 12570us) service_pool.cc:224] Handling call
0709 13:17:48.069061 (+1124687us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:48.069289 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.069523 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:48.069883 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.398798 (+328915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:48.399835 (+  1037us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.402267 (+  2432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.407529 (+  5262us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.407682 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2069,"prepare.queue_time_us":198,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":7454,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5068,"spinlock_wait_cycles":4985088,"thread_start_us":316882,"threads_started":1,"wal-append.queue_time_us":460795}
I20260709 13:17:48.590160 17645 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.535827 17741 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.445268 17728 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.535591 17488 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:48.592468 17741 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:48.592933 17719 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:48.592881 17488 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.593649 17719 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:48.593500 17741 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.594581 17719 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.595309 17488 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.595963 15676 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:48.535367 17668 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:48.596905 17668 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.598459 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.599119 17668 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.599339 15742 raft_consensus.cc:2410] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:48.539469 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:48.557900 17748 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:48.536473 17559 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:48.600929 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1329) took 1138 ms. Trace:
I20260709 13:17:48.600713 17748 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.601327 17559 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.603089 17748 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.552795 17725 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:48.601329 15596 rpcz_store.cc:276] 0709 13:17:47.462885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.243793 (+780908us) service_pool.cc:224] Handling call
0709 13:17:48.344932 (+101139us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:48.350785 (+  5853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.350822 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:48.353985 (+  3163us) log.cc:844] Serialized 52 byte log entry
0709 13:17:48.512932 (+158947us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:48.512973 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.513045 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.600714 (+ 87669us) raft_consensus.cc:1685] finished
0709 13:17:48.600734 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.600875 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":2238,"thread_start_us":115487,"threads_started":1,"wal-append.queue_time_us":182038}
I20260709 13:17:48.555730 17616 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.536717 17742 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:17:48.576989 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 96790us
I20260709 13:17:48.566612 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.584713 17425 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.600144 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.509392 16299 rpcz_store.cc:276] 0709 13:17:47.003100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.244492 (+241392us) service_pool.cc:224] Handling call
0709 13:17:48.138298 (+893806us) spinlock_profiling.cc:243] Waited 97 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:48.445729 (+307431us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223153920}
I20260709 13:17:48.557626 17606 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:48.559386 17650 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:17:48.647490 17750 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:17:48.651046 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.652148 15745 raft_consensus.cc:2410] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:48.600440 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.622289 16304 raft_consensus.cc:2410] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:48.658231 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.604332 17659 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.660079 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:48.662341 15745 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.669915 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1322) took 1221 ms. Trace:
I20260709 13:17:48.567829 17647 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.675180 15600 rpcz_store.cc:276] 0709 13:17:47.448046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.203131 (+755085us) service_pool.cc:224] Handling call
0709 13:17:48.203498 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.203741 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:48.482851 (+279110us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.669529 (+186678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:48.669588 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.669637 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.669705 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.669849 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":320879,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"thread_start_us":435897,"threads_started":2}
I20260709 13:17:48.654431 17652 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:48.678121 15745 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:48.715682 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:48.654152 15669 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:48.719063 15745 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:48.631412 17616 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.722566 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:48.724960 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:48.726683 15742 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.726693 15745 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:48.720248 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.684847 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.728680 15672 raft_consensus.cc:2376] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:48.732627 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:48.734066 15671 raft_consensus.cc:2376] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:48.733507 17650 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.736001 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.737483 15672 raft_consensus.cc:2376] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:48.738561 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.739244 15672 raft_consensus.cc:2376] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:48.739874 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:48.741650 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.743538 17425 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:48.744302 15640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.319s	user 0.025s	sys 0.055s
I20260709 13:17:48.754329 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.755856 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.773641 15674 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:48.773746 15675 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:48.759443 17657 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.760342 17606 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.763562 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.784351 16308 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:48.716586 17728 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:48.672737 15747 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:48.764000 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:48.771215 16307 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:48.766606 15677 raft_consensus.cc:2376] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:48.791333 15745 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:48.776263 15672 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:17:48.780483 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 161002us
I20260709 13:17:48.785991 16265 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:17:48.773185 15640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.026s	sys 0.056s
I20260709 13:17:48.793676 15742 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:48.797662 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.798862 15567 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:48.803134 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:48.803872 15640 connection.cc:256] RPC call timeout handler was delayed by -1.2382963589998326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
W20260709 13:17:48.804524 15640 connection.cc:256] RPC call timeout handler was delayed by -1.1905963589999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:17:48.810142 17616 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.793397 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:48.841694 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.790766 17741 consensus_queue.cc:1059] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:48.799396 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.805722 17680 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:48.807135 17559 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:48.792904 17738 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.865192 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1325) took 1403 ms. Trace:
W20260709 13:17:48.392382 17736 consensus_queue.cc:1175] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "398beb97ee4b40688f6279f18fa51ade" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 4 index: 6 } }
I20260709 13:17:48.866743 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.867434 15742 raft_consensus.cc:2376] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4. Re-sending same reply.
I20260709 13:17:48.868460 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.868315 17746 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.869119 15742 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:48.870038 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.870586 17746 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:48.871726 17555 consensus_meta.cc:287] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.006s
I20260709 13:17:48.842594 17328 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:48.853165 17680 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.875643 17680 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:48.878986 17647 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:48.846626 17773 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:17:48.875739 17764 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:48.870736 15742 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:48.841506 17768 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.856233 15642 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:48.844801 17657 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:48.846871 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.847795 15669 raft_consensus.cc:2376] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:48.903980 15670 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:48.855799 17559 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.905994 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.907866 15742 raft_consensus.cc:2393] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:48.872313 17555 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:48.911441 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:48.912997 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 69638.6us
I20260709 13:17:48.921260 15742 raft_consensus.cc:2410] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:17:48.926061 17772 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:48.926442 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:48.921697 15567 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:48.928148 17778 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:48.934059 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:48.934574 15746 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:48.934727 15742 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:48.935755 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.904454 17647 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:48.983206 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1298) took 2818 ms. Trace:
I20260709 13:17:48.984550 15746 rpcz_store.cc:276] 0709 13:17:46.117460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.117678 (+   218us) service_pool.cc:224] Handling call
0709 13:17:46.135125 (+ 17447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.089490 (+1954365us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400390920. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe667dc0 00007faefe6f21c0 00007faefe6f3231 00007faefe6efd8f 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c
0709 13:17:48.934329 (+844839us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400390920. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe667dc0 00007faefe6f2d87 00007faefe6f3470 00007faefe6efd8f 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c
0709 13:17:48.934964 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.935159 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769476608}
I20260709 13:17:48.908663 17559 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:48.983805 17681 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:17:48.989317 15598 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:48.983736 17647 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.903836 17767 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.986442 15640 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.908s (SENT)
W20260709 13:17:48.925976 17722 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.017s	user 0.002s	sys 0.003s
I20260709 13:17:48.903915 17650 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:17:48.988045 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:48.991879 15742 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:48.865882 15594 rpcz_store.cc:276] 0709 13:17:47.461617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.234516 (+772899us) service_pool.cc:224] Handling call
0709 13:17:48.255518 (+ 21002us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:48.356359 (+100841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.369652 (+ 13293us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:48.436376 (+ 66724us) log.cc:844] Serialized 52 byte log entry
0709 13:17:48.568523 (+132147us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.571945 (+  3422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.578262 (+  6317us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.847337 (+269075us) raft_consensus.cc:1685] finished
0709 13:17:48.847367 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.865066 (+ 17699us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1632,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":1976,"thread_start_us":120179,"threads_started":1,"wal-append.queue_time_us":268503}
I20260709 13:17:48.902983 17768 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:49.054080 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 1872) took 1046 ms. Trace:
W20260709 13:17:49.118387 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 131979us
W20260709 13:17:49.069952 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.330039 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 369) took 1616 ms. Trace:
I20260709 13:17:49.416946 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.291373 15596 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.412779 15601 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:17:49.329334 17753 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.144s
I20260709 13:17:49.321141 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 372) took 1540 ms. Trace:
I20260709 13:17:49.223754 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.479286 15748 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:49.190033 15500 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 3 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:49.477808 15751 rpcz_store.cc:276] 0709 13:17:47.781247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.962040 (+180793us) service_pool.cc:224] Handling call
0709 13:17:47.962409 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:47.962615 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:48.129908 (+167293us) log.cc:844] Serialized 14 byte log entry
0709 13:17:48.676826 (+546918us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.320416 (+643590us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b18003e7340. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:17:49.320651 (+   235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.320733 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:49.320798 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.320890 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.321057 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36618,"prepare.queue_time_us":116555,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":9401,"raft.queue_time_us":686569,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":6133,"spinlock_wait_cycles":12573952,"thread_start_us":539544,"threads_started":3,"wal-append.queue_time_us":375342}
I20260709 13:17:49.481462 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.429251 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.478204 15742 rpcz_store.cc:276] 0709 13:17:48.007235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.933785 (+926550us) service_pool.cc:224] Handling call
0709 13:17:49.054023 (+120238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:49.289915 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1332) took 1784 ms (client timeout 1908 ms). Trace:
W20260709 13:17:49.491318 15598 rpcz_store.cc:269] 0709 13:17:47.506243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.755487 (+249244us) service_pool.cc:224] Handling call
0709 13:17:49.289684 (+1534197us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54002972d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:49.289844 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2124603136}
I20260709 13:17:49.290740 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.492692 15600 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:46.850145 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.329226 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.324337 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:49.481568 15597 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:49.473141 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:49.495692 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 171431us
I20260709 13:17:49.496872 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:17:49.406467 17659 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.003s
W20260709 13:17:49.195928 15743 consensus_meta.cc:287] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.758s	user 0.009s	sys 0.001s
I20260709 13:17:49.500458 15714 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:49.502710 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.475410 15749 rpcz_store.cc:276] 0709 13:17:47.713671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.714255 (+   584us) service_pool.cc:224] Handling call
0709 13:17:47.756364 (+ 42109us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:48.441266 (+684902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.441297 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:48.441878 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 13:17:48.577719 (+135841us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.779938 (+202219us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.329643 (+549705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.329742 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.329799 (+    57us) raft_consensus.cc:1685] finished
0709 13:17:49.329810 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.329968 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":579587,"prepare.queue_time_us":155665,"raft.queue_time_us":920732,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":56757,"spinlock_wait_cycles":2375936,"thread_start_us":946607,"threads_started":3,"wal-append.queue_time_us":284494}
I20260709 13:17:49.053784 15746 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
W20260709 13:17:49.169703 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 114085us
W20260709 13:17:49.506948 15642 leader_election.cc:336] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.872s (SENT)
I20260709 13:17:49.507609 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:49.509578 15642 leader_election.cc:336] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.127s (SENT)
W20260709 13:17:49.483382 16263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.001s	sys 0.009s
I20260709 13:17:49.194622 15750 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:49.329174 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 573061us
I20260709 13:17:49.463456 17652 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:49.189348 17555 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.342365 17743 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.489228 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.532745 15601 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:49.489686 15748 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:49.533608 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1312) took 1025 ms. Trace:
I20260709 13:17:49.120649 17328 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:49.498741 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.052310 17770 raft_consensus.cc:2764] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:17:49.540977 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.051200 17474 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:49.183228 17783 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:17:49.407142 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:49.481679 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.514659 15593 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.523190 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:49.524307 16265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.003s	sys 0.026s
I20260709 13:17:49.056782 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.536468 17739 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:49.352384 17719 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.168295 17792 raft_consensus.cc:3055] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:49.527750 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:17:49.528843 16263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.002s	sys 0.010s
I20260709 13:17:49.533942 15748 rpcz_store.cc:276] 0709 13:17:48.508398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.481208 (+972810us) service_pool.cc:224] Handling call
0709 13:17:49.533552 (+ 52344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.293545 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 323) took 1370 ms. Trace:
I20260709 13:17:49.537729 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:49.515805 17559 consensus_meta.cc:287] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.002s
I20260709 13:17:49.567086 15670 rpcz_store.cc:276] 0709 13:17:47.923033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.181525 (+258492us) service_pool.cc:224] Handling call
0709 13:17:49.293283 (+1111758us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54003007d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:49.293468 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1513398656}
I20260709 13:17:49.049659 17647 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.501742 17756 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.515044 15743 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:49.553534 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.514581 17616 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:17:49.560436 16265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.004s	sys 0.027s
I20260709 13:17:49.560422 15746 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.561407 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.191473 17680 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.546260 15565 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:49.571533 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.578099 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:49.592839 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1313) took 1084 ms. Trace:
I20260709 13:17:49.328924 17602 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.567519 15749 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:49.544761 17652 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.566425 17792 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:49.547696 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.548338 17738 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:49.515573 17659 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.565349 17739 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:49.577677 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1610) took 1027 ms. Trace:
I20260709 13:17:49.582671 17753 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.593228 15748 rpcz_store.cc:276] 0709 13:17:48.511119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.571264 (+1060145us) service_pool.cc:224] Handling call
0709 13:17:49.592771 (+ 21507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.612803 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.613495 15748 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:49.614100 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1328) took 1098 ms. Trace:
I20260709 13:17:49.614480 15748 rpcz_store.cc:276] 0709 13:17:48.515462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.612500 (+1097038us) service_pool.cc:224] Handling call
0709 13:17:49.614029 (+  1529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.615628 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.051200 17767 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:49.583091 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 55455.3us
W20260709 13:17:49.590591 15743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 1870) took 1580 ms (client timeout 1939 ms). Trace:
I20260709 13:17:49.617822 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:49.582746 17756 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:49.586568 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 789982us
W20260709 13:17:49.591858 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45723.1us
I20260709 13:17:49.571024 15596 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:49.587834 15595 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:49.602394 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1325) took 1087 ms. Trace:
I20260709 13:17:49.625201 15749 rpcz_store.cc:276] 0709 13:17:48.514640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.505330 (+990690us) service_pool.cc:224] Handling call
0709 13:17:49.602328 (+ 96998us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:49.567638 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 669790us
I20260709 13:17:49.628769 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.630410 16263 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:49.558350 17743 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:49.539179 17606 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:49.609972 15676 rpcz_store.cc:276] 0709 13:17:48.549986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.550212 (+   226us) service_pool.cc:224] Handling call
0709 13:17:49.577469 (+1027257us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b54001cfa54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:49.577600 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95068416}
I20260709 13:17:49.593310 15673 raft_consensus.cc:2410] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:49.605129 17650 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.584422 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1322) took 1070 ms. Trace:
I20260709 13:17:49.602799 17770 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.571586 17719 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.619102 15746 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
W20260709 13:17:49.619751 15674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.010s	sys 0.012s
W20260709 13:17:49.655709 15674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.010s	sys 0.012s
W20260709 13:17:49.620049 15567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.005s	sys 0.017s
I20260709 13:17:49.618947 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:49.656520 15567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.005s	sys 0.017s
W20260709 13:17:49.656905 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 735227us
I20260709 13:17:49.657419 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:49.578321 15593 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:49.648176 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1613) took 1083 ms. Trace:
I20260709 13:17:49.643251 17720 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.611467 17739 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.650779 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:49.571973 17559 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:49.671921 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 133826us
I20260709 13:17:49.528843 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1319) took 1015 ms. Trace:
I20260709 13:17:49.673486 15742 rpcz_store.cc:276] 0709 13:17:48.512918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.502370 (+989452us) service_pool.cc:224] Handling call
0709 13:17:49.528772 (+ 26402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.654632 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:49.655539 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 388) took 1431 ms. Trace:
I20260709 13:17:49.657626 15567 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:49.675203 15746 rpcz_store.cc:276] 0709 13:17:48.223941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.505921 (+1281980us) service_pool.cc:224] Handling call
0709 13:17:49.655475 (+149554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.676045 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:49.676895 17794 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.676950 15567 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:49.677424 17794 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.677835 17794 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.679322 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:49.605962 17602 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.680881 17555 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:49.681322 17784 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:49.682572 17421 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.661361 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:49.648450 15565 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:49.660899 15673 rpcz_store.cc:276] 0709 13:17:48.564643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.565245 (+   602us) service_pool.cc:224] Handling call
0709 13:17:49.577929 (+1012684us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:49.648111 (+ 70182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970880}
I20260709 13:17:49.643589 17753 raft_consensus.cc:697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:49.650223 17606 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:49.662788 17720 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.679944 15676 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.664237 17746 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.686445 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:49.688562 15567 connection.cc:256] RPC call timeout handler was delayed by -1.705716738999854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2391s for a response
I20260709 13:17:49.651711 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.650002 15747 rpcz_store.cc:276] 0709 13:17:48.513864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.014201 (+500337us) service_pool.cc:224] Handling call
0709 13:17:49.584346 (+570145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:49.695829 15567 connection.cc:256] RPC call timeout handler was delayed by -1.6903224419997969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 13:17:49.690565 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:49.697151 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 380) took 1475 ms. Trace:
I20260709 13:17:49.697609 15742 rpcz_store.cc:276] 0709 13:17:48.221735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.690331 (+1468596us) service_pool.cc:224] Handling call
0709 13:17:49.697075 (+  6744us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.676231 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.700026 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1327) took 1184 ms. Trace:
I20260709 13:17:49.700495 15746 rpcz_store.cc:276] 0709 13:17:48.515182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.675981 (+1160799us) service_pool.cc:224] Handling call
0709 13:17:49.699949 (+ 23968us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:49.622994 15743 rpcz_store.cc:269] 0709 13:17:48.006623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.177139 (+170516us) service_pool.cc:224] Handling call
0709 13:17:49.587330 (+1410191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.652631 17770 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.664459 17736 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.659471 17798 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:49.660717 17791 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:17:49.686311 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:49.653432 17650 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.727219 17647 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.695547 15749 raft_consensus.cc:2410] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:17:49.703619 17680 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.704805 17652 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:49.705482 17743 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:49.707854 17753 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.711855 17794 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:49.681432 17555 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:49.717017 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:49.718362 17719 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:49.693797 17606 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:49.719673 17768 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.720134 17756 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.721555 17571 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:49.722244 17474 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.726907 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.739835 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:49.841029 15742 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.741164 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:49.817541 17798 raft_consensus.cc:697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:49.688853 17728 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:49.694154 17657 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:49.690153 15565 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:49.853597 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 163528us
I20260709 13:17:49.687271 17795 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:49.683116 17421 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:49.697154 17720 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.859333 17421 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.816797 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1324) took 1302 ms. Trace:
I20260709 13:17:49.860769 15749 rpcz_store.cc:276] 0709 13:17:48.514394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.625919 (+1111525us) service_pool.cc:224] Handling call
0709 13:17:49.816720 (+190801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.696162 17746 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.864157 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:49.862421 15565 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:49.818328 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 121564us
I20260709 13:17:49.738678 17651 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:49.738165 17770 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.737905 17736 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.824534 15676 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
W20260709 13:17:49.831972 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 177407us
I20260709 13:17:49.836884 17647 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:49.838610 17794 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.820652 17784 raft_consensus.cc:697] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:49.748407 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:49.881705 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 133423us
I20260709 13:17:49.882288 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.882452 15642 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:49.848893 15742 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:49.871402 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.883529 15749 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:49.884007 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 379) took 1662 ms. Trace:
I20260709 13:17:49.853108 17657 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.833139 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.866052 17746 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.831678 17571 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.673846 17792 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.878022 17736 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.883096 15746 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:49.884335 15749 rpcz_store.cc:276] 0709 13:17:48.221485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.871101 (+1649616us) service_pool.cc:224] Handling call
0709 13:17:49.883951 (+ 12850us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.841033 15669 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:49.887660 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:49.901732 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 382) took 1679 ms. Trace:
W20260709 13:17:49.891018 15567 connection.cc:256] RPC call timeout handler was delayed by -1.5608167389998471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25520000000000004s for a response
I20260709 13:17:49.902323 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:49.891840 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:49.903833 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.904464 15742 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:49.902094 15746 rpcz_store.cc:276] 0709 13:17:48.222287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.880212 (+1657925us) service_pool.cc:224] Handling call
0709 13:17:49.901670 (+ 21458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.872309 17474 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.886564 17804 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:49.892057 16306 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:17:49.894006 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:49.880560 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.920748 17602 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:49.875703 17795 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:49.934684 17795 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.876418 17659 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:49.878196 17738 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.900504 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 156991us
I20260709 13:17:49.937127 17738 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.929530 17798 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:49.891543 15716 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:49.941310 17559 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.922715 17421 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.942440 17421 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.942873 17421 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.942601 17784 consensus_queue.cc:237] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:49.905277 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:49.946162 15742 raft_consensus.cc:2376] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:49.856330 17721 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:49.907497 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:49.910099 17806 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:49.948662 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:49.910390 17689 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.888334 17768 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:49.893966 17657 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:49.926307 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.898322 16307 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:49.928048 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1871) took 1921 ms. Trace:
I20260709 13:17:49.896799 17794 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.968024 17794 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.897231 17571 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.968321 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1593) took 3446 ms. Trace:
I20260709 13:17:49.968705 17811 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.968870 15668 rpcz_store.cc:276] 0709 13:17:46.521825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.621050 (+ 99225us) service_pool.cc:224] Handling call
0709 13:17:46.687060 (+ 66010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.360335 (+1673275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.968060 (+1607725us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400363154. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:49.968257 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3282012928}
I20260709 13:17:49.969271 17811 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:49.956969 17805 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:49.971491 17805 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.971848 17805 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:49.972116 17811 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:49.899065 17555 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:49.952801 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 61332.9us
I20260709 13:17:49.906201 17474 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.895172 17647 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:17:49.996426 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:49.966279 15746 rpcz_store.cc:276] 0709 13:17:48.006934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.923801 (+1916867us) service_pool.cc:224] Handling call
0709 13:17:49.927711 (+  3910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.927843 (+   132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.927857 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.927884 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:49.927904 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.927935 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.928006 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:49.967000 15749 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:49.967504 17602 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.977228 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:49.968406 17794 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:49.978940 17767 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:49.979485 17813 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.981038 17650 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:49.981326 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:50.065193 17813 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:49.983052 15750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 381) took 1761 ms (client timeout 1513 ms). Trace:
I20260709 13:17:49.983963 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1855) took 3856 ms. Trace:
I20260709 13:17:49.984630 17559 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:49.984627 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:50.066465 15750 rpcz_store.cc:269] 0709 13:17:48.222019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.395022 (+173003us) service_pool.cc:224] Handling call
0709 13:17:49.982867 (+1587845us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54001d1fd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:49.982985 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660982016}
I20260709 13:17:50.067320 16309 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:50.067974 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 592) took 1562 ms. Trace:
I20260709 13:17:50.068025 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.956849 17790 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:49.956972 17689 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.998678 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 67224.2us
I20260709 13:17:50.068632 17813 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.068850 17790 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:50.069351 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:50.068377 16309 rpcz_store.cc:276] 0709 13:17:48.506084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.506578 (+   494us) service_pool.cc:224] Handling call
0709 13:17:49.984465 (+1477887us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:50.067911 (+ 83446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28704640}
I20260709 13:17:50.071163 15565 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:49.966462 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:50.034654 15598 raft_consensus.cc:2410] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:50.003888 16265 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:49.948972 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:50.035655 17602 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:49.955590 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:50.004799 17474 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.043284 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:49.923947 17720 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.042397 17811 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:17:50.100397 15748 raft_consensus.cc:2368] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4.
I20260709 13:17:50.066541 15744 rpcz_store.cc:276] 0709 13:17:46.127236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.219864 (+2092628us) service_pool.cc:224] Handling call
0709 13:17:48.220167 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.533946 (+313779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.533976 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.544622 (+ 10646us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.735282 (+190660us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.735335 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.983584 (+1248249us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540030edd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:49.983631 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.983674 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:49.983687 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.983904 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3220,"raft.queue_time_us":81647,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":303204608,"thread_start_us":329081,"threads_started":2,"wal-append.queue_time_us":231361,"wal-append.run_cpu_time_us":2993,"wal-append.run_wall_time_us":1135901}
I20260709 13:17:50.101401 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:50.102006 15744 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:50.069005 17689 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.038262 17681 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:17:50.102880 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:50.103468 15744 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
W20260709 13:17:49.951176 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 43726.4us
W20260709 13:17:50.072489 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 106104us
I20260709 13:17:50.036418 17647 consensus_queue.cc:1243] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:17:50.073050 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 69259.8us
I20260709 13:17:50.123389 16265 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:50.124293 17808 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.124815 17808 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.125204 17808 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.124668 16265 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:50.078896 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:50.096463 16263 leader_election.cc:336] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.505s (SENT)
I20260709 13:17:50.096882 15746 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:50.126374 16265 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:50.037395 17673 consensus_queue.cc:1059] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:49.961009 17721 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:50.003999 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.112952 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1875) took 2085 ms. Trace:
I20260709 13:17:50.113715 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:50.076020 17559 raft_consensus.cc:2764] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:17:50.073801 17791 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.115880 17421 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.116858 17805 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.118824 17746 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.127264 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:50.127275 15749 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:50.124156 17736 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.128989 17689 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.095788 16299 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.161307 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:50.165884 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.134061 17680 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:50.134938 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:50.137120 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:50.253134 15750 raft_consensus.cc:2393] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:50.069492 17790 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.074175 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.089187 17602 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.128265 17811 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:17:50.130909 16305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.565s	user 0.008s	sys 0.040s
I20260709 13:17:50.166649 16309 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:50.168996 17721 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.169687 17689 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.172101 17746 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:50.136145 17784 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.174489 17421 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.176723 17651 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:50.134011 15744 rpcz_store.cc:276] 0709 13:17:48.027484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.104129 (+2076645us) service_pool.cc:224] Handling call
0709 13:17:50.104399 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.104550 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.104574 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.112615 (+  8041us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:50.112675 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.112739 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.112886 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:50.138827 17673 consensus_queue.cc:1243] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:50.138286 17647 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:50.167238 17659 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.141829 17450 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.133932 17741 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.142436 17606 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.186069 17807 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.280s
W20260709 13:17:50.652498 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 517589us
W20260709 13:17:50.319430 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 206830us
W20260709 13:17:50.533571 16263 leader_election.cc:336] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.883s (SENT)
I20260709 13:17:50.654748 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:50.288353 15750 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:50.657284 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 383) took 2434 ms. Trace:
W20260709 13:17:50.301898 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.657799 15750 rpcz_store.cc:276] 0709 13:17:48.222589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.287753 (+2065164us) service_pool.cc:224] Handling call
0709 13:17:50.288024 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.657018 (+368994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.657219 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:50.659142 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.286334 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:50.662210 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 128693us
I20260709 13:17:50.663070 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:50.663686 15673 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.662372 15599 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:50.665573 15565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.018s	sys 0.011s
I20260709 13:17:50.672952 15750 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:17:50.674989 16263 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.977s (SENT)
I20260709 13:17:50.666326 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 291) took 1234 ms. Trace:
I20260709 13:17:50.676105 15599 rpcz_store.cc:276] 0709 13:17:49.431610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.282610 (+851000us) service_pool.cc:224] Handling call
0709 13:17:50.666266 (+383656us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:50.676364 16263 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.235s (SENT)
W20260709 13:17:50.676965 15565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.019s	sys 0.011s
W20260709 13:17:50.677290 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 606192us
W20260709 13:17:50.549584 17571 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
W20260709 13:17:50.512622 17739 consensus_meta.cc:287] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.002s
W20260709 13:17:50.602705 17794 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.000s
W20260709 13:17:50.652962 16305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.089s	user 0.035s	sys 0.101s
I20260709 13:17:50.675096 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:50.682950 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 390) took 2458 ms. Trace:
W20260709 13:17:50.541610 17657 consensus_meta.cc:287] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.000s
W20260709 13:17:50.422632 17770 consensus_meta.cc:287] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
I20260709 13:17:50.688795 16305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 589) took 3378 ms. Trace:
I20260709 13:17:50.689033 17770 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.690302 15597 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:17:50.635068 17474 consensus_meta.cc:287] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.000s
I20260709 13:17:50.686205 15744 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:50.689254 16305 rpcz_store.cc:276] 0709 13:17:47.310895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.201250 (+890355us) service_pool.cc:224] Handling call
0709 13:17:48.257344 (+ 56094us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:48.387484 (+130140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.388131 (+   647us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:48.484904 (+ 96773us) log.cc:844] Serialized 52 byte log entry
0709 13:17:49.973954 (+1489050us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefb5e60ac 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b
0709 13:17:50.688250 (+714296us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:50.688300 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.688373 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.688412 (+    39us) raft_consensus.cc:1685] finished
0709 13:17:50.688429 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.688707 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25907,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":11239,"spinlock_wait_cycles":6711040,"thread_start_us":2130330,"threads_started":1,"wal-append.queue_time_us":1646111}
I20260709 13:17:50.513200 15743 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:50.688479 15750 rpcz_store.cc:276] 0709 13:17:48.224457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.672374 (+2447917us) service_pool.cc:224] Handling call
0709 13:17:50.672630 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.673440 (+   810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.682858 (+  9418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:50.659802 17450 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.659125 17651 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:50.716099 17651 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:50.688809 17657 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.718663 17657 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.653488 17811 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:50.534716 17720 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:50.572458 17805 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.694703 17571 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.721702 15742 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:50.716341 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.722765 17571 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:50.698896 17474 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.665766 17753 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.699990 15673 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:50.653338 16299 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
W20260709 13:17:50.684307 17645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.005s	sys 0.024s
I20260709 13:17:50.663656 17644 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:50.283192 17650 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:50.699036 17739 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.703925 17555 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:50.705914 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:50.700832 17794 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.664742 17741 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:50.732565 17741 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.732973 17474 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.682437 17559 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:17:50.734529 17559 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:50.711035 17450 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.678789 17421 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:50.713450 17797 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.894s	user 0.009s	sys 0.006s
I20260709 13:17:50.737675 17606 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.737924 17421 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:50.711701 17647 consensus_queue.cc:1059] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:50.740567 17647 raft_consensus.cc:3055] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:50.741032 17647 raft_consensus.cc:740] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:50.741525 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:50.741871 17647 consensus_queue.cc:260] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:50.742550 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 288) took 1311 ms. Trace:
I20260709 13:17:50.721844 17811 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.724366 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1874) took 2697 ms. Trace:
I20260709 13:17:50.749401 15742 rpcz_store.cc:276] 0709 13:17:48.027203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.946822 (+1919619us) service_pool.cc:224] Handling call
0709 13:17:49.947107 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.722145 (+775038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.724141 (+  1996us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540002c454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:50.724312 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780936960}
I20260709 13:17:50.750500 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:50.751113 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:50.751379 16306 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.691396 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 376) took 2547 ms. Trace:
I20260709 13:17:50.733058 17794 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.578661 17808 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.384806 17768 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.743007 15600 rpcz_store.cc:276] 0709 13:17:49.430661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.741237 (+1310576us) service_pool.cc:224] Handling call
0709 13:17:50.742482 (+  1245us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:50.725394 17645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.024s
W20260709 13:17:50.744946 15567 connection.cc:256] RPC call timeout handler was delayed by -1.0193965029998253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
I20260709 13:17:50.758610 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:50.765399 17650 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:50.766999 15751 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:50.771555 15673 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:50.773767 16306 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:50.775270 15673 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:50.729435 17555 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.742352 17651 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.777523 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:50.750181 17774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.631s	user 0.021s	sys 0.034s
I20260709 13:17:50.785006 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:50.786175 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:50.787392 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:50.725366 17753 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:17:50.786166 17774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.730s	user 0.021s	sys 0.034s
I20260709 13:17:50.778307 17647 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.780866 17555 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.781936 17832 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:50.797168 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.799823 17651 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.800174 15670 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:50.800031 17832 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.799176 15671 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.799450 17474 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:50.802402 17474 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:50.803265 17474 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:50.804231 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.804369 17832 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.805708 15673 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:17:50.807032 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:50.807672 15742 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:50.754032 15743 rpcz_store.cc:276] 0709 13:17:48.143932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.260930 (+2116998us) service_pool.cc:224] Handling call
0709 13:17:50.432665 (+171735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.691125 (+258460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.691336 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:50.811594 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.812529 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.813519 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.825731 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1880) took 1141 ms. Trace:
I20260709 13:17:50.826450 15742 rpcz_store.cc:276] 0709 13:17:49.684739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.823988 (+1139249us) service_pool.cc:224] Handling call
0709 13:17:50.824341 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.824544 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.824566 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.825399 (+   833us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:50.825453 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.825529 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.825655 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:50.820904 15670 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 1.
I20260709 13:17:50.774957 17768 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.779028 17650 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:50.833590 17790 consensus_meta.cc:287] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.002s
I20260709 13:17:50.842343 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:50.845685 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.844398 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.851083 15672 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:50.851729 17736 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:50.851887 17753 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:50.854287 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 289) took 1423 ms. Trace:
I20260709 13:17:50.854753 15597 rpcz_store.cc:276] 0709 13:17:49.430959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.981003 (+550044us) service_pool.cc:224] Handling call
0709 13:17:50.854077 (+873074us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400390dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:50.854224 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435062656}
I20260709 13:17:50.839085 17808 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.834195 17832 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:50.857704 17832 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:50.858660 17832 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.839253 17768 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:50.857086 15745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1317) took 2344 ms (client timeout 1872 ms). Trace:
W20260709 13:17:50.864120 15745 rpcz_store.cc:269] 0709 13:17:48.512394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.856562 (+2344168us) service_pool.cc:211] Skipping call since client already timed out
0709 13:17:50.857018 (+   456us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:17:50.865854 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1884) took 1177 ms. Trace:
I20260709 13:17:50.866219 15745 rpcz_store.cc:276] 0709 13:17:49.687960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.865027 (+1177067us) service_pool.cc:224] Handling call
0709 13:17:50.865375 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.865549 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.865573 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.865609 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:50.865638 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.865687 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.865796 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:50.867280 17602 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.868260 15745 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:50.803893 17450 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.869356 17739 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.870713 17450 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.873308 17770 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.873041 15500 catalog_manager.cc:5697] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:50.874401 15743 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:50.875236 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1883) took 1187 ms. Trace:
I20260709 13:17:50.875023 15500 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:50.876780 15745 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:50.877131 15745 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:50.878019 17421 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.877835 15745 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:50.879452 15751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1316) took 2367 ms (client timeout 2152 ms). Trace:
W20260709 13:17:50.879860 15751 rpcz_store.cc:269] 0709 13:17:48.512103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.481453 (+969350us) service_pool.cc:224] Handling call
0709 13:17:50.879245 (+1397792us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400216454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:50.879387 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778461952}
I20260709 13:17:50.880636 15745 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:50.880966 15749 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:50.685319 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet ea2d5bac8fb54783a1f420061d08067f (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
W20260709 13:17:50.882926 15484 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 197627us
W20260709 13:17:50.883962 15484 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:50.885337 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 340) took 1203 ms. Trace:
I20260709 13:17:50.885752 15669 rpcz_store.cc:276] 0709 13:17:49.682662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.682916 (+   254us) service_pool.cc:224] Handling call
0709 13:17:49.683245 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.922348 (+239103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.885082 (+962734us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400002dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:50.885277 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327911296}
W20260709 13:17:50.886556 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.836942 17790 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.889037 17790 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:50.836318 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:50.890743 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 54509us
I20260709 13:17:50.891377 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:50.892375 17795 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:50.875617 15743 rpcz_store.cc:276] 0709 13:17:49.687641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.850695 (+1163054us) service_pool.cc:224] Handling call
0709 13:17:50.874049 (+ 23354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.874959 (+   910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.875177 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:50.892947 17795 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:50.893996 17808 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:50.892994 17742 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:50.895465 17328 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:50.897194 17808 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:50.897560 17808 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:50.897591 17741 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.898207 17742 raft_consensus.cc:697] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:50.898849 17808 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.899217 17742 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.901438 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.902225 16307 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:50.903192 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.847980 15742 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.903921 15675 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:50.904337 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1882) took 1219 ms. Trace:
W20260709 13:17:50.836061 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 49960.9us
I20260709 13:17:50.904711 15742 rpcz_store.cc:276] 0709 13:17:49.685225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.828196 (+1142971us) service_pool.cc:224] Handling call
0709 13:17:50.828564 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.904073 (+ 75509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.904284 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:50.907256 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.907470 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.917477 15675 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:50.893953 17795 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:50.909842 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46324 (request call id 312) took 7616 ms. Trace:
I20260709 13:17:50.911566 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.900072 17808 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:50.912458 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 99136.6us
I20260709 13:17:50.912588 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:50.929915 15670 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:17:50.901489 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.910808 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:50.918229 16308 raft_consensus.cc:2368] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:17:50.917095 15500 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 3, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:50.909121 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.933451 16306 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:50.923692 15672 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:50.934362 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.935072 16306 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:50.937011 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:50.942461 15500 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:50.944810 15500 catalog_manager.cc:5697] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 4, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:50.955688 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1878) took 1271 ms. Trace:
I20260709 13:17:50.963251 15600 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:50.968631 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:50.969550 15595 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:50.906428 17741 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:50.965351 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:50.972570 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:51.053574 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.035409 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:51.047222 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:51.012820 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 227871us
W20260709 13:17:50.974684 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 48715.1us
I20260709 13:17:51.056106 15567 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:51.056006 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.057148 15675 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.057691 15600 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:51.026605 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:51.044209 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.937815 16306 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:17:51.059226 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.022110 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 100351us
I20260709 13:17:51.066690 15670 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:51.067907 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.068773 15670 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.073675 15745 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:17:51.074299 15745 pending_rounds.cc:85] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 5
I20260709 13:17:51.081315 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:51.099436 15745 pending_rounds.cc:107] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:17:51.063535 15642 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:51.099771 15745 raft_consensus.cc:2889] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.100171 15677 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:51.101155 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:51.101990 15677 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:51.104066 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 402) took 1213 ms. Trace:
I20260709 13:17:51.054800 15672 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:51.087898 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.104547 15745 rpcz_store.cc:276] 0709 13:17:49.891025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.873333 (+982308us) service_pool.cc:224] Handling call
0709 13:17:50.876655 (+  3322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.103763 (+227108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.103993 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:51.105629 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.105701 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.107229 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.108271 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:50.977721 15500 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 3 to 5, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.095475 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.098330 15601 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:17:51.098484 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.112407 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.113233 15600 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:50.923424 15497 rpcz_store.cc:276] 0709 13:17:43.248407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.248581 (+   174us) service_pool.cc:224] Handling call
0709 13:17:50.864528 (+7615947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:44.248817 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:44.249653 (+   836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:44.249703 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:17:44.249731 (+    28us) tablet.cc:662] Decoding operations
0709 13:17:44.349654 (+ 99923us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:44.358819 (+  9165us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:44.371562 (+ 12743us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:44.459834 (+ 88272us) tablet.cc:701] Row locks acquired
0709 13:17:44.466029 (+  6195us) write_op.cc:260] PREPARE: finished
0709 13:17:44.466201 (+   172us) write_op.cc:270] Start()
0709 13:17:44.466328 (+   127us) write_op.cc:276] Timestamp: P: 1783603064466150 usec, L: 0
0709 13:17:44.466354 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:17:44.467117 (+   763us) log.cc:844] Serialized 918 byte log entry
0709 13:17:44.656743 (+189626us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefb5e60ac 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b
0709 13:17:46.015909 (+1359166us) op_driver.cc:464] REPLICATION: finished
0709 13:17:46.396662 (+380753us) write_op.cc:301] APPLY: starting
0709 13:17:46.396785 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.396910 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.396935 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.397303 (+   368us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.397476 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:46.397523 (+    47us) write_op.cc:312] APPLY: finished
0709 13:17:46.397716 (+   193us) log.cc:844] Serialized 29 byte log entry
0709 13:17:46.397910 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.398005 (+    95us) write_op.cc:454] Released schema lock
0709 13:17:46.398050 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:46.399223 (+  1173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.399251 (+    28us) write_op.cc:454] Released schema lock
0709 13:17:46.815249 (+415998us) spinlock_profiling.cc:243] Waited 40.7 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ed32a 00007faefe672f14 00007faefe672ec3 00007faefe672e38 00007faefe672df3 00007faefe6720dc 00007faefe69be16 00007faefe683cbb 00007faefe66e39d 00007faefe671d75
Metrics: {"mutex_wait_us":290290,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":365658,"apply.run_cpu_time_us":1834,"apply.run_wall_time_us":15013,"num_ops":2,"prepare.queue_time_us":658921,"prepare.run_cpu_time_us":24668,"prepare.run_wall_time_us":1202274,"raft.queue_time_us":128432,"raft.run_cpu_time_us":14095,"raft.run_wall_time_us":921118,"replication_time_us":1528548,"spinlock_wait_cycles":102660096,"thread_start_us":1513880,"threads_started":4,"wal-append.queue_time_us":740987,"wal-append.run_cpu_time_us":13655,"wal-append.run_wall_time_us":2202664}]]}
I20260709 13:17:51.075871 15669 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:51.115898 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.110589 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.120442 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.122023 15677 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.052253 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.074913 17816 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:51.153169 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.153949 15672 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:17:51.118223 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54779.8us
I20260709 13:17:51.118911 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.024925 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:50.935839 17328 consensus_queue.cc:1059] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.180s
I20260709 13:17:51.125201 17829 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:51.075052 17791 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:17:51.134022 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.127334 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.179697 15601 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:51.130016 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.117722 15500 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 6, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 6 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:51.107051 17741 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:17:51.138381 15670 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
W20260709 13:17:51.125238 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 96873.9us
I20260709 13:17:51.018757 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:51.206863 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.118117 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.146436 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 406) took 1114 ms. Trace:
I20260709 13:17:51.231456 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.155616 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:51.159332 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.159832 15675 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:51.108316 17736 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.130559 15716 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:51.179495 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:51.233780 15595 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:51.234313 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 54902.3us
W20260709 13:17:51.188627 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.235001 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:51.181401 15500 catalog_manager.cc:5697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 3 to 5, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.146696 17602 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:51.238545 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 107829us
I20260709 13:17:51.209201 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.123230 17765 consensus_queue.cc:1059] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:17:51.208371 15600 raft_consensus.cc:2393] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:51.231093 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.133123 17680 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:17:51.154888 15742 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.162277 17784 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:17:51.238547 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 83054.9us
I20260709 13:17:51.238883 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:51.151124 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.178107 17829 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:51.222378 17828 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.207039 17816 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:51.240528 15716 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:17:51.289795 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 174237us
I20260709 13:17:51.296777 15675 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.308866 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:51.313853 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 73397.5us
I20260709 13:17:51.236768 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.308293 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.242419 17794 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:51.317353 17450 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:51.262724 17753 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:51.350519 15672 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:51.261056 17839 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.305328 17829 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:51.232019 17832 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:51.322431 15742 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:51.305540 17555 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.317481 17828 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:51.324487 17650 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:51.324936 17845 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:17:51.325429 17816 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:51.326478 17804 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:51.230736 17659 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:17:51.329402 17811 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.333508 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 393) took 3102 ms. Trace:
I20260709 13:17:51.322958 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:51.206554 17657 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:17:51.336787 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.375347 15744 rpcz_store.cc:276] 0709 13:17:48.231196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.671922 (+2440726us) service_pool.cc:224] Handling call
0709 13:17:50.672220 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.690846 (+ 18626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.333250 (+642404us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54003048d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:51.333436 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31734656}
I20260709 13:17:51.376132 15745 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:51.261078 17736 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.349324 16307 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:17:51.319793 17602 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:51.301311 16305 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:51.358986 17832 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.319291 17798 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:17:51.384688 17798 consensus_queue.cc:1243] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:51.369402 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.385329 15742 raft_consensus.cc:2376] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4. Re-sending same reply.
I20260709 13:17:51.385782 17832 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:51.341656 17450 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.380193 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.380625 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.379329 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:51.353693 17753 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:51.386194 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.401754 15742 raft_consensus.cc:2376] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4. Re-sending same reply.
I20260709 13:17:51.386806 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:51.402626 16306 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.374936 17804 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:51.365955 17720 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:51.401252 17450 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.373714 17741 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:51.405571 17753 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.413239 17804 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.451788 17854 consensus_queue.cc:1059] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:17:51.470557 17850 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:51.475461 17853 raft_consensus.cc:3055] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.476536 17853 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:51.236692 15500 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:51.299263 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 64333.7us
I20260709 13:17:51.350965 15675 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:51.336779 15677 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:51.427978 16306 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:51.565424 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.528544 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:51.232241 15743 rpcz_store.cc:276] 0709 13:17:50.032105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.893178 (+861073us) service_pool.cc:224] Handling call
0709 13:17:50.893505 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.893733 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:50.894306 (+   573us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.074811 (+180505us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.093709 (+ 18898us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:51.106378 (+ 12669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.119783 (+ 13405us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.140931 (+ 21148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":154,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":15003,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16752,"thread_start_us":165891,"threads_started":1,"wal-append.queue_time_us":269756}
I20260709 13:17:51.538913 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.540580 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:51.539657 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.539036 15745 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:51.543274 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.542482 17555 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:51.552503 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.313627 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.553285 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:51.541590 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.554823 16305 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:17:51.349614 15669 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.563374 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.429545 17756 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:17:51.589982 17736 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:51.590910 17736 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:51.585666 15593 raft_consensus.cc:2376] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5. Re-sending same reply.
I20260709 13:17:51.594558 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.596511 15744 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:51.597877 16295 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.598496 15676 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:51.599813 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:51.600217 15677 raft_consensus.cc:2410] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:17:51.601614 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.600272 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.603458 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.603636 15593 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:51.597903 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.604302 15743 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:51.610054 15594 raft_consensus.cc:2376] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4. Re-sending same reply.
I20260709 13:17:51.610581 15742 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:51.589838 17720 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.611436 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:51.612183 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.613190 17602 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:51.617115 15673 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.477687 17853 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.599830 17858 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:51.632918 17858 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:51.633462 17858 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:51.371075 17839 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.618546 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.638695 15600 raft_consensus.cc:2376] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4. Re-sending same reply.
I20260709 13:17:51.639993 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.620131 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:51.625293 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 97177.7us
I20260709 13:17:51.640419 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.641603 15567 leader_election.cc:400] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:17:51.641700 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 375) took 3554 ms. Trace:
I20260709 13:17:51.618547 15675 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:51.641899 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.642249 15749 rpcz_store.cc:276] 0709 13:17:48.097757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.153907 (+2056150us) service_pool.cc:224] Handling call
0709 13:17:50.880800 (+726893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.881340 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.641186 (+759846us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400216450. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:51.641485 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491420032}
I20260709 13:17:51.643567 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.643910 15675 pending_rounds.cc:85] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 1
I20260709 13:17:51.644317 15675 pending_rounds.cc:107] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:51.644871 15675 raft_consensus.cc:2889] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.645396 15676 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:17:51.645663 15748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1323) took 3131 ms (client timeout 2650 ms). Trace:
I20260709 13:17:51.645840 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:51.646116 15748 rpcz_store.cc:269] 0709 13:17:48.514151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.628381 (+1114230us) service_pool.cc:224] Handling call
0709 13:17:51.645170 (+2016789us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540026bbd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:51.645450 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082511744}
I20260709 13:17:51.646600 15676 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:51.641965 15567 leader_election.cc:403] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:51.647202 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.648149 15676 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.649106 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.650264 15594 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:51.644449 15602 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.629127 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.647441 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.650799 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:51.650813 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.592046 17736 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:51.651042 17720 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:51.686136 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.687655 17720 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:51.629405 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.689008 17645 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:51.689289 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:51.690219 15742 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:51.631398 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.633507 17602 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.652443 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.653426 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.654515 16306 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:51.655357 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.659508 16307 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:17:51.642102 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 285860us
W20260709 13:17:51.661350 17862 log.cc:927] Time spent T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:17:51.661475 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:51.663985 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:51.644096 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.670141 15676 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.671559 16304 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:51.684306 15677 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:51.692073 15742 raft_consensus.cc:1240] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:17:51.773422 15673 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:51.773888 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.774782 15742 pending_rounds.cc:85] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 4
I20260709 13:17:51.775305 15742 pending_rounds.cc:107] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:17:51.774855 17753 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.775590 15742 raft_consensus.cc:2889] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.776854 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 600) took 1027 ms. Trace:
I20260709 13:17:51.777421 16304 rpcz_store.cc:276] 0709 13:17:50.749832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.754068 (+  4236us) service_pool.cc:224] Handling call
0709 13:17:51.670348 (+916280us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:51.670773 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.776232 (+105459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.776756 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52121856}
I20260709 13:17:51.778314 15749 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:51.780525 15677 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:51.780956 15744 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:51.685009 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.782068 15676 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:17:51.686616 17808 consensus_meta.cc:287] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.714s	user 0.015s	sys 0.000s
I20260709 13:17:51.782589 15676 pending_rounds.cc:85] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 1
I20260709 13:17:51.782902 15676 pending_rounds.cc:107] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:17:51.641693 15745 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:51.783196 15676 raft_consensus.cc:2889] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:51.689723 17645 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.688007 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.784705 15673 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:17:51.788584 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 140276us
I20260709 13:17:51.690243 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:51.763577 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 467238us
I20260709 13:17:51.789346 16306 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:17:51.792212 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.795029 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 401729us
W20260709 13:17:51.799459 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.799783 15716 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:51.703207 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.803391 16306 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.813396 15602 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:51.814906 16306 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.816042 17450 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:51.819550 17450 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:51.820331 17816 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:17:51.821094 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:51.821990 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:51.822017 17864 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.822057 16308 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:51.823800 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.824530 15600 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:51.825618 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.826591 15594 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:51.827883 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.832667 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:51.831018 17828 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:51.836117 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.837348 15670 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.838047 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.839567 16306 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:51.839756 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.841586 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.843029 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.839813 15671 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:51.846356 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 336) took 2945 ms. Trace:
I20260709 13:17:51.844498 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:51.846812 15674 rpcz_store.cc:276] 0709 13:17:48.900863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.900979 (+   116us) service_pool.cc:224] Handling call
0709 13:17:48.904505 (+  3526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.906763 (+  2258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.906806 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.932832 (+ 26026us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.656149 (+723317us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:49.656217 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.656308 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.712847 (+1056539us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:17:50.780243 (+ 67396us) raft_consensus.cc:1685] finished
0709 13:17:50.780267 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.845927 (+1065660us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b54002ccc50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:51.846152 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1725,"raft.queue_time_us":4087,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":72019,"spinlock_wait_cycles":17628416,"thread_start_us":722921,"threads_started":1,"wal-append.queue_time_us":739710,"wal-append.run_cpu_time_us":18174,"wal-append.run_wall_time_us":2121119}
I20260709 13:17:51.792078 17555 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:51.856416 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.830682 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.868237 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:51.878834 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 57100.4us
W20260709 13:17:51.877574 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45236us
I20260709 13:17:50.956270 15750 rpcz_store.cc:276] 0709 13:17:49.684122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.692663 (+1008541us) service_pool.cc:224] Handling call
0709 13:17:50.692947 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.693132 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:17:50.767493 (+ 74361us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.955231 (+187738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:50.955295 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:50.955353 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.955444 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.955612 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104747,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":141,"thread_start_us":250018,"threads_started":2}
W20260709 13:17:51.859124 17829 consensus_meta.cc:287] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.500s	user 0.004s	sys 0.009s
I20260709 13:17:51.892755 17829 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:51.893682 15642 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.650s (SENT) [suppressed 88 similar messages]
I20260709 13:17:51.895100 17837 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.895221 17829 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:51.895515 17728 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:17:51.890617 15677 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:51.895704 17837 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:51.859093 17328 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:17:51.857473 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 601) took 1090 ms. Trace:
I20260709 13:17:51.897151 17753 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:51.898073 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.881477 15593 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:17:51.898878 17811 consensus_meta.cc:287] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.007s
I20260709 13:17:51.899796 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.897181 16299 rpcz_store.cc:276] 0709 13:17:50.766515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.770251 (+  3736us) service_pool.cc:224] Handling call
0709 13:17:51.856143 (+1085892us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:51.856499 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.856903 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.856931 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.856974 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:51.857015 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.857095 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.857280 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32353152}
I20260709 13:17:51.884255 17828 raft_consensus.cc:2764] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:17:51.884732 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1873) took 3877 ms. Trace:
I20260709 13:17:51.886782 17738 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:51.890116 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.889833 17856 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:51.891063 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:51.891232 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:51.865142 17555 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.874059 15567 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:51.859683 17860 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:51.898605 16307 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:51.877981 15594 raft_consensus.cc:2368] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:51.851830 17645 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:51.907279 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:51.908143 15746 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 5. Ops: []
W20260709 13:17:51.908727 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.910563 17828 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:51.911476 17813 raft_consensus.cc:3055] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:51.913249 17767 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:51.913825 17815 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 1.981s	user 0.015s	sys 0.008s
I20260709 13:17:51.900799 15669 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:51.918417 15673 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.929065 15671 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:51.938305 15602 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:51.905117 15747 rpcz_store.cc:276] 0709 13:17:48.026746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.944927 (+1918181us) service_pool.cc:224] Handling call
0709 13:17:51.880887 (+1935960us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:51.881307 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.884088 (+  2781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.884146 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.884212 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:51.884254 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.884342 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.884498 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4868864}
I20260709 13:17:51.942097 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.898509 17837 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:51.976732 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:51.977362 17858 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:51.945231 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 54172us
I20260709 13:17:51.944825 15716 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:51.937153 17555 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:51.979061 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 342) took 1325 ms. Trace:
I20260709 13:17:51.960495 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:51.979352 17828 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:51.978937 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:51.979959 17828 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.980433 17828 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:51.981102 17753 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:51.981570 17753 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:51.959477 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.947494 17860 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:51.941190 15600 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:51.959574 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:51.976761 17837 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:17:51.978910 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 55130.9us
I20260709 13:17:52.004192 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:51.965226 17813 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:51.978907 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.005106 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.965757 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:51.961854 15670 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:52.005983 15600 raft_consensus.cc:2376] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5. Re-sending same reply.
I20260709 13:17:52.005992 15602 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:52.010694 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:52.012976 17865 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:51.965704 17767 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:52.012964 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 144126us
I20260709 13:17:52.016110 15670 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.014496 17822 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.019945 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.022781 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.023099 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.003206 17753 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:52.026597 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.015659 17811 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:52.032749 17821 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:52.033303 17821 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:17:52.034855 16263 leader_election.cc:336] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.513s (SENT)
I20260709 13:17:52.035605 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:52.019114 17767 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.032994 15598 raft_consensus.cc:2393] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 3: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.019770 17865 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:52.043459 17804 consensus_meta.cc:287] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.506s	user 0.002s	sys 0.011s
I20260709 13:17:52.044024 17804 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.044480 16310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 515) took 2128 ms. Trace:
I20260709 13:17:52.045056 16310 rpcz_store.cc:276] 0709 13:17:49.900362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.901586 (+  1224us) service_pool.cc:224] Handling call
0709 13:17:49.908219 (+  6633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.908467 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.908493 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.909004 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.947862 (+ 38858us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:49.947924 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.947989 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.912809 (+1964820us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:17:52.015121 (+102312us) raft_consensus.cc:1685] finished
0709 13:17:52.015145 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.028384 (+ 13239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46964608,"thread_start_us":38507,"threads_started":1,"wal-append.queue_time_us":23026}
I20260709 13:17:52.046466 17804 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:52.021510 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:52.053092 17813 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.054737 17813 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.042956 17739 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:17:52.058200 16302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 605) took 1272 ms. Trace:
I20260709 13:17:52.058677 16302 rpcz_store.cc:276] 0709 13:17:50.785430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.788401 (+  2971us) service_pool.cc:224] Handling call
0709 13:17:51.654826 (+866425us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:51.655194 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.655696 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:51.905246 (+249550us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.021924 (+116678us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.031459 (+  9535us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.038056 (+  6597us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:52.041488 (+  3432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.057899 (+ 16411us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.058036 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16373,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":12606,"spinlock_wait_cycles":27884416,"thread_start_us":267155,"threads_started":2,"wal-append.queue_time_us":123763}
I20260709 13:17:52.051965 17555 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.064706 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 405) took 1972 ms. Trace:
I20260709 13:17:52.065177 15751 rpcz_store.cc:276] 0709 13:17:50.031803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.882722 (+850919us) service_pool.cc:224] Handling call
0709 13:17:50.900651 (+ 17929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.900911 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:50.901243 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.649861 (+748618us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b18003f48a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe29023a 00007faefe6faa2a
0709 13:17:51.861978 (+212117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.874081 (+ 12103us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:51.957019 (+ 82938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.965285 (+  8266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.004161 (+ 38876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22293,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":647,"raft.queue_time_us":63846,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":17394,"spinlock_wait_cycles":63041024,"thread_start_us":70720,"threads_started":1,"wal-append.queue_time_us":1014840}
I20260709 13:17:52.041639 17865 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:52.067469 17865 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:52.069007 15671 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.070778 17742 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:52.070705 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 53371.3us
I20260709 13:17:52.071749 15671 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:52.072722 17756 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:52.067615 17555 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:52.076244 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:52.087256 17839 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:52.089207 15751 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:52.076797 17860 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.090513 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:52.109622 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.110082 17858 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:52.110687 17847 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:17:52.093390 17794 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:52.111002 17828 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.111541 17794 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:52.113452 17828 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:52.100817 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:52.117023 17868 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
I20260709 13:17:52.115321 17794 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.031801 17811 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:52.118431 15673 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:52.124712 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:52.134722 17811 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:52.172343 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 110399us
I20260709 13:17:52.151837 17794 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.151670 17828 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:52.146021 17792 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.152076 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:17:52.192862 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.197549 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.004390 15668 rpcz_store.cc:276] 0709 13:17:50.653954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.655962 (+  2008us) service_pool.cc:224] Handling call
0709 13:17:50.703515 (+ 47553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.703722 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:51.648797 (+945075us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b18003694c0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefe2984bc 00007faefb5e648b 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb600455 00007faf020e83c7 00007faefe6fa9a7 00007faefe70a0bf
0709 13:17:51.649045 (+   248us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.872206 (+223161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.920330 (+ 48124us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:51.964676 (+ 44346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.978661 (+ 13985us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.978827 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191367,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":54186,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":18255,"spinlock_wait_cycles":254741120,"thread_start_us":368480,"threads_started":2,"wal-append.queue_time_us":315106}
I20260709 13:17:52.196586 16304 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:52.216804 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 175905us
I20260709 13:17:52.222348 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.223127 15595 raft_consensus.cc:2376] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5. Re-sending same reply.
I20260709 13:17:52.223682 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1363) took 1048 ms. Trace:
I20260709 13:17:52.224059 15595 rpcz_store.cc:276] 0709 13:17:51.175517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.216001 (+1040484us) service_pool.cc:224] Handling call
0709 13:17:52.223606 (+  7605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.223150 15673 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.233729 15714 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:52.234890 17756 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.234941 15640 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:52.235936 17804 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:52.236255 15640 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:52.236536 17804 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:52.237620 17804 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.238677 17839 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:52.239229 17839 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:52.240272 17839 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.260058 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.264314 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1341) took 1119 ms. Trace:
I20260709 13:17:52.266728 15595 rpcz_store.cc:276] 0709 13:17:51.155871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.247669 (+1091798us) service_pool.cc:224] Handling call
0709 13:17:52.264239 (+ 16570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.268056 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.269492 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:52.272307 17873 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:17:52.273171 17876 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.069s	user 0.001s	sys 0.001s
I20260709 13:17:52.274271 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:52.274507 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1341) took 1040 ms. Trace:
I20260709 13:17:52.275099 15598 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.275813 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1345) took 1105 ms. Trace:
I20260709 13:17:52.274952 15742 rpcz_store.cc:276] 0709 13:17:51.233633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.773813 (+540180us) service_pool.cc:224] Handling call
0709 13:17:51.774312 (+   499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:51.907097 (+132785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.907122 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:51.908055 (+   933us) log.cc:844] Serialized 52 byte log entry
0709 13:17:52.000104 (+ 92049us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:52.146046 (+145942us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.148265 (+  2219us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.150187 (+  1922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.150278 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.274290 (+124012us) raft_consensus.cc:1685] finished
0709 13:17:52.274306 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.274454 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21829,"prepare.queue_time_us":261293,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":4979,"raft.queue_time_us":31702,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"spinlock_wait_cycles":9253376,"thread_start_us":197763,"threads_started":2,"wal-append.queue_time_us":238643}
I20260709 13:17:52.276081 17767 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.263106 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:52.279006 17767 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:52.266291 17816 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.276335 15598 rpcz_store.cc:276] 0709 13:17:51.170210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.273929 (+1103719us) service_pool.cc:224] Handling call
0709 13:17:52.275752 (+  1823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.284255 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.285404 15598 raft_consensus.cc:2368] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4.
I20260709 13:17:52.286005 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1333) took 1176 ms. Trace:
I20260709 13:17:52.286353 15598 rpcz_store.cc:276] 0709 13:17:51.109810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.282601 (+1172791us) service_pool.cc:224] Handling call
0709 13:17:52.285941 (+  3340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.287329 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.288179 15598 raft_consensus.cc:2410] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:52.288403 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.280019 17816 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.289045 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:52.289129 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.289649 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.289939 15598 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:52.290014 17828 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:17:52.290401 15601 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.290530 17828 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:52.290786 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:52.291049 17828 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:52.290977 17816 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:52.293306 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 565) took 1385 ms. Trace:
I20260709 13:17:52.293731 16295 rpcz_store.cc:276] 0709 13:17:50.907923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.911448 (+  3525us) service_pool.cc:224] Handling call
0709 13:17:51.036311 (+124863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.598468 (+562157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.292945 (+694477us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b5400077954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:52.293182 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1252382976}
I20260709 13:17:52.295217 17798 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:52.295614 17798 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:52.295462 17865 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.287724 17753 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.296783 17798 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.297923 17798 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.299229 17753 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:52.299908 17753 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:52.300658 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.301432 15598 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.299639 17828 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:52.301849 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1334) took 1191 ms. Trace:
I20260709 13:17:52.303097 15598 rpcz_store.cc:276] 0709 13:17:51.110061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.300262 (+1190201us) service_pool.cc:224] Handling call
0709 13:17:52.301792 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.304091 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.305289 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:52.306226 15599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1571) took 1340 ms (client timeout 1651 ms). Trace:
W20260709 13:17:52.306596 15599 rpcz_store.cc:269] 0709 13:17:50.966044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.966286 (+   242us) service_pool.cc:224] Handling call
0709 13:17:52.304978 (+1338692us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:52.306121 (+  1143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25121024}
I20260709 13:17:52.307798 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.308519 15565 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:52.309422 17555 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:52.313684 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:52.314098 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:52.314901 15672 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:52.315330 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1631) took 1128 ms. Trace:
I20260709 13:17:52.315645 15672 rpcz_store.cc:276] 0709 13:17:51.186512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.540423 (+353911us) service_pool.cc:224] Handling call
0709 13:17:52.313848 (+773425us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:52.315269 (+  1421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14123392}
I20260709 13:17:52.314731 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:52.312819 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:52.304867 15598 raft_consensus.cc:2393] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.290843 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1361) took 1115 ms. Trace:
I20260709 13:17:52.321170 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:52.292358 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:52.323451 16310 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:52.324077 15599 raft_consensus.cc:2393] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.319347 15601 rpcz_store.cc:276] 0709 13:17:51.174946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.289373 (+1114427us) service_pool.cc:224] Handling call
0709 13:17:52.290789 (+  1416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.325520 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1338) took 1214 ms. Trace:
W20260709 13:17:52.325265 16263 leader_election.cc:336] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.788s (SENT)
I20260709 13:17:52.326244 15598 rpcz_store.cc:276] 0709 13:17:51.111005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.303761 (+1192756us) service_pool.cc:224] Handling call
0709 13:17:52.325466 (+ 21705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.326468 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:52.327011 15742 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:52.327435 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.327915 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1348) took 1156 ms. Trace:
I20260709 13:17:52.328301 15599 rpcz_store.cc:276] 0709 13:17:51.171096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.307483 (+1136387us) service_pool.cc:224] Handling call
0709 13:17:52.327852 (+ 20369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.332219 15598 raft_consensus.cc:2410] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:52.321583 17767 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:52.333076 17767 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.335496 17767 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:52.338189 15743 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.333231 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:52.339475 15601 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.339668 17770 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:52.340016 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1350) took 1168 ms. Trace:
W20260709 13:17:52.340715 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.341501 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:52.340508 15601 rpcz_store.cc:276] 0709 13:17:51.171684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.329800 (+1158116us) service_pool.cc:224] Handling call
0709 13:17:52.339934 (+ 10134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.344372 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:52.345504 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 53274.8us
I20260709 13:17:52.346838 17788 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:52.346772 17813 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:52.347537 17788 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:52.347684 17813 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:52.348292 17813 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.348686 17788 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.350178 17788 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:52.352756 15599 raft_consensus.cc:2376] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:17:52.353821 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:52.355532 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1344) took 1185 ms. Trace:
I20260709 13:17:52.355875 15595 rpcz_store.cc:276] 0709 13:17:51.169839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.282827 (+1112988us) service_pool.cc:224] Handling call
0709 13:17:52.355480 (+ 72653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.357831 15599 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.360013 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.363600 15601 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.362674 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.342392 17853 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:52.365367 15595 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.364332 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.366888 15598 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.367398 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1601) took 1258 ms. Trace:
I20260709 13:17:52.367748 15598 rpcz_store.cc:276] 0709 13:17:51.109316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.344557 (+1235241us) service_pool.cc:224] Handling call
0709 13:17:52.367326 (+ 22769us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:52.368088 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 55332.6us
I20260709 13:17:52.369556 15599 raft_consensus.cc:1240] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:17:52.377044 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1582) took 1274 ms. Trace:
W20260709 13:17:52.378638 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.377558 15599 rpcz_store.cc:276] 0709 13:17:51.097957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.361344 (+1263387us) service_pool.cc:224] Handling call
0709 13:17:52.368094 (+  6750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.370601 (+  2507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.372780 (+  2179us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:52.377147 15642 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.622s (SENT)
I20260709 13:17:52.382252 15598 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:52.382795 15601 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:52.383133 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1602) took 1273 ms. Trace:
I20260709 13:17:52.383482 15598 rpcz_store.cc:276] 0709 13:17:51.109556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.368301 (+1258745us) service_pool.cc:224] Handling call
0709 13:17:52.381002 (+ 12701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.382915 (+  1913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.383058 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:52.386150 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 373) took 4345 ms. Trace:
I20260709 13:17:52.386603 15746 rpcz_store.cc:276] 0709 13:17:48.040712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.126858 (+2086146us) service_pool.cc:224] Handling call
0709 13:17:50.131554 (+  4696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.987193 (+1855639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.385871 (+398678us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540002bf54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:52.386076 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4069639424}
I20260709 13:17:52.390151 17791 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.392400 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.393479 15600 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.393925 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1360) took 1219 ms. Trace:
I20260709 13:17:52.394264 15600 rpcz_store.cc:276] 0709 13:17:51.174648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.023197 (+848549us) service_pool.cc:224] Handling call
0709 13:17:52.392210 (+369013us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:52.393852 (+  1642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25769344}
I20260709 13:17:52.395666 15600 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:52.396423 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:52.397078 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.397838 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1366) took 1221 ms. Trace:
I20260709 13:17:52.398141 15602 rpcz_store.cc:276] 0709 13:17:51.176412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.038129 (+861717us) service_pool.cc:224] Handling call
0709 13:17:52.396953 (+358824us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:52.397776 (+   823us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99504000}
I20260709 13:17:52.399049 15743 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:17:52.400628 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.401476 15596 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.401837 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1359) took 1227 ms. Trace:
I20260709 13:17:52.402122 15596 rpcz_store.cc:276] 0709 13:17:51.174370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.021442 (+847072us) service_pool.cc:224] Handling call
0709 13:17:52.400462 (+379020us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:52.401790 (+  1328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123941760}
I20260709 13:17:52.403156 17741 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:52.407064 17821 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.408232 17821 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:52.418339 17828 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:52.428689 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1584) took 1314 ms. Trace:
I20260709 13:17:52.429265 15601 rpcz_store.cc:276] 0709 13:17:51.101075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.364233 (+1263158us) service_pool.cc:224] Handling call
0709 13:17:52.381957 (+ 17724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.415209 (+ 33252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.415400 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:52.431243 15642 leader_election.cc:336] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.675s (SENT)
I20260709 13:17:52.433879 15742 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:52.434818 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.459903 15595 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:52.460942 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:17:52.466228 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.468935 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 149968us
I20260709 13:17:52.475358 15745 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:52.474278 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.452486 17753 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:52.477337 17889 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:17:52.460494 17866 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.392s	user 0.004s	sys 0.000s
I20260709 13:17:52.473588 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1365) took 1290 ms. Trace:
I20260709 13:17:52.494688 15595 rpcz_store.cc:276] 0709 13:17:51.176115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.374574 (+1198459us) service_pool.cc:224] Handling call
0709 13:17:52.442822 (+ 68248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.460368 (+ 17546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.466631 (+  6263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:52.496958 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 122932us
W20260709 13:17:52.500370 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:52.514277 16263 leader_election.cc:336] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.839s (SENT)
W20260709 13:17:52.515846 16263 leader_election.cc:336] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.890s (SENT)
I20260709 13:17:52.514309 17756 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.518268 17756 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:52.519256 17756 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.521271 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:52.522181 15593 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:52.522598 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1339) took 1411 ms. Trace:
I20260709 13:17:52.522917 15593 rpcz_store.cc:276] 0709 13:17:51.111249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.052765 (+941516us) service_pool.cc:224] Handling call
0709 13:17:52.521076 (+468311us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:52.522541 (+  1465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142933760}
I20260709 13:17:52.524076 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:52.524669 15674 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.524694 17651 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.525156 17813 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.525503 17651 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:52.527014 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 95833.5us
I20260709 13:17:52.499948 17865 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:52.544342 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:52.547610 15642 leader_election.cc:336] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.692s (SENT)
I20260709 13:17:52.477388 17753 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.540272 15747 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:52.566895 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:52.569190 15745 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:52.570016 15640 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.622s (SENT)
I20260709 13:17:52.570672 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:52.575402 15676 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:52.576937 15672 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.560200 15594 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
W20260709 13:17:52.585582 16263 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.167s (SENT)
I20260709 13:17:52.586257 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:52.568133 16305 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:52.613243 15742 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:52.580526 17804 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.617720 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:52.618469 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 48517.3us
I20260709 13:17:52.630375 17559 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:52.630986 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.636468 15746 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:52.612586 17888 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 13:17:52.656924 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:52.661917 15642 leader_election.cc:336] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.711s (SENT)
W20260709 13:17:52.667289 15640 leader_election.cc:336] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.650s (SENT)
I20260709 13:17:52.567921 17811 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.670142 17559 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.671226 15745 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:52.723403 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:52.736795 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 193418us
W20260709 13:17:52.739068 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 297852us
I20260709 13:17:52.740828 15672 raft_consensus.cc:2410] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:52.649909 17813 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:52.751282 15746 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:52.738909 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1783) took 1689 ms. Trace:
W20260709 13:17:52.758638 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 91408.3us
W20260709 13:17:52.760372 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.735652 16304 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:52.773988 15746 raft_consensus.cc:1240] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:52.779707 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1367) took 1597 ms. Trace:
I20260709 13:17:52.753448 15675 rpcz_store.cc:276] 0709 13:17:51.049467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.642888 (+593421us) service_pool.cc:224] Handling call
0709 13:17:51.643472 (+   584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:51.645694 (+  2222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:51.645741 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:51.646241 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:17:51.752801 (+106560us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:51.764513 (+ 11712us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.783655 (+ 19142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.783723 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.420122 (+636399us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:17:52.733476 (+313354us) raft_consensus.cc:1685] finished
0709 13:17:52.738679 (+  5203us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.738847 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10831,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":248,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":225,"spinlock_wait_cycles":48267008,"thread_start_us":106035,"threads_started":1,"wal-append.queue_time_us":356708}
W20260709 13:17:52.783883 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 141253us
I20260709 13:17:52.764138 15743 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:17:52.789529 17767 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.790133 17767 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.790557 17753 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:52.791887 15714 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:52.792733 17768 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:52.792658 17813 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:52.793794 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.792454 15747 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:52.792459 17753 consensus_queue.cc:1059] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:17:52.795684 17753 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:52.796075 17753 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:52.792431 17767 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:52.804191 15746 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:17:52.807648 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 46071.1us
I20260709 13:17:52.809362 17736 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:52.798369 17753 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.810096 17736 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.811095 17753 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.811471 17736 raft_consensus.cc:697] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:52.813925 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:52.814996 17559 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:52.815495 15642 leader_election.cc:336] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.902s (SENT)
W20260709 13:17:52.816538 15642 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.908s (SENT)
I20260709 13:17:52.816917 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:52.812721 17736 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:52.821925 17874 log.cc:927] Time spent T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.778s	user 0.000s	sys 0.003s
W20260709 13:17:52.825443 15597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1578) took 1753 ms (client timeout 1974 ms). Trace:
I20260709 13:17:52.825723 17767 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:52.825932 15597 rpcz_store.cc:269] 0709 13:17:51.072179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.072346 (+   167us) service_pool.cc:224] Handling call
0709 13:17:52.825145 (+1752799us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54002972d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:52.825283 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102254848}
I20260709 13:17:52.827701 16306 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
W20260709 13:17:52.829849 17893 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:17:52.831555 15594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1351) took 1659 ms (client timeout 2162 ms). Trace:
W20260709 13:17:52.832060 15594 rpcz_store.cc:269] 0709 13:17:51.171972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.003405 (+831433us) service_pool.cc:224] Handling call
0709 13:17:52.831355 (+827950us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400201554. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:52.831487 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522203008}
I20260709 13:17:52.832430 17811 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:52.837894 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 269801us
W20260709 13:17:52.838052 17867 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.801s	user 0.004s	sys 0.000s
I20260709 13:17:52.838465 17770 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:52.839852 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.837711 17822 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:17:52.842356 15745 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:17:52.843147 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:52.854625 15716 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:52.864485 15674 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:17:52.867074 15742 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:52.852142 17853 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.875252 17871 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:52.875614 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.870077 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:52.881114 15565 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:52.872474 15642 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.948s (SENT)
I20260709 13:17:52.861315 17753 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:17:52.900146 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62878.6us
I20260709 13:17:52.903879 16307 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:17:52.892896 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:52.905400 16302 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:52.905212 15743 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:52.886881 17853 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:52.908916 17474 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:52.909673 17474 raft_consensus.cc:697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:52.910374 17853 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:52.901108 17753 raft_consensus.cc:697] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:52.932052 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.933861 16305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 529) took 1574 ms. Trace:
I20260709 13:17:52.940713 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:52.934383 16305 rpcz_store.cc:276] 0709 13:17:51.359717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.609947 (+250230us) service_pool.cc:224] Handling call
0709 13:17:51.610477 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.615239 (+1004762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.933564 (+318325us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54005cf3d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:52.933785 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120026368}
I20260709 13:17:52.910967 17474 consensus_queue.cc:237] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:52.918625 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:17:52.955430 15640 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.948s (SENT)
I20260709 13:17:52.955919 15640 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:52.958930 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:52.991199 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:52.963425 17651 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:52.993808 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 44803.8us
I20260709 13:17:52.995074 15674 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:52.998900 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:52.999620 17794 consensus_queue.cc:1059] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:53.006928 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:53.007216 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:53.007628 16308 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.008018 16305 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:53.008154 16302 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:53.009312 16305 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:53.009567 16302 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:53.011780 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:53.013541 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.014402 17856 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:53.014883 17856 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:53.015302 17856 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:52.992542 17753 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.017172 17770 raft_consensus.cc:3055] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:53.017676 17770 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:52.950019 17816 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:52.957433 17837 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:53.018679 17770 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.019421 17837 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:53.020079 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:53.001488 17822 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:17:53.021209 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 71227.8us
I20260709 13:17:53.021572 16304 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:17:53.018649 17816 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.022070 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:53.022459 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:53.021551 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:53.022809 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 67414.2us
I20260709 13:17:53.025357 17821 raft_consensus.cc:3055] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:53.025812 17821 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.026736 17821 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.027987 17821 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.022235 17816 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.030124 17839 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:53.036018 17839 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.036458 17839 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.039184 17816 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.031821 17837 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:53.032401 17822 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:53.061822 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.089249 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:53.096539 15640 leader_election.cc:336] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.142s (SENT)
W20260709 13:17:53.101939 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 142661us
I20260709 13:17:53.087522 17816 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.002224 17908 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:17:53.110325 17914 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:53.111035 17914 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.112246 17914 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:53.152101 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 126449us
I20260709 13:17:53.166996 16308 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:17:53.173084 16307 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:53.109066 17907 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:17:53.193954 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 151970us
I20260709 13:17:53.196945 15565 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:17:53.196954 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52483.3us
I20260709 13:17:53.203667 17770 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.207124 17839 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:53.212203 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.214924 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.216720 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 110630us
I20260709 13:17:53.224061 15567 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:53.226279 17903 log.cc:927] Time spent T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.347s	user 0.000s	sys 0.013s
W20260709 13:17:53.232750 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.218395 17794 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:53.234556 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:53.234050 15670 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:53.235589 16263 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:53.236948 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:53.237593 15674 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
W20260709 13:17:53.236224 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 70183.9us
I20260709 13:17:53.239701 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:53.239862 17651 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:53.240120 15672 raft_consensus.cc:1240] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:17:53.240193 17917 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.242645 17794 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:53.242822 15675 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:17:53.216037 17916 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:17:53.244011 17916 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.243084 17794 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:53.261113 15640 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.253s (SENT)
I20260709 13:17:53.261840 15640 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:53.250227 17916 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.270071 17680 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:17:53.270239 17916 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.267436 17794 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.271631 17916 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.272079 17822 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.272586 17822 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.273197 15672 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:53.274739 17822 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:53.274869 15640 leader_election.cc:336] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.313s (SENT)
I20260709 13:17:53.233634 17907 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:17:53.275341 15640 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:53.276175 17907 raft_consensus.cc:3055] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:17:53.276548 17907 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.277839 17767 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.277504 17907 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:53.278759 17856 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.279349 17907 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:53.278211 17804 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.249547 17917 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.281849 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:53.281693 17917 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.283044 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:53.286371 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 89502.8us
W20260709 13:17:53.288807 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 64840.1us
I20260709 13:17:53.289875 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:53.220757 17914 consensus_queue.cc:1059] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:17:53.304899 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.306262 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:53.321025 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:52.780618 15598 rpcz_store.cc:276] 0709 13:17:51.176757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.432292 (+1255535us) service_pool.cc:224] Handling call
0709 13:17:52.472108 (+ 39816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.483744 (+ 11636us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:52.528255 (+ 44511us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.763175 (+234920us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.773349 (+ 10174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.773429 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:52.773488 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.773555 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.773706 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44216,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":4067,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5558,"spinlock_wait_cycles":5660416,"thread_start_us":199975,"threads_started":1}
I20260709 13:17:53.334988 15744 raft_consensus.cc:2410] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:17:53.355302 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.240811 17921 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:17:53.363948 15677 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:53.360070 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:53.338617 16263 connection.cc:256] RPC call timeout handler was delayed by -1.0444430069999271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17020000000000002s for a response
I20260709 13:17:53.374768 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:53.378062 15672 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:53.380570 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 609) took 1486 ms. Trace:
I20260709 13:17:53.381448 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:53.381192 16306 rpcz_store.cc:276] 0709 13:17:51.889099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.890718 (+  1619us) service_pool.cc:224] Handling call
0709 13:17:53.375413 (+1484695us) spinlock_profiling.cc:243] Waited 891 ms on lock 0x7b5400597754. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:17:53.375523 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048493824}
I20260709 13:17:53.388726 15676 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
W20260709 13:17:53.402701 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.405179 15640 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.075s (SENT)
I20260709 13:17:53.408455 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:53.409262 16306 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:53.363469 17908 consensus_queue.cc:1243] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:53.418378 15714 connection.cc:256] RPC call timeout handler was delayed by -1.5936617200002274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:17:53.388427 17917 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:17:53.422547 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.423009 15714 connection.cc:256] RPC call timeout handler was delayed by -1.4953154760000871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.311s for a response
W20260709 13:17:53.423331 15714 connection.cc:256] RPC call timeout handler was delayed by -1.4063822630000686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 13:17:53.423681 15714 connection.cc:256] RPC call timeout handler was delayed by -1.3920617200001288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:17:53.424050 15714 connection.cc:256] RPC call timeout handler was delayed by -1.1445617200001834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21589999999999998s for a response
I20260709 13:17:53.389770 17921 consensus_queue.cc:1243] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:53.428891 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.430619 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.434965 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:53.421440 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 88359.9us
I20260709 13:17:53.418375 17839 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:53.439334 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.450312 15673 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:17:53.452711 16306 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:17:53.453938 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.454944 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.455757 15742 raft_consensus.cc:2393] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:53.436334 17860 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.453919 15565 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:17:53.461136 15640 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.116s (SENT)
W20260709 13:17:53.463755 15640 leader_election.cc:336] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.134s (SENT)
I20260709 13:17:53.464253 15640 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:53.466717 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.469892 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.472100 15748 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:53.444586 16299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:17:53.473075 17930 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.473501 16299 raft_consensus.cc:606] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.473728 17930 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.475883 17930 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:53.481549 17926 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:53.442492 17736 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:53.482018 17559 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.482606 17559 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:17:53.490643 17929 log.cc:927] Time spent T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:17:53.495317 17925 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:53.495914 17925 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.497179 17925 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.498749 17925 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.440196 17813 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:17:53.538354 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.538630 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:53.514173 17898 log.cc:927] Time spent T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:53.548184 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.545096 15746 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:53.544514 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:53.509297 17908 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.508973 17856 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:53.555133 15642 leader_election.cc:336] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.554s (SENT)
I20260709 13:17:53.558566 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:53.562335 15642 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:53.565490 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.566143 15746 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:53.569237 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:53.569869 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:53.571527 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 107784us
I20260709 13:17:53.572129 15675 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:53.573964 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:53.574774 15744 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:53.575903 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.547132 17924 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:53.547358 17804 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:53.578308 15640 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.202s (SENT)
I20260709 13:17:53.578629 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.505676 17860 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:53.583092 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 123112us
I20260709 13:17:53.579375 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.550319 17474 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:53.579628 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 135203us
I20260709 13:17:53.557714 17908 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.606630 17822 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.607144 17753 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:53.607494 17908 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.608878 17908 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.609154 17474 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:53.578775 17937 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.612715 17924 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.614251 17856 consensus_queue.cc:1059] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:17:53.619297 15640 leader_election.cc:336] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.664s (SENT)
I20260709 13:17:53.621234 15748 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:53.594779 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.580941 17933 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.625699 15745 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:53.615312 15751 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:53.561278 17798 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.483757 17559 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:53.626292 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 117304us
I20260709 13:17:53.629967 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:53.600410 17839 raft_consensus.cc:2764] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:17:53.635298 15751 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:53.630309 17933 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.646287 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.650080 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:17:53.634835 17927 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:17:53.634486 17741 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.656504 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.661747 16263 leader_election.cc:336] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.702s (SENT)
W20260709 13:17:53.662410 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 67739us
I20260709 13:17:53.651840 17559 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.671761 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:53.632349 17798 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:53.674608 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 76421.4us
I20260709 13:17:53.666200 17813 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.668689 17816 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:53.697919 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 91342.5us
I20260709 13:17:53.683007 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.699218 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.697844 17736 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:53.702296 16263 leader_election.cc:336] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.076s (SENT)
I20260709 13:17:53.711027 16263 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:53.718451 17934 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:17:53.718335 15565 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.720366 16307 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:53.682878 17924 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:53.729089 17933 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:53.729837 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:53.721442 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.667580 17741 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:53.741662 17936 log.cc:927] Time spent T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:17:53.747709 17860 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:53.748764 17916 consensus_queue.cc:1059] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:53.750013 17939 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:53.703068 17813 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.753453 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:53.731467 17914 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:53.730185 17770 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.754882 17813 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:53.709609 17794 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.772727 17921 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:53.779277 17921 raft_consensus.cc:697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.780460 17914 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.781453 17914 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:53.781831 17914 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.782452 17925 raft_consensus.cc:3055] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.782981 17770 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:53.772583 17871 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.779421 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:53.784821 17907 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:53.785355 17907 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.786024 17921 consensus_queue.cc:237] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.786305 17907 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.715565 17736 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.782931 17925 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:53.783712 17770 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.789476 17925 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.790445 17736 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:53.790632 17770 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:53.784837 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.793394 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.795738 17917 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.796394 17917 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:53.796738 17917 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.796941 17794 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:53.797076 17917 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.797118 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.800316 15745 raft_consensus.cc:2410] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:17:53.793572 17798 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:53.774804 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 56571.7us
I20260709 13:17:53.802723 15567 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:53.782635 17914 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.861315 17816 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:53.861577 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.861874 17816 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.862320 17816 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:53.862366 15750 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:53.804255 15565 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:53.863776 17914 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:53.864338 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:53.866036 16307 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:53.866959 17741 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:53.861439 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:53.869617 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.896414 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.868500 16295 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
W20260709 13:17:53.902117 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 185207us
W20260709 13:17:53.902786 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 98640.1us
I20260709 13:17:53.903213 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:53.903633 17933 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:53.904222 17933 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:17:53.904759 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 100577us
I20260709 13:17:53.905400 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:53.904510 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:53.927585 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.934278 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.938553 15742 raft_consensus.cc:2368] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4.
I20260709 13:17:53.941890 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:53.933079 17813 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:53.931269 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:53.939893 17821 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:53.958771 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 266842us
I20260709 13:17:53.935235 17811 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:17:53.932891 17736 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:17:53.948485 17945 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:53.972945 17736 raft_consensus.cc:3055] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:53.973372 17736 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:53.974396 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 69962.4us
I20260709 13:17:53.974304 17736 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.975832 17736 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:53.958199 17917 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:53.956905 17916 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:53.964495 17933 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:53.999577 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.002305 15598 raft_consensus.cc:2376] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4. Re-sending same reply.
I20260709 13:17:54.000365 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.000828 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:54.004485 15642 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.116s (SENT)
I20260709 13:17:54.008778 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.005334 15595 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:54.005731 15596 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:54.006141 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.006110 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:54.011438 16263 leader_election.cc:336] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.126s (SENT)
I20260709 13:17:54.012321 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.014770 15601 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.014907 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.027751 15596 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:17:54.012923 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.032155 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.026592 17856 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.040669 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.040874 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.041385 15598 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:54.043164 15597 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.032279 17788 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.015324 15594 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:54.046159 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.033815 17736 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.046944 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:54.042163 17947 log.cc:927] Time spent T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:17:54.048239 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.052826 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.053421 15597 raft_consensus.cc:2376] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5. Re-sending same reply.
I20260709 13:17:54.055469 17945 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:17:54.056362 17931 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.386s	user 0.006s	sys 0.005s
I20260709 13:17:54.061741 17804 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:54.062206 17804 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:54.063110 17804 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:54.064847 15640 leader_election.cc:336] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.948s (SENT)
I20260709 13:17:54.065351 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.066438 17856 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.054230 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.070063 15595 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.042428 17816 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.072335 17816 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:54.073071 15593 raft_consensus.cc:2368] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6.
I20260709 13:17:54.075708 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.076330 15602 raft_consensus.cc:2376] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4. Re-sending same reply.
I20260709 13:17:54.078171 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.078428 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.079916 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.081926 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.081737 15497 catalog_manager.cc:5697] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 3, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:17:54.083312 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.083253 15497 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 5, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 5 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.084811 17957 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.085387 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.086385 15601 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.087236 17902 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.090428 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.091554 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.092136 15600 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:54.089840 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.092979 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.093089 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.093801 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.094259 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.094421 15595 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 2.
I20260709 13:17:54.094496 15596 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:54.094986 15594 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.095548 15602 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:54.100281 17917 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:54.100841 17957 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.108011 15598 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:17:54.064363 17804 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.114074 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.116514 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.106122 15497 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 4 to 5, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted, no longer has a pending config: VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66), VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67), VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 3 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:54.117817 15597 raft_consensus.cc:2393] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:17:54.120828 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.129243 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:54.131071 15672 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:54.133147 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:54.133760 15744 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.134582 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:54.141638 15640 leader_election.cc:336] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.506s (SENT)
W20260709 13:17:54.143146 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 131748us
I20260709 13:17:54.143177 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:54.131837 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:54.145025 15497 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:54.149736 15497 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 4, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 4 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:54.151608 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:54.152251 15747 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:54.156906 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:54.158831 17798 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:54.157045 16263 leader_election.cc:336] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.174s (SENT)
I20260709 13:17:54.159432 17798 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.149384 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:54.160213 16263 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.158761 15744 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:17:54.167574 15748 raft_consensus.cc:3055] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:17:54.170953 15748 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:54.172379 15497 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 3, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:54.174845 15497 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 4, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 4 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:54.176578 15497 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:54.177832 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.178962 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:54.180749 15714 connection.cc:256] RPC call timeout handler was delayed by -1.3111318649998793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 13:17:54.167044 15747 raft_consensus.cc:2410] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:17:54.169894 15716 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:54.159917 17798 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:54.188115 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.179319 15497 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:54.192626 15670 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:54.194746 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:54.196762 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 65746.7us
W20260709 13:17:54.197101 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.221s (SENT)
I20260709 13:17:54.197525 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:17:54.197872 15640 leader_election.cc:336] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.542s (SENT)
I20260709 13:17:54.179069 15567 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:54.201012 15672 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:54.209286 16307 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 13:17:54.167577 17680 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.217702 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.200140 15748 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.193675 17811 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:54.186319 17813 raft_consensus.cc:2764] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:54.186467 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:54.192811 17839 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:54.224660 15640 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.058s (SENT)
I20260709 13:17:54.226017 15748 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:54.211608 17937 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.204977 17856 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.221884 17559 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:54.235610 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 290) took 8671 ms. Trace:
I20260709 13:17:54.236124 17839 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.242515 17937 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.242425 17795 consensus_queue.cc:1059] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:54.223281 17935 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:17:54.235688 17854 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.233314 15640 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.227458 17811 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.219038 17916 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:17:54.241639 15714 leader_election.cc:336] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.026s (SENT)
I20260709 13:17:54.224185 17924 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.248576 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.239363 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:54.250264 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:17:54.254896 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.244099 15668 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:17:54.255836 17937 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.256423 17741 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.256527 17937 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:54.261521 17916 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:54.261404 17937 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.262463 17916 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.243912 17902 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:54.253628 17811 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.252856 17559 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.267946 16295 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:54.244133 17328 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:17:54.238757 15743 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:54.282078 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 64484.1us
I20260709 13:17:54.283380 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.243772 17839 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:54.261405 17871 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:54.295748 17328 consensus_queue.cc:1059] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:17:54.272979 17945 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.240454 15500 rpcz_store.cc:276] 0709 13:17:45.517711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.517947 (+   236us) service_pool.cc:224] Handling call
0709 13:17:54.189100 (+8671153us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:52.115131 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:52.116731 (+  1600us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:52.116794 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:17:52.116830 (+    36us) tablet.cc:662] Decoding operations
0709 13:17:52.120146 (+  3316us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:52.120226 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:52.120254 (+    28us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:17:52.123988 (+  3734us) tablet.cc:701] Row locks acquired
0709 13:17:52.124077 (+    89us) write_op.cc:260] PREPARE: finished
0709 13:17:52.124274 (+   197us) write_op.cc:270] Start()
0709 13:17:52.143792 (+ 19518us) write_op.cc:276] Timestamp: P: 1783603072124184 usec, L: 0
0709 13:17:52.148813 (+  5021us) op_driver.cc:348] REPLICATION: starting
0709 13:17:52.174758 (+ 25945us) log.cc:844] Serialized 3989 byte log entry
0709 13:17:52.786435 (+611677us) op_driver.cc:464] REPLICATION: finished
0709 13:17:52.962043 (+175608us) write_op.cc:301] APPLY: starting
0709 13:17:52.962142 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:52.962390 (+   248us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:52.962533 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:52.991688 (+ 29155us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:53.014864 (+ 23176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:17:53.014912 (+    48us) write_op.cc:312] APPLY: finished
0709 13:17:53.015307 (+   395us) log.cc:844] Serialized 77 byte log entry
0709 13:17:53.015514 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.015638 (+   124us) write_op.cc:454] Released schema lock
0709 13:17:53.015715 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:53.016153 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.016178 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1869613,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":149111,"apply.run_cpu_time_us":4003,"apply.run_wall_time_us":54080,"num_ops":10,"prepare.queue_time_us":440660,"prepare.run_cpu_time_us":17815,"prepare.run_wall_time_us":132917,"raft.queue_time_us":339519,"raft.run_cpu_time_us":19664,"raft.run_wall_time_us":159926,"replication_time_us":612608,"thread_start_us":447595,"threads_started":4,"wal-append.queue_time_us":87920,"wal-append.run_cpu_time_us":37049,"wal-append.run_wall_time_us":1743039}]]}
I20260709 13:17:54.307497 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.309162 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.310688 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:54.313436 16263 leader_election.cc:336] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.880s (SENT)
I20260709 13:17:54.314471 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:54.315369 15672 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:54.313906 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.317137 17924 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:54.292622 17935 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.319576 15672 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:54.320801 17559 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:54.318437 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 85814.4us
I20260709 13:17:54.318841 15642 leader_election.cc:400] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4.
I20260709 13:17:54.329699 15642 leader_election.cc:403] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:54.296886 17871 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.339094 15748 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:17:54.339646 15748 pending_rounds.cc:85] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 1
I20260709 13:17:54.320485 17935 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.342831 15673 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:54.340155 15748 pending_rounds.cc:107] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:54.319311 17839 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.344971 15748 raft_consensus.cc:2889] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.348958 15593 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:17:54.349318 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:54.349932 15593 raft_consensus.cc:606] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:54.351156 15714 leader_election.cc:336] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.067s (SENT)
I20260709 13:17:54.355093 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.355986 15598 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.356556 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.357682 15597 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:54.359251 15601 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:17:54.332866 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:54.362295 15600 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:17:54.297132 17854 consensus_queue.cc:1059] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:54.361352 15750 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:54.365509 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.365955 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.367645 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.368963 15674 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:17:54.337316 17937 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:54.361363 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.337031 17871 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:54.378156 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.382719 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.388244 15599 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.384558 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.383713 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:54.397038 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 78319.1us
I20260709 13:17:54.397523 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:54.398955 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.394069 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.400956 15748 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:54.403483 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.355988 17821 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.381317 17795 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:54.422022 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.421826 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:54.420744 15598 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:17:54.420356 15640 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.367520 17938 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:17:54.393754 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.370940 17559 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:17:54.427819 15671 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:17:54.406117 17940 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:54.430014 15600 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 2.
I20260709 13:17:54.432688 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.418056 17767 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4.
I20260709 13:17:54.435310 15602 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:54.422618 17854 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:54.437578 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.434165 16263 leader_election.cc:336] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 3.209s (SENT)
I20260709 13:17:54.442552 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.441782 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.444506 15598 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:54.425029 17839 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:17:54.468227 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.468572 15601 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:54.434093 15669 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:54.495100 15599 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:54.435164 17935 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.421434 17937 consensus_queue.cc:1059] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:17:54.488768 15597 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
W20260709 13:17:54.490875 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.503047 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 72076.3us
W20260709 13:17:54.497087 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 81566us
I20260709 13:17:54.445465 17788 raft_consensus.cc:3055] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:54.396776 17965 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:54.504356 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.427335 17821 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.508744 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.454420 17925 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:54.452235 17328 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.509452 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.509505 15597 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:17:54.451574 15743 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:17:54.512912 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.451691 17798 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.507284 17788 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:54.522234 17798 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:54.458200 17854 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.440464 17940 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.525449 17753 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:54.525916 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:54.522279 17788 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.527992 17945 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:54.528524 17945 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:54.529026 17945 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:54.526041 17753 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.532851 17974 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:54.533011 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.533764 15597 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:54.533478 17974 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.534698 17788 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:54.532452 17854 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:54.528028 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:54.541714 15640 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.565786 17753 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:54.566793 15640 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:54.539505 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.544783 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.560950 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.570391 15597 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.555228 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:54.555615 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:17:54.583393 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.570948 15750 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:54.584568 17984 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.584798 17680 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.543859 17811 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.574842 17860 consensus_queue.cc:1059] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:54.615206 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.615895 15599 raft_consensus.cc:2376] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5. Re-sending same reply.
I20260709 13:17:54.567394 17957 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:54.604485 17811 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:54.575047 17736 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:17:54.625358 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:54.630951 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.584209 17935 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:54.644943 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.645645 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.626117 15640 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.543987 15593 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
W20260709 13:17:54.660013 15640 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.681s (SENT)
I20260709 13:17:54.661059 15601 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:17:54.664140 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.664753 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.665768 15600 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:54.667119 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.667812 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.631531 17856 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:54.630386 17957 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:54.668525 15602 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:54.685573 17811 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:54.686456 15750 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:17:54.631729 17902 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:54.713884 16263 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.684446 17957 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:54.720510 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:54.725428 16310 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:54.725575 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:54.686169 17811 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:54.731796 15602 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:17:54.729714 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:54.741627 15670 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:54.747287 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 195915us
I20260709 13:17:54.716873 17767 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.690368 17979 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.718291 17974 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:54.806429 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.807058 15600 raft_consensus.cc:2376] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5. Re-sending same reply.
I20260709 13:17:54.804328 15602 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:54.805008 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:54.808969 15750 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:54.742280 17854 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:54.811800 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 253056us
I20260709 13:17:54.748558 16305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:17:54.752381 17821 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:54.751380 17940 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:54.821161 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:54.805759 17971 raft_consensus.cc:3055] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:54.850363 15673 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.806689 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:54.815821 17854 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:54.816025 17948 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.085s	user 0.009s	sys 0.000s
I20260709 13:17:54.862576 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:54.865406 16263 leader_election.cc:336] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.508s (SENT)
I20260709 13:17:54.875447 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:54.824932 17989 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.851992 17971 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:54.874284 17854 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:54.807750 17871 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.892786 15600 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:17:54.901518 16263 leader_election.cc:336] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.578s (SENT)
I20260709 13:17:54.852644 16305 raft_consensus.cc:606] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:54.858421 17860 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.900007 15673 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
W20260709 13:17:54.897699 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 84515.7us
I20260709 13:17:54.888825 17935 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:54.905668 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:54.876235 16295 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:17:54.902987 17982 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:17:54.911549 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:54.911893 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:54.913936 15748 raft_consensus.cc:2393] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:54.914661 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:54.913039 17973 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:54.896252 17989 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.896225 17992 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:54.891480 17811 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.913298 17991 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:54.919842 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:54.919492 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:54.919559 17651 raft_consensus.cc:3055] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:54.935238 17651 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:54.935418 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.920203 17935 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:54.936067 15597 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:17:54.936229 17651 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.937326 17651 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:54.938970 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:54.939659 15602 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:54.941457 17972 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:54.942170 16305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:17:54.942059 17972 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.924741 17811 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:54.925544 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.922791 17989 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:54.951737 17651 raft_consensus.cc:993] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:54.952518 17651 raft_consensus.cc:1081] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:54.953090 15743 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:17:54.963359 16310 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:54.965869 17871 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:54.971258 15599 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:54.920965 17940 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:17:54.980825 17992 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:54.925359 17971 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:54.982560 17971 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:54.926105 17991 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.985008 17991 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:54.987615 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 71878.8us
I20260709 13:17:54.990021 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:54.998901 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:54.999738 15598 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:55.000696 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:55.001391 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:55.002346 15596 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:55.000761 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:55.006840 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:55.008276 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:55.009085 15596 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:54.926491 17957 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.013775 17989 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:55.014400 17989 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.015009 17957 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:54.910585 17860 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:17:55.027861 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:55.036867 15602 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:55.041505 15598 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:17:55.025662 17996 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:55.025827 17972 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:55.006803 17871 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:55.025775 17788 raft_consensus.cc:993] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:17:55.055740 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:55.026268 16305 raft_consensus.cc:606] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
W20260709 13:17:54.997373 17984 consensus_queue.cc:1175] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5433f0c9863e427d88ba5916819e28e3" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:17:55.063078 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:55.063805 17788 raft_consensus.cc:1081] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
W20260709 13:17:55.075241 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.075438 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:55.076397 15675 raft_consensus.cc:2410] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 5 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:17:55.068396 17871 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:55.065192 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:55.016541 17989 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:55.073266 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:55.074299 17860 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:55.018172 17854 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.076771 16299 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.079468 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:55.079458 16263 leader_election.cc:336] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.773s (SENT)
I20260709 13:17:55.025249 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:55.095882 16310 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:17:55.096866 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.097440 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.101051 15672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.003s	sys 0.006s
W20260709 13:17:55.101439 15672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.003s	sys 0.006s
I20260709 13:17:55.108798 15596 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:17:55.110466 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:55.111111 15747 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:55.093564 15594 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
W20260709 13:17:55.114283 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.108395 15742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:55.120317 15742 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.120738 15742 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.108982 15743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:44676
I20260709 13:17:55.115576 17990 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.095870 17871 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:55.166702 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.168625 15640 leader_election.cc:336] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.968s (SENT)
I20260709 13:17:55.169323 15742 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.177809 15640 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:55.127234 15593 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:55.163938 15743 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:55.185145 15742 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:55.173018 17816 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.186939 17989 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:55.188536 17991 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.191080 17991 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:17:55.193516 17945 consensus_meta.cc:287] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
I20260709 13:17:55.187460 17816 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.164319 17990 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.195482 17816 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:55.195891 17990 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:55.184466 17854 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:55.198969 15743 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.193934 17945 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.241904 15747 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:17:55.243347 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:55.245893 15742 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:17:55.249009 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 71633.4us
I20260709 13:17:55.261407 15749 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:55.262084 15748 raft_consensus.cc:1240] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:55.263653 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:55.249820 16299 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:17:55.298942 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:55.299829 15670 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.238039 17839 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.282972 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:55.283396 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:55.303907 15674 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.258185 17816 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.306190 17816 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.312795 15670 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:55.316138 16305 raft_consensus.cc:614] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:55.317548 17736 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:55.320852 17839 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.323010 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 555) took 1128 ms. Trace:
I20260709 13:17:55.324986 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:55.328946 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.388211 15677 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:55.330296 17945 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:55.330515 15716 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:17:55.390201 15714 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.651s (SENT)
W20260709 13:17:55.390451 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 60004.3us
W20260709 13:17:55.333246 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.390843 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:55.394078 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:55.345347 15640 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:55.353585 17804 raft_consensus.cc:3055] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:55.357709 15496 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 3, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 3 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.363000 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:55.363438 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 323) took 2696 ms. Trace:
I20260709 13:17:55.364691 15668 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:55.265275 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:55.372967 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:55.403451 15672 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:55.403620 15745 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:55.376452 15673 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:55.404315 17767 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:17:55.406515 17767 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:17:55.409334 17965 raft_consensus.cc:3055] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:55.409744 17965 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:55.410394 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:55.410609 17965 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.411248 15670 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:55.411988 17965 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.412901 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:55.413427 15675 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:17:55.414296 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:55.414526 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:55.382293 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:55.385572 15671 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:55.385624 16306 rpcz_store.cc:276] 0709 13:17:54.194923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.195101 (+   178us) service_pool.cc:224] Handling call
0709 13:17:54.195378 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.236452 (+ 41074us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:54.309716 (+ 73264us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.491877 (+182161us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.493622 (+  1745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.493737 (+   115us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:54.493846 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.322757 (+828911us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b54004826d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:55.322807 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.322947 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43519,"prepare.queue_time_us":58941,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":40545,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":226,"spinlock_wait_cycles":93930240,"thread_start_us":228488,"threads_started":2}
I20260709 13:17:55.399319 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:55.398010 15496 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.417445 15677 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:55.418115 15496 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:55.401635 15714 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.685s (SENT)
I20260709 13:17:55.413532 16309 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:55.385285 17736 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:55.425223 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 79986.8us
I20260709 13:17:55.426054 15640 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:55.420029 16309 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:55.427356 16263 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:55.422243 15744 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:55.377785 15674 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:55.419623 15496 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 4, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.431360 15673 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:55.421609 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:55.444169 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.383272 17951 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:55.399874 17902 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:55.427758 16309 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.457235 16309 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.442710 15496 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 3, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:55.446432 15670 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:17:55.416191 17988 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:55.403057 17811 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:17:55.462873 15496 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 3, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 3 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.424691 17680 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.397171 17804 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:55.398988 15497 rpcz_store.cc:276] 0709 13:17:52.667338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.667662 (+   324us) service_pool.cc:224] Handling call
0709 13:17:55.363350 (+2695688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:54.311781 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:54.312405 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:54.312442 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:17:54.312464 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:54.313445 (+   981us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:54.313520 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:54.313551 (+    31us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:17:54.314334 (+   783us) tablet.cc:701] Row locks acquired
0709 13:17:54.314349 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:17:54.314509 (+   160us) write_op.cc:270] Start()
0709 13:17:54.314742 (+   233us) write_op.cc:276] Timestamp: P: 1783603074314453 usec, L: 0
0709 13:17:54.314767 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:17:54.315741 (+   974us) log.cc:844] Serialized 3641 byte log entry
0709 13:17:54.442927 (+127186us) op_driver.cc:464] REPLICATION: finished
0709 13:17:54.688626 (+245699us) write_op.cc:301] APPLY: starting
0709 13:17:54.704705 (+ 16079us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:54.745358 (+ 40653us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:54.819248 (+ 73890us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:54.975748 (+156500us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:54.975997 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:17:54.976042 (+    45us) write_op.cc:312] APPLY: finished
0709 13:17:54.976319 (+   277us) log.cc:844] Serialized 71 byte log entry
0709 13:17:54.976488 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.976633 (+   145us) write_op.cc:454] Released schema lock
0709 13:17:54.976688 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:54.977067 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.977094 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":98635,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":232391,"apply.run_cpu_time_us":3883,"apply.run_wall_time_us":298520,"num_ops":9,"prepare.queue_time_us":38010,"prepare.run_cpu_time_us":5215,"prepare.run_wall_time_us":81454,"raft.queue_time_us":33543,"raft.run_cpu_time_us":43788,"raft.run_wall_time_us":170178,"replication_time_us":127959,"thread_start_us":234261,"threads_started":4,"wal-append.queue_time_us":59707}]]}
I20260709 13:17:55.460995 15640 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:55.402356 17753 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:17:55.465827 15496 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.459810 17937 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:17:55.484247 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 82645.2us
I20260709 13:17:55.464264 17871 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:55.485601 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 69248.8us
I20260709 13:17:55.484829 15496 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 4, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:55.491883 16263 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:55.477865 17925 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:55.477044 17902 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:55.481953 17937 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:17:55.497785 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 76250.5us
I20260709 13:17:55.504331 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:55.504914 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:55.506865 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:55.507480 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:55.500146 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:55.508267 15598 raft_consensus.cc:2393] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:55.511214 15602 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:55.508893 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:55.518566 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:55.520536 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:55.521881 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:55.532554 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:55.507972 17937 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:17:55.531060 17988 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.533818 17988 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.525243 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:55.488868 15484 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:55.538931 15484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 149727us
I20260709 13:17:55.504676 17993 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:17:55.461385 17788 consensus_queue.cc:1175] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5433f0c9863e427d88ba5916819e28e3" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:17:55.557787 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 54697.7us
I20260709 13:17:55.559069 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:55.562115 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:55.523869 17951 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:55.487649 17736 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.523130 17925 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:55.591252 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 49469.5us
I20260709 13:17:55.549922 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:55.538450 17974 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:55.540247 17767 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:55.556954 17854 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:55.567234 15669 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:55.557811 18018 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:55.603466 16310 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:17:55.589614 17992 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:55.538182 17753 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:17:55.504030 17804 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:55.616164 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 109372us
I20260709 13:17:55.607785 15567 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:55.592000 17973 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.570526 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:55.605201 16263 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:55.539754 17996 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:17:55.537588 15743 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.599088 18021 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:55.607023 17811 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:55.626092 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:55.604421 17951 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:55.606431 17854 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:55.608762 17767 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:55.613278 18016 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:55.613436 18018 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.638784 17816 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:55.640290 17988 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:55.642717 17991 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:55.596350 17925 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.607788 18022 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:55.604169 15593 raft_consensus.cc:2376] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6. Re-sending same reply.
I20260709 13:17:55.648931 15749 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:55.617704 17839 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:55.622810 17974 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:17:55.662730 18013 log.cc:927] Time spent T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:17:55.663189 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:17:55.663121 17974 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.630561 17821 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:55.665851 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:55.668198 15743 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:55.634416 17992 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:55.632382 17972 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:55.633330 17811 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:55.618158 18015 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:17:55.647415 17767 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.645988 17854 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.601466 17902 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:55.673624 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 47616.9us
W20260709 13:17:55.674374 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 69249.8us
I20260709 13:17:55.654058 18018 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:55.682221 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 57782us
I20260709 13:17:55.684535 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:55.657310 17991 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:55.680415 17811 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.633363 18021 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.691707 17651 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:55.723229 16309 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:55.684360 17753 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.644470 17973 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.670318 18019 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:17:55.681316 17937 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:17:55.744310 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 182264us
I20260709 13:17:55.725376 17839 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.719225 17651 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:55.735005 18014 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:17:55.778434 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 158642us
I20260709 13:17:55.757678 18031 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:55.768218 17651 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.733723 17753 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.775031 18016 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:55.732563 17991 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.733144 17951 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:55.796775 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.801672 17736 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.806946 17992 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:55.807571 17992 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:55.808699 17991 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:55.814772 17973 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:55.819056 17816 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.819648 17816 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.821933 17816 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:17:55.822816 18010 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.328s	user 0.005s	sys 0.000s
I20260709 13:17:55.825377 17937 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:55.822999 18011 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:55.823562 17821 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:55.826814 18021 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:55.826995 17821 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:55.824156 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 139913us
I20260709 13:17:55.830263 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:55.833011 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:55.833539 16309 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:55.833834 16309 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:55.834487 16309 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.775094 17839 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.824894 18019 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:55.843755 18019 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:55.844712 18011 consensus_queue.cc:1059] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.845609 18011 consensus_queue.cc:1059] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.847388 18011 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:55.849817 17753 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:55.835350 16309 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:55.824697 18022 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:55.827447 17925 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:55.836865 17973 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:55.858140 18016 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.858829 17973 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.859180 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:55.783442 18031 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:55.861135 17973 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:55.839344 15744 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:17:55.862177 15744 pending_rounds.cc:85] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 2
I20260709 13:17:55.862432 15744 pending_rounds.cc:107] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:17:55.862684 15744 raft_consensus.cc:2889] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.842401 15742 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:17:55.840382 15748 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:55.863210 15742 pending_rounds.cc:85] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 2
W20260709 13:17:55.863062 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 86897.3us
I20260709 13:17:55.863739 15742 pending_rounds.cc:107] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:17:55.864146 15742 raft_consensus.cc:2889] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.864259 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:55.848402 18011 raft_consensus.cc:3055] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:55.837939 17680 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:55.914304 17992 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:55.920393 18019 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:55.968819 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 104631us
W20260709 13:17:55.980265 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 296054us
W20260709 13:17:55.989337 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.993639 16309 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
W20260709 13:17:55.999210 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 218230us
I20260709 13:17:55.868074 17816 raft_consensus.cc:3055] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:55.871742 18011 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:17:55.994138 18010 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:17:56.011457 16309 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:56.015064 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.017236 16308 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:55.989007 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.025517 15743 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:17:56.026625 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.027082 18015 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:56.027223 18022 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:56.027309 17651 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.028893 18027 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:17:56.029599 18020 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:56.018110 17996 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:56.005367 17816 raft_consensus.cc:740] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:56.032392 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:55.992995 18021 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:56.034993 16307 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:56.038471 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:56.036079 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:56.045710 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 327) took 1131 ms. Trace:
I20260709 13:17:56.046126 15600 rpcz_store.cc:276] 0709 13:17:54.913885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.914392 (+   507us) service_pool.cc:224] Handling call
0709 13:17:54.927260 (+ 12868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.934112 (+  6852us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:55.173381 (+239269us) log.cc:844] Serialized 14 byte log entry
0709 13:17:55.368348 (+194967us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.384398 (+ 16050us) log.cc:844] Serialized 26 byte log entry
0709 13:17:55.384620 (+   222us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:55.384674 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.384782 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.822137 (+437355us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:17:56.033728 (+211591us) raft_consensus.cc:1685] finished
0709 13:17:56.045441 (+ 11713us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.045646 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":740,"prepare.queue_time_us":206999,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":15463,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":10843,"spinlock_wait_cycles":2986240,"thread_start_us":290163,"threads_started":2,"wal-append.queue_time_us":239797}
I20260709 13:17:56.045610 17937 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:56.050817 17937 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.053109 17937 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.053484 17839 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.043016 17925 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:56.054562 17804 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.059024 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.064301 18032 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:17:56.066174 17965 consensus_meta.cc:287] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.006s
I20260709 13:17:56.037016 17990 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:56.044349 18021 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.071027 18021 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.075361 17651 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.016304 17854 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:56.077224 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 52266.3us
I20260709 13:17:56.078840 17854 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.079094 17860 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:56.079847 17860 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:56.080379 17860 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.080998 18039 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:56.084754 16310 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:56.085243 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.086380 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 50413.8us
I20260709 13:17:56.087788 18027 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:56.087874 17925 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:56.088292 18032 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:56.088207 18027 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.090137 15744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86c5f054f586412fbd8a416245340d63"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:17:56.093901 15744 raft_consensus.cc:606] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:17:56.094237 15744 raft_consensus.cc:614] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:56.078790 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:56.034380 18019 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:56.098022 18012 log.cc:927] Time spent T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:56.089402 17940 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.098937 18011 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.098870 17940 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.101662 17811 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.103729 17940 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:56.096414 18027 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.103394 17767 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:56.113054 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.110374 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:56.119498 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:56.119226 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.122771 16310 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
W20260709 13:17:56.114487 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 75550.9us
I20260709 13:17:56.088752 18032 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:56.125407 15716 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:56.100617 18011 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.129987 15716 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:56.104192 17992 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.132581 15745 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:17:56.132771 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 45697.4us
W20260709 13:17:56.134629 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.130446 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:56.122627 17902 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:56.148993 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:56.156360 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:56.149156 17957 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:56.126444 17965 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:56.162472 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.168287 15742 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:17:56.163904 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:56.165988 17940 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:56.106012 18018 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.129479 17736 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:56.177084 18015 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:56.180795 15749 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:56.186195 15671 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:56.156821 17996 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:56.156279 17945 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:56.201161 15747 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:56.167946 17965 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.187888 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.203320 18034 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:17:56.210157 18031 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.212903 17767 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.213414 17811 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.204119 18032 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.214588 17925 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.214865 18032 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.215161 17925 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:56.217504 17925 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:56.231475 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:56.175137 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.237514 15668 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:17:56.236583 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:56.205850 17996 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:56.240460 17996 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.244223 18018 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.244930 17965 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.190528 17940 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:56.249617 18020 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.249892 17940 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.250185 18020 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.252200 18020 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.253021 17753 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:56.255992 17753 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:56.256389 17753 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:56.273218 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 138828us
I20260709 13:17:56.278232 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:56.285072 16310 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:56.304451 15744 raft_consensus.cc:1240] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:56.306658 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.307463 15744 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:56.311713 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:56.318799 15567 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:56.236413 17860 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.312537 18015 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.272447 18020 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:56.317763 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.318830 16265 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:56.321208 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:56.325623 15748 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
W20260709 13:17:56.327397 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 170564us
I20260709 13:17:56.333464 15567 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:56.312848 18050 log.cc:927] Time spent T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.133s	user 0.004s	sys 0.000s
I20260709 13:17:56.338510 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:56.263849 18027 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.325165 17651 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:17:56.349118 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 185387us
I20260709 13:17:56.324295 18053 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:56.330072 17971 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:56.352795 18039 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:56.374488 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:56.375640 16310 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:56.353636 18047 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:56.300745 17816 consensus_queue.cc:260] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.358913 17753 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.329923 18015 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.361048 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.406647 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.407228 15744 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:56.362149 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.362810 17860 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.341451 18020 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.364575 18027 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.365139 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:56.414842 15746 raft_consensus.cc:2393] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 2: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:56.365420 15750 raft_consensus.cc:2410] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:17:56.366617 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.369467 15747 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:56.387322 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.375016 17935 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:56.336341 17973 consensus_queue.cc:1059] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:56.388365 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.419844 15671 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:17:56.344717 18052 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:17:56.404524 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.410257 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:56.375483 18011 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:56.413226 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.365927 18053 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.417251 15751 raft_consensus.cc:2393] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:56.424525 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.425757 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:56.402400 17971 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:56.412303 17680 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.411475 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.411527 17811 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:56.435194 15675 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:56.417649 17945 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:56.428303 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 174215us
I20260709 13:17:56.435981 17767 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:56.438900 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:56.409077 18018 consensus_queue.cc:1059] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:17:56.429793 17804 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:56.429896 18011 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.425822 18052 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.443132 15669 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:56.436848 17984 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.432793 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:56.463572 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 124073us
I20260709 13:17:56.422791 17935 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.451960 15743 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:56.430744 18021 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:17:56.455500 17860 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:56.459422 18011 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.456645 17804 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:56.462489 18052 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:56.443789 17811 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.436677 17680 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.499590 16302 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:56.499806 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:56.510061 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 152014us
I20260709 13:17:56.496803 17767 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.494745 15668 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.502192 17860 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.526926 16308 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:17:56.526818 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:56.509797 17804 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:56.531301 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:56.531944 15744 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.513234 18035 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.489534 17984 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.534752 15675 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:17:56.538087 15675 pending_rounds.cc:85] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 5
W20260709 13:17:56.541102 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.542284 15750 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:56.542307 15640 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:56.550529 15744 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:17:56.527900 18032 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:56.551311 15675 pending_rounds.cc:107] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:17:56.584851 15675 raft_consensus.cc:2889] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.551170 17937 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:56.551718 17839 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.586575 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.587414 15671 raft_consensus.cc:2410] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:17:56.586858 17839 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.552937 18066 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:56.544430 18035 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:56.589888 15548 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5433f0c9863e427d88ba5916819e28e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:56.590564 15548 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:17:56.590790 18035 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:56.590950 15548 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:17:56.526746 17651 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:17:56.557705 17993 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:56.559541 17984 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.542371 17925 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.564136 17821 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.581502 18021 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:56.517865 17971 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.568773 17753 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:56.569123 18020 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.569923 18057 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.574020 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.532716 17860 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.580572 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.534413 18027 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.541821 18047 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.620990 15669 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:17:56.578718 17924 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:56.591782 18055 log.cc:927] Time spent T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:17:56.527807 17767 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.534301 17945 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.612140 17680 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.612475 17935 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.612964 18021 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.613075 17821 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.603960 17902 raft_consensus.cc:3055] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:56.544303 17965 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.614405 17925 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:56.626751 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 68414us
I20260709 13:17:56.598894 18015 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.632706 15674 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:17:56.629390 15751 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:56.588963 18066 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.597877 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.650614 17937 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.591449 18065 consensus_queue.cc:1059] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:17:56.634292 18067 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.637250 18027 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.637713 18047 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:56.636788 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 63025.9us
I20260709 13:17:56.673225 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.652493 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:56.633406 18020 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.677241 15673 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:56.679085 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.680112 15745 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.665594 15675 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 2.
I20260709 13:17:56.681962 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.609421 17993 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.667671 17839 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.668725 17811 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.672794 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.673738 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.662379 17902 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:17:56.693720 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 151481us
I20260709 13:17:56.669701 18067 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.671131 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:56.683043 15675 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:56.661125 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.684751 15742 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:56.679759 15750 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:56.659168 18053 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.699960 16265 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:56.686400 15751 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:56.694564 15640 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:56.695529 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.700909 15749 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:56.701550 16265 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:56.702562 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.703374 16310 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:56.705150 15640 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:56.670429 18066 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.671548 18027 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:56.748891 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 76226.6us
I20260709 13:17:56.707304 15716 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:56.749478 17651 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:56.690145 17924 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:56.634662 18057 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.709887 15640 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:56.751701 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:56.754853 15673 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
W20260709 13:17:56.766906 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 59662.3us
I20260709 13:17:56.669194 17925 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.778959 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.713989 15669 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:56.746456 17935 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:56.671294 18052 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:56.793637 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.690569 18020 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.801879 15742 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:56.795193 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.771342 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.771591 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.804105 15596 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:56.804538 15598 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:56.771992 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.806046 15602 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.776187 15599 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:56.686789 18035 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:17:56.780654 17945 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:56.708281 17680 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:56.749974 17651 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.785106 15745 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:56.794881 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.683780 17937 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.795811 15750 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:17:56.760295 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.776911 17924 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.808143 15749 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:17:56.809293 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.811057 18011 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:56.782218 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.819289 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.859758 15596 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:56.777524 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.830267 15602 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:56.863529 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.864192 15602 raft_consensus.cc:2376] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4. Re-sending same reply.
I20260709 13:17:56.865042 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.812052 18027 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:17:56.808148 18066 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:56.707993 18081 consensus_queue.cc:1059] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:17:56.856397 15600 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:56.813731 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.856753 15749 pending_rounds.cc:85] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 4
I20260709 13:17:56.905061 15749 pending_rounds.cc:107] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:17:56.905370 15749 raft_consensus.cc:2889] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.794041 17821 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.879514 16302 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:56.880431 16304 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:56.880261 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.907480 15596 raft_consensus.cc:2376] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4. Re-sending same reply.
I20260709 13:17:56.829058 17680 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.887755 15602 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:56.824349 17945 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:56.912834 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.899282 15674 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:56.853310 17651 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.913487 15600 raft_consensus.cc:2376] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4. Re-sending same reply.
I20260709 13:17:56.823716 18074 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:56.863585 17935 raft_consensus.cc:2764] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:17:56.910513 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.919097 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:17:56.919703 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 209886us
I20260709 13:17:56.919925 15602 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:56.921025 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.858412 17984 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:56.913295 17945 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:56.926517 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.927361 15600 raft_consensus.cc:2376] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4. Re-sending same reply.
W20260709 13:17:56.930060 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 137085us
W20260709 13:17:56.930850 15714 leader_election.cc:336] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.884s (SENT)
I20260709 13:17:56.932390 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:56.933815 15585 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2d5bac8fb54783a1f420061d08067f with delete_type TABLET_DATA_TOMBSTONED (TS 558532223b984cf796cb6b98ddd6c9f2 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:51462
I20260709 13:17:56.933964 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.937965 15600 raft_consensus.cc:2410] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 5 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:17:56.924978 18021 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.939010 15600 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:56.935223 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.940543 15596 raft_consensus.cc:2376] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5. Re-sending same reply.
I20260709 13:17:56.940814 17990 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:56.941215 17990 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.935503 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.941713 17990 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:56.942121 15602 raft_consensus.cc:2410] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:17:56.941973 17945 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.944319 17945 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:56.946656 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.947551 15602 raft_consensus.cc:2368] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:56.914314 17680 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:56.948231 15714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.886s (SENT) [suppressed 50 similar messages]
I20260709 13:17:56.951810 18021 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:56.985505 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.932057 18080 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:56.985673 18047 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:56.953786 18082 log.cc:927] Time spent T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:17:56.992429 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.992944 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:56.993649 15602 raft_consensus.cc:2368] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:56.993718 15600 raft_consensus.cc:2368] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:56.994726 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:56.999585 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.000430 15602 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:57.001606 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.002199 15602 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:57.002557 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.003039 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.003186 15596 raft_consensus.cc:2376] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6. Re-sending same reply.
I20260709 13:17:56.999665 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.004842 15600 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:57.006414 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.003894 15602 raft_consensus.cc:2368] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:57.008209 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.010205 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:56.989276 18080 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:57.010978 15745 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:56.985404 18021 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:56.996799 17839 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.013274 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.023277 18011 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:56.954244 18016 raft_consensus.cc:2955] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:56.995651 17804 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.003667 18087 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.050948 18087 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.053175 18087 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.053953 17804 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.054697 15675 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:57.055204 17651 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.058631 17860 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.067062 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:57.031172 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.068508 15601 raft_consensus.cc:2368] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:17:57.069353 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.036980 18020 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.038494 15668 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:57.039223 17816 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.040279 18021 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.013087 17821 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.084442 17821 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.092280 17736 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:17:57.092923 17736 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:57.093191 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.093806 17736 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.096859 15596 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:57.059034 15593 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:57.035089 18093 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.008209 18077 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.076205 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.099912 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.001791 18066 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:57.062774 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:17:57.083647 18068 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:57.094334 15594 raft_consensus.cc:2393] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:57.040920 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.097926 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.073356 18052 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:57.123093 16310 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:57.101074 15601 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:57.101549 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:17:57.102891 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.082590 18080 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.074173 17973 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:17:57.126721 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 46214.7us
I20260709 13:17:57.128551 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.098162 17924 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.131505 15601 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:17:57.134555 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.135356 15596 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.136570 15595 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:57.098903 17821 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.132488 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.063428 17839 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.139092 17854 raft_consensus.cc:3055] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.125447 18093 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.127698 18077 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.141057 17860 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:57.141659 18036 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:57.142055 18080 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.170389 15565 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.144958 18067 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.134606 17945 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.147929 15670 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:17:57.144960 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.148073 18066 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.148934 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.151446 15596 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:57.152791 16302 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:17:57.154009 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.125501 18011 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.130702 17937 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.192500 15670 pending_rounds.cc:85] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 1
I20260709 13:17:57.155565 17854 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:57.197926 15670 pending_rounds.cc:107] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:17:57.199715 15670 raft_consensus.cc:2889] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.200050 15670 pending_rounds.cc:107] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:17:57.200276 15670 raft_consensus.cc:2889] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.183319 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:57.203646 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.169363 17924 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.164955 18036 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:57.207098 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.169729 17935 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:57.172866 18053 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.153554 17680 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.208652 15714 leader_election.cc:400] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:57.135682 17973 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.194021 18022 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:57.211920 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:57.211789 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.216889 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.211472 17940 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:57.314353 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.212934 17945 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.234177 17651 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.240923 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.325152 15674 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:57.206385 18094 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:57.233476 17839 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.275578 15640 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:17:57.328488 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 53014.6us
I20260709 13:17:57.236037 17973 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:57.203065 18011 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.245142 18096 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:17:57.195456 18020 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:17:57.239629 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.221400 18015 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:17:57.235426 17965 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.248723 18077 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.235845 18073 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:57.212425 17860 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:57.234460 18057 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.239485 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:57.343451 15668 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:17:57.344177 18048 log.cc:927] Time spent T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.019s	user 0.007s	sys 0.000s
I20260709 13:17:57.236974 17854 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.345990 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.347010 17854 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.246604 17990 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.350241 17990 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.253539 17767 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.351236 18015 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.222507 15671 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.313184 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.313849 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.307577 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.240854 18093 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.354938 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.333904 18035 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.213758 17935 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.370184 15601 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:17:57.331045 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 114225us
I20260709 13:17:57.332948 15597 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:57.334180 15640 leader_election.cc:400] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:57.374511 15640 leader_election.cc:403] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:57.334784 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.374857 15714 leader_election.cc:400] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:57.375267 15714 leader_election.cc:403] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:17:57.375415 15674 raft_consensus.cc:2410] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:57.375911 16305 raft_consensus.cc:2368] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:57.339578 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.376473 15594 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:17:57.376725 18074 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:17:57.377331 18097 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:17:57.377759 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 48456.7us
I20260709 13:17:57.378635 15640 leader_election.cc:400] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:17:57.378914 15640 leader_election.cc:403] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:57.378836 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.379634 15599 raft_consensus.cc:2368] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3.
I20260709 13:17:57.379978 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:57.369858 17651 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.377347 18074 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.381341 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.354985 18073 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.382161 15596 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:57.219816 18039 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.383047 18074 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.382932 18039 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.383466 18073 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.383615 18074 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.376351 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.384668 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.359216 18077 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:57.385300 18039 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.352836 17860 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:57.385644 18077 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.386577 15640 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:57.386742 17860 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.387674 18077 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.328418 18094 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.337122 17804 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:57.315416 18036 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.388558 15673 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:17:57.389042 18036 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.388198 18094 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:57.390101 17935 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.390671 17804 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.391099 17804 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.391216 17680 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.392977 17839 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:57.376410 16305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 578) took 1060 ms. Trace:
I20260709 13:17:57.370234 18093 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.394678 18093 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.381181 17651 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.397629 17937 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:57.399247 17651 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.399472 15640 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:57.400177 17940 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.400668 17940 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.401250 18035 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:57.401789 18035 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.402384 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.402999 15747 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:57.404753 16307 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:57.403784 18035 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:57.405808 18035 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:57.406126 17937 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:57.406849 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.408560 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:57.409137 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:57.409811 15745 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.410357 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.411726 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.411908 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.210747 17924 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.412509 15747 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:57.412930 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:57.413511 15749 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.413817 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.414243 17924 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.394464 16305 rpcz_store.cc:276] 0709 13:17:56.315555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.324392 (+  8837us) service_pool.cc:224] Handling call
0709 13:17:57.307451 (+983059us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:57.376342 (+ 68891us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13268224}
I20260709 13:17:57.415522 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.412286 15677 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:57.417557 15640 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:57.385329 15601 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:57.409252 16302 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.356065 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:57.405870 17940 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:57.420044 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.420641 15748 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:57.352571 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:57.419350 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:57.384776 15674 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:17:57.368270 15671 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:57.448498 18034 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.448987 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.449147 18034 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.449697 15672 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:57.451406 18034 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.451885 15672 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:57.452956 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:57.423748 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:57.453595 15750 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.452248 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:57.454762 15742 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:17:57.454762 15675 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.456691 15672 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:57.419868 17937 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:57.461349 15751 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:57.461684 16308 raft_consensus.cc:2368] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:57.461969 16265 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:57.444380 15745 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:17:57.454100 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:17:57.469082 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 112558us
I20260709 13:17:57.471041 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:57.471774 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.473369 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.474769 15716 leader_election.cc:400] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:57.475108 15716 leader_election.cc:403] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:57.476729 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.480057 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.487195 18056 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:57.487859 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.488538 16295 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:57.488859 18075 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.490501 16310 raft_consensus.cc:2955] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:57.460433 17767 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 2. Current term is 3.
I20260709 13:17:57.495044 17993 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.310220 15484 catalog_manager.cc:5028] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): tablet ea2d5bac8fb54783a1f420061d08067f (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
W20260709 13:17:57.498737 15484 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 188547us
I20260709 13:17:57.500941 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.501693 15669 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:57.501868 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.502511 15743 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:57.460693 17935 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.509023 17935 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.511183 17935 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.511176 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:56.673913 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:57.517812 18094 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.500978 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.520136 18094 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.520578 16309 raft_consensus.cc:2410] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:57.464741 18093 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:57.522137 18061 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:57.460721 17924 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:57.508455 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.466475 18034 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:57.554682 15747 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:17:57.529085 15675 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:17:57.560453 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:57.561200 16307 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.474395 18077 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:57.531733 15742 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:17:57.562047 15642 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:57.422039 15668 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:17:57.571275 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 198303us
I20260709 13:17:57.574819 15714 leader_election.cc:400] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:57.575642 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:57.573009 15749 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
W20260709 13:17:57.529695 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 68528.9us
I20260709 13:17:57.374603 18066 consensus_queue.cc:1059] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.180s
I20260709 13:17:57.578274 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:57.606369 15716 leader_election.cc:400] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:57.560580 18034 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.554404 18076 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:57.615041 18076 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.580677 15750 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:57.618153 18076 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:57.588500 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.586525 16263 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:57.604388 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:57.619635 15749 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:57.620651 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.621542 16304 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:57.623978 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:57.625141 17993 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:57.625617 17993 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.626036 17993 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:57.628314 15749 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:17:57.629385 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.630396 16309 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:57.631505 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.633807 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.636543 16304 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:57.644500 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.577924 18074 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:57.649284 18074 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.563174 17940 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:57.568130 18077 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.652818 18077 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.653374 18074 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.652848 17940 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.656028 17940 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:57.475908 18080 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:17:57.606877 15675 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:57.607405 16265 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:57.567157 17924 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:57.658728 17924 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.659190 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.660928 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.611487 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.667184 18077 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.607895 15716 leader_election.cc:403] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:17:57.668547 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 62377.7us
I20260709 13:17:57.618644 18034 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.671062 17940 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:57.645481 18035 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:57.677523 18034 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.680667 18034 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.682482 18077 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.685859 16304 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:57.583914 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:57.699028 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.699204 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.699894 15598 raft_consensus.cc:2393] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:57.699910 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.700901 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.701696 15596 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:17:57.703006 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.704023 15600 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:57.700894 15595 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:17:57.708442 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.709503 15599 raft_consensus.cc:2393] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:57.712872 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.720964 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:57.722010 15597 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:17:57.600049 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:57.604753 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.576799 17965 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:17:57.754906 15746 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:17:57.762018 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 49229.2us
W20260709 13:17:57.762693 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 178889us
W20260709 13:17:57.729918 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 125298us
I20260709 13:17:57.728859 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:57.766638 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.391309 17902 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:57.734164 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 147747us
W20260709 13:17:57.734802 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 127499us
W20260709 13:17:57.735291 18095 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:17:57.735391 18076 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:57.735831 18080 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:57.736073 18077 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:57.745227 18011 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.606170 18056 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:57.504020 15743 raft_consensus.cc:2955] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:57.782948 18077 raft_consensus.cc:697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:57.784080 18077 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.577904 17839 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:57.787633 16302 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:17:57.788743 16305 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:17:57.765748 18094 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:57.790455 18094 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.790828 18094 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:57.750685 18019 raft_consensus.cc:3055] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:17:57.606498 17990 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.772857 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:57.759907 18035 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:57.801222 18080 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.803810 18080 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.767568 18075 consensus_queue.cc:1059] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:17:57.804723 17993 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.805552 17854 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:17:57.805639 18075 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:57.806069 17854 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:57.806286 18075 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:57.806514 17854 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:57.764613 18020 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:57.772452 15567 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:57.808120 16265 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:57.811051 16307 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:17:57.807454 18075 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.820888 18036 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:57.821491 18036 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:57.822364 18036 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.772712 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:57.767872 17940 raft_consensus.cc:2764] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:17:57.804327 18035 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:57.830442 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:57.783924 17804 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.778396 18076 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:57.879099 18076 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:57.779244 18016 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:17:57.845356 17680 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:17:57.810242 18019 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:57.778910 17651 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:17:57.872654 17973 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:57.860641 17990 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:57.904642 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:57.850396 18035 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:57.904989 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 132358us
I20260709 13:17:57.909807 15742 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:57.910913 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 142294us
W20260709 13:17:57.924163 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.912587 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.907364 17993 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:57.928994 15744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.010s
W20260709 13:17:57.945358 15744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.004s	sys 0.010s
W20260709 13:17:57.930855 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 164287us
I20260709 13:17:57.947953 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:57.871572 18094 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.905491 18075 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:57.912990 18016 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:17:57.955440 15567 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:57.867955 17854 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:57.960249 15567 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:57.918433 17990 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:57.921216 17973 raft_consensus.cc:697] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:57.970985 15742 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:57.953787 18044 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.953933 17839 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:57.972734 16265 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:17:57.959919 17925 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:57.988063 18096 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:57.959962 18016 raft_consensus.cc:697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:57.989372 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:57.988736 18096 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:58.013334 18096 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:57.956957 17945 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:57.995155 17925 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:58.019102 17925 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.020999 18069 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:57.982951 17651 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:58.021607 18069 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.022298 17651 raft_consensus.cc:697] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:58.023228 17651 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.023927 18069 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:57.982753 18044 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.027267 18044 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:57.944494 18019 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.031627 18019 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:58.002316 17990 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.001268 18016 consensus_queue.cc:237] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:17:57.972589 17940 raft_consensus.cc:2764] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:17:58.012323 17804 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:58.023547 17902 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.005100 17973 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:58.046054 15672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.019s
W20260709 13:17:58.046489 15672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.008s	sys 0.019s
W20260709 13:17:58.040045 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.989944 17839 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:58.058799 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 415573us
I20260709 13:17:58.000273 18076 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:58.052194 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62926.2us
I20260709 13:17:58.060523 18034 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:58.130041 17965 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:58.128428 17680 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:58.205976 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 293494us
W20260709 13:17:58.191920 18063 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:17:58.212019 18069 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:58.222615 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.223340 15749 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:58.230697 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:58.238761 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.238806 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:58.240588 15751 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.244941 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:58.247422 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.250033 15673 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:58.257602 15677 raft_consensus.cc:2393] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:17:58.262115 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.275558 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.276219 15673 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:17:58.278280 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 501023us
I20260709 13:17:58.280392 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:58.281167 15674 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:58.279619 15565 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:58.290256 18011 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:58.296927 18011 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.299158 18011 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:58.299413 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:58.299793 18011 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:58.301486 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.302582 15675 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:17:58.239331 18039 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.243482 17854 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:58.300230 15668 raft_consensus.cc:2393] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:58.275204 18044 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:58.273562 18066 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:58.215895 17965 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.242592 18069 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:17:58.313025 18011 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.316998 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:17:58.354800 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 403048us
I20260709 13:17:58.356016 15714 leader_election.cc:400] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3.
I20260709 13:17:58.317279 18076 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:58.356472 15714 leader_election.cc:403] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:17:58.331552 18077 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.344326 17839 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:58.314509 17951 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:17:58.352206 18011 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:58.314036 18039 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.341058 15674 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
W20260709 13:17:58.372661 18109 log.cc:927] Time spent T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:17:58.343014 18066 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.363317 17860 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:58.397958 17753 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 2. Current term is 3.
W20260709 13:17:58.401990 18121 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:58.403389 18036 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:58.405011 18116 log.cc:927] Time spent T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:58.405741 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:58.407725 18036 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:58.408149 18036 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:58.408558 18036 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:58.409799 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:58.412724 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:58.415181 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:58.413739 17965 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:58.420358 18066 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:58.416589 18036 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.425179 15500 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 4 to 5, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.434566 18036 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:58.434358 15500 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.435871 15500 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 3, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.426668 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:17:58.441004 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 161458us
W20260709 13:17:58.441286 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.369824 18077 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.424979 15496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 212) took 5095 ms. Trace:
I20260709 13:17:58.443446 15567 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:58.388759 18126 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:58.447507 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:58.442708 15496 rpcz_store.cc:276] 0709 13:17:53.329260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.349073 (+ 19813us) service_pool.cc:224] Handling call
0709 13:17:58.424879 (+5075806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:55.691032 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:55.691595 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:55.691630 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:17:55.691648 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:55.692578 (+   930us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:55.692670 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:55.692703 (+    33us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:17:55.788851 (+ 96148us) tablet.cc:701] Row locks acquired
0709 13:17:55.788885 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:17:55.789142 (+   257us) write_op.cc:270] Start()
0709 13:17:55.789309 (+   167us) write_op.cc:276] Timestamp: P: 1783603075789056 usec, L: 0
0709 13:17:55.789343 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:17:55.804854 (+ 15511us) log.cc:844] Serialized 3194 byte log entry
0709 13:17:56.083760 (+278906us) op_driver.cc:464] REPLICATION: finished
0709 13:17:56.365021 (+281261us) write_op.cc:301] APPLY: starting
0709 13:17:56.365112 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:56.365329 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:56.365435 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:56.390807 (+ 25372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:56.391132 (+   325us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:17:56.391200 (+    68us) write_op.cc:312] APPLY: finished
0709 13:17:56.391547 (+   347us) log.cc:844] Serialized 65 byte log entry
0709 13:17:56.391815 (+   268us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.391992 (+   177us) write_op.cc:454] Released schema lock
0709 13:17:56.392060 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:56.392566 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:56.394723 (+  2157us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":172317,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":264830,"apply.run_cpu_time_us":7181,"apply.run_wall_time_us":27469,"num_ops":8,"prepare.queue_time_us":92835,"prepare.run_cpu_time_us":5586,"prepare.run_wall_time_us":114161,"replication_time_us":294243,"thread_start_us":249248,"threads_started":2}]]}
I20260709 13:17:58.450310 17925 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:58.454393 17925 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:58.450147 18044 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:58.456771 18044 raft_consensus.cc:3055] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:58.457168 18044 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:58.446448 16295 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:58.458084 18044 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.457265 15565 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:58.459388 18044 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:58.446038 18109 log.cc:927] Time spent T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:17:58.422667 18035 consensus_meta.cc:287] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.004s
I20260709 13:17:58.426841 18020 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:58.470548 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:58.475319 15675 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.447270 18019 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:58.440346 15500 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 4, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.421749 18034 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:58.473709 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:58.395707 17860 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.486811 15751 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:58.471951 15674 raft_consensus.cc:2955] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:17:58.438596 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:58.498960 17651 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:17:58.498881 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 60332.7us
I20260709 13:17:58.500010 16263 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:17:58.501185 18036 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:58.472287 18075 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:58.445618 17680 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:17:58.503494 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:58.503816 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:58.507849 16308 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.477808 18020 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.506083 15640 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:58.519508 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.501798 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:58.495425 15675 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:58.488139 15500 catalog_manager.cc:5697] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 3 to 4, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
W20260709 13:17:58.493141 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 137313us
I20260709 13:17:58.529471 15673 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:58.530787 15500 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 3, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.532673 15500 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 4, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.534744 15675 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:17:58.535120 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.513664 17651 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:58.535925 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.534797 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.536923 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.537520 15601 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.535954 17651 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:17:58.540737 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:58.541841 15675 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:17:58.543463 15500 catalog_manager.cc:5697] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 3, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:17:58.551575 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.552234 15600 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.512466 18075 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.553067 18075 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:58.552168 15500 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 3, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.554302 15500 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:17:58.546358 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.558782 15597 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 4: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:58.547417 15668 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:58.525637 17993 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:58.511652 17965 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.559885 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:17:58.564356 18118 log.cc:927] Time spent T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.355s	user 0.002s	sys 0.007s
I20260709 13:17:58.547724 15599 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:17:58.564924 17902 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:58.477614 18035 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:58.556972 18131 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260709 13:17:58.580382 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.550768 17651 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.558789 17860 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:58.525029 18020 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.567866 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:58.568344 15600 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:58.545185 15601 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:17:58.461364 18126 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.574326 16310 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:58.550347 18130 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:58.575093 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:17:58.578639 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.623948 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.640945 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.642127 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.580935 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.611001 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.643261 15671 raft_consensus.cc:2368] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:58.643191 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.559129 15500 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 3, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:58.643999 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.644233 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.514962 17839 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:58.597497 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.610957 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.608793 15670 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:58.655891 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:58.655977 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.609243 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.625113 17651 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:58.585736 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:58.656957 15601 raft_consensus.cc:2368] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:58.631937 18077 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:58.632938 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1857) took 1270 ms. Trace:
I20260709 13:17:58.633934 18035 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:58.637801 18056 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.638837 15598 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:17:58.607798 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.679171 15750 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:58.626660 17902 raft_consensus.cc:697] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:17:58.584031 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.560745 17993 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.641577 15602 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:58.649482 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:58.650004 16308 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:58.692561 15671 raft_consensus.cc:2368] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
W20260709 13:17:58.692420 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 171366us
I20260709 13:17:58.692737 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:58.655014 17839 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.656884 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.656982 15751 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:17:58.657593 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.562322 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1991) took 1077 ms. Trace:
W20260709 13:17:58.630465 18111 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.480s	user 0.005s	sys 0.005s
I20260709 13:17:58.655193 15747 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:17:58.582903 17924 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.581606 18034 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.561427 18137 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.560688 18094 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:58.659013 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.662573 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:58.658782 15672 rpcz_store.cc:276] 0709 13:17:57.362643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.457762 (+ 95119us) service_pool.cc:224] Handling call
0709 13:17:57.458151 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.458651 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.458698 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.459286 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.046959 (+587673us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:17:58.047022 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.047126 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.563775 (+516649us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:17:58.632675 (+ 68900us) raft_consensus.cc:1685] finished
0709 13:17:58.632699 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.632880 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2130,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":19730,"spinlock_wait_cycles":56753536,"thread_start_us":587272,"threads_started":1,"wal-append.queue_time_us":719108}
I20260709 13:17:58.745981 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.746588 15672 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:58.747375 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.748311 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.749316 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:58.580919 18093 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:58.750597 18093 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.581758 18069 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.753511 18069 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.659761 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.642160 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:17:58.681386 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:17:58.623621 15668 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
W20260709 13:17:58.762660 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 120612us
I20260709 13:17:58.764777 17680 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:58.765209 15668 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:58.765839 18125 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:58.766253 18125 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:58.766909 15668 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.692800 17993 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:58.561355 17965 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.770493 17965 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:58.683579 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:17:58.773357 18134 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:58.764390 17651 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:58.774925 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.775835 15742 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:58.677997 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.776723 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.777035 15598 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:17:58.777776 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.777904 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.778482 15742 raft_consensus.cc:2393] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:58.778432 15598 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:17:58.779259 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.780187 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.693917 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.782606 15746 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:17:58.782965 15673 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:58.783247 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.694249 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 244598us
I20260709 13:17:58.646435 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.785246 15742 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:58.773640 16263 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:17:58.689327 18039 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:58.658519 18096 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:58.728863 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.658715 16295 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:17:58.743366 15602 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:17:58.801607 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.802211 15600 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:58.781234 15677 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:58.781641 15601 raft_consensus.cc:2410] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:58.695484 15714 leader_election.cc:400] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:17:58.788830 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.789294 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:17:58.678851 18128 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:17:58.704912 17839 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:58.792223 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:17:58.802261 15602 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:17:58.693434 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:58.685725 18056 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:58.727612 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:58.790668 15567 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:17:59.001993 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.803273 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:58.848340 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:17:59.019563 15742 raft_consensus.cc:2393] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:17:58.871454 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 177794us
I20260709 13:17:58.999512 15596 raft_consensus.cc:2410] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:58.839303 15751 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:17:58.806397 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 224816us
I20260709 13:17:59.027386 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:17:58.939091 15673 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:58.804620 15750 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:17:59.030398 15750 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:17:59.020987 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 325666us
I20260709 13:17:59.023780 15751 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:17:59.017367 15486 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5433f0c9863e427d88ba5916819e28e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:17:59.070281 15486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 421162us
W20260709 13:17:58.890779 18111 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:17:59.074448 15746 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:59.076690 15748 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 13:17:59.008430 18146 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:17:59.105739 15742 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:58.800870 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:58.801334 17854 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:17:59.082417 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 291851us
I20260709 13:17:58.742915 18034 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.755946 17924 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:59.076349 18016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.005s
I20260709 13:17:58.932253 18148 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.138561 18141 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:17:59.098057 17965 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.097963 18150 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.079676 18136 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.021111 18075 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.166992 15598 raft_consensus.cc:2376] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4. Re-sending same reply.
I20260709 13:17:59.168018 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1841) took 2545 ms. Trace:
I20260709 13:17:58.933348 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:59.138464 18093 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.078287 18044 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:59.332118 18044 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.334839 18044 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:58.781013 17902 consensus_queue.cc:237] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:58.756317 18137 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:59.191829 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 99496.2us
I20260709 13:17:59.337752 15640 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:58.831750 18096 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:59.194635 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 167371us
I20260709 13:17:59.339021 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:17:59.162554 18016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.007s	sys 0.006s
I20260709 13:17:59.340001 18096 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.196476 15672 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:59.198124 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:59.342581 15675 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:59.342639 16302 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
W20260709 13:17:59.221055 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 185683us
I20260709 13:17:59.161763 18126 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.328150 18019 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:59.147032 18128 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:17:59.338300 18137 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.347187 18019 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.349808 18019 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.199514 15676 rpcz_store.cc:276] 0709 13:17:56.622484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.057927 (+435443us) service_pool.cc:224] Handling call
0709 13:17:57.058200 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.058594 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:57.113951 (+ 55357us) log.cc:844] Serialized 14 byte log entry
0709 13:17:57.452368 (+338417us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800433cc0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe29023a 00007faefe6faa2a
0709 13:17:57.923134 (+470766us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.960094 (+ 36960us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.960288 (+   194us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:57.960336 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.960435 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.629902 (+669467us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:17:59.167785 (+537883us) raft_consensus.cc:1685] finished
0709 13:17:59.167809 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.167948 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17609,"prepare.queue_time_us":64738,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":16213,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":32634,"spinlock_wait_cycles":74477696,"thread_start_us":514218,"threads_started":2,"wal-append.queue_time_us":953477}
I20260709 13:17:59.197700 18094 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.474210 15601 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:58.905787 18125 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.197233 18149 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:17:59.500265 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 162592us
W20260709 13:17:59.501268 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 162318us
I20260709 13:17:59.499985 18165 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:17:59.511818 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:59.517192 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:59.518160 15675 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:17:59.520339 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:17:59.361439 18151 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.536832 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:59.197115 17965 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.541848 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:59.551782 15675 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:17:59.555810 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.473136 18069 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:59.493914 18094 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.167227 18148 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.490322 17753 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:59.576575 15642 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:59.571090 15675 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:17:59.510762 18149 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.544458 18140 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.205132 18150 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:59.596261 18143 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.395s	user 0.000s	sys 0.000s
I20260709 13:17:59.616941 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 358) took 1032 ms. Trace:
I20260709 13:17:59.319576 18136 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.558822 18074 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.623417 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:17:59.624536 16306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 682) took 1559 ms (client timeout 1719 ms). Trace:
W20260709 13:17:59.625049 16306 rpcz_store.cc:269] 0709 13:17:58.065634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.065805 (+   171us) service_pool.cc:224] Handling call
0709 13:17:59.623227 (+1557422us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:59.624460 (+  1233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2371840}
I20260709 13:17:59.617530 15597 rpcz_store.cc:276] 0709 13:17:58.584019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.584140 (+   121us) service_pool.cc:224] Handling call
0709 13:17:58.584467 (+   327us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:58.584885 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.584925 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:58.624080 (+ 39155us) log.cc:844] Serialized 78 byte log entry
0709 13:17:58.636158 (+ 12078us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b18002f9a40. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1 00007faefe6aba0f
0709 13:17:58.749737 (+113579us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:58.955416 (+205679us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.955719 (+   303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.955824 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.567320 (+611496us) raft_consensus.cc:1685] finished
0709 13:17:59.616632 (+ 49312us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.616860 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8523,"prepare.queue_time_us":449787,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":16400,"raft.queue_time_us":67974,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":67291,"spinlock_wait_cycles":6056704,"thread_start_us":318476,"threads_started":2,"wal-append.queue_time_us":127909}
I20260709 13:17:59.630295 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:59.577847 18094 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.559110 18171 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.576174 18069 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:17:59.576833 18157 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.601302 18142 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.615723 18141 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:59.590806 18149 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:59.650858 18162 log.cc:927] Time spent T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:17:59.651567 18150 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.656312 18173 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:58.704860 15743 rpcz_store.cc:276] 0709 13:17:57.485341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.503235 (+ 17894us) service_pool.cc:224] Handling call
0709 13:17:57.503595 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.503873 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:57.890170 (+386297us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.521305 (+631135us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.561771 (+ 40466us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.561942 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.561994 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:58.562045 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.562139 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.562260 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25418,"prepare.queue_time_us":639672,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":95,"raft.queue_time_us":54625,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":42843,"thread_start_us":575454,"threads_started":2,"wal-append.queue_time_us":513048}
I20260709 13:17:59.657650 18163 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.658881 18170 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:17:59.615270 18140 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.665457 18016 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:59.601118 17753 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.645411 18145 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:59.723109 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:59.682226 18142 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:59.701109 16265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.079s	sys 0.173s
I20260709 13:17:59.701964 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1665) took 1047 ms. Trace:
I20260709 13:17:59.559556 18151 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:59.734741 16265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.080s	sys 0.173s
I20260709 13:17:59.734833 15601 rpcz_store.cc:276] 0709 13:17:58.654961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.019807 (+364846us) service_pool.cc:224] Handling call
0709 13:17:59.020170 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.474731 (+454561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.701628 (+226897us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540012b954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:59.701884 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043758848}
W20260709 13:17:59.699844 18146 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:59.638118 18074 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.709648 18056 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:59.750684 15668 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.983s	user 0.015s	sys 0.004s
I20260709 13:17:59.751688 15668 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:59.647332 18171 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.737481 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:59.755180 15601 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:17:59.756328 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:59.758714 18151 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:59.759604 18169 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:59.751715 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:17:59.763191 18180 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.733942 15597 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:17:59.669046 18069 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.743013 18136 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:59.732627 17924 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:17:59.746995 18110 log.cc:927] Time spent T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.556s	user 0.009s	sys 0.012s
I20260709 13:17:59.739470 17854 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:59.768741 15597 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:17:59.730487 18016 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:17:59.763950 18180 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.780457 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 477) took 2374 ms. Trace:
I20260709 13:17:59.788154 15744 rpcz_store.cc:276] 0709 13:17:57.406268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.407315 (+  1047us) service_pool.cc:224] Handling call
0709 13:17:57.407588 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.407899 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.407926 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.408360 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.945935 (+537575us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:57.945997 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.946092 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.746125 (+1800033us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:17:59.780057 (+ 33932us) raft_consensus.cc:1685] finished
0709 13:17:59.780086 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.780372 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7044,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":89,"spinlock_wait_cycles":12201344,"thread_start_us":537131,"threads_started":1,"wal-append.queue_time_us":676685}
I20260709 13:17:59.789827 17753 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.790261 18164 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:17:59.791230 17854 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.793608 18140 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.763239 15593 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:59.795964 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1676) took 1023 ms. Trace:
I20260709 13:17:59.796458 15593 rpcz_store.cc:276] 0709 13:17:58.772349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.762245 (+989896us) service_pool.cc:224] Handling call
0709 13:17:59.762978 (+   733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.795575 (+ 32597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.795881 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:59.688220 18157 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.766621 18145 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:17:59.752518 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1686) took 1082 ms. Trace:
I20260709 13:17:59.787595 18016 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.787050 18056 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.802168 18151 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:17:59.822641 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 1999) took 1607 ms. Trace:
I20260709 13:17:59.823215 18180 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.826121 15748 rpcz_store.cc:276] 0709 13:17:58.216944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.217064 (+   120us) service_pool.cc:224] Handling call
0709 13:17:58.252677 (+ 35613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.078616 (+825939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.822338 (+743722us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54003de854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:17:59.822556 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1894157056}
I20260709 13:17:59.829623 18074 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.823752 18132 raft_consensus.cc:3055] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:59.846513 18132 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:17:59.829777 18069 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.809561 17965 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.823962 18075 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.839453 18145 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.840885 18142 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.842947 18157 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.847568 18132 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.844683 18056 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.853490 18056 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:59.845685 18151 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.855032 18171 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:17:59.855381 18151 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:17:59.850373 18149 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:17:59.870064 18020 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.240s	user 0.011s	sys 0.000s
I20260709 13:17:59.870983 18020 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.874106 18020 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.876482 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:17:59.877574 15600 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:17:59.867803 18011 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.486s	user 0.012s	sys 0.001s
W20260709 13:17:59.868170 17993 consensus_meta.cc:287] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 1.100s	user 0.014s	sys 0.001s
W20260709 13:17:59.884119 15567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.101s	sys 0.099s
I20260709 13:17:59.812413 15668 rpcz_store.cc:276] 0709 13:17:58.670287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.766346 (+ 96059us) service_pool.cc:224] Handling call
0709 13:17:58.766731 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.752156 (+985425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.752439 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:59.888772 15567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.101s	sys 0.099s
W20260709 13:17:59.881515 17839 consensus_meta.cc:287] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.805s	user 0.009s	sys 0.003s
W20260709 13:17:59.890504 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 740504us
W20260709 13:17:59.888978 15566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.017s	sys 0.054s
W20260709 13:17:59.892266 15566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.017s	sys 0.054s
W20260709 13:17:59.892678 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.883008 17902 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.036s
I20260709 13:17:59.892953 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:17:59.880105 18075 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:17:59.905490 15567 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:17:59.897068 17902 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.000s	sys 0.037s
I20260709 13:17:59.913630 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:17:59.887993 16299 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:17:59.936133 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:17:59.903671 18039 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:59.888460 18011 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:17:59.950120 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.895172 17839 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.915448 18165 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:59.911006 18164 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:17:59.890842 17993 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.951122 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 613) took 1161 ms. Trace:
I20260709 13:17:59.913044 18075 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:17:59.958564 17816 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.941926 17945 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.979787 16263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.189s	user 0.002s	sys 0.047s
I20260709 13:17:59.960234 18039 raft_consensus.cc:697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:17:59.978776 18149 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:17:59.981467 16299 rpcz_store.cc:276] 0709 13:17:58.789517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.792030 (+  2513us) service_pool.cc:224] Handling call
0709 13:17:59.876271 (+1084241us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:17:59.944014 (+ 67743us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33506560}
I20260709 13:17:59.970046 17902 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.985368 16263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.002s	sys 0.047s
W20260709 13:17:59.989777 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 1.19949e+06us
W20260709 13:17:59.991148 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 414641us
I20260709 13:17:59.976496 18165 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.973794 18177 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.994038 15671 raft_consensus.cc:2368] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:17:59.992765 15642 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:17:59.987525 15594 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:59.979830 18184 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:59.987044 18056 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.000841 18165 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.013712 17839 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:00.022329 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1674) took 1250 ms. Trace:
I20260709 13:18:00.034950 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:00.022610 15642 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:00.025758 15595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.034s	sys 0.046s
I20260709 13:18:00.027617 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:00.036432 15595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.034s	sys 0.047s
I20260709 13:18:00.029733 15748 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:00.040655 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:00.040932 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:00.035059 15602 rpcz_store.cc:276] 0709 13:17:58.771799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.077458 (+305659us) service_pool.cc:224] Handling call
0709 13:17:59.156124 (+ 78666us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:59.378352 (+222228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.378407 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:59.379216 (+   809us) log.cc:844] Serialized 52 byte log entry
0709 13:17:59.709286 (+330070us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:59.709341 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.709438 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.022036 (+312598us) raft_consensus.cc:1685] finished
0709 13:18:00.022055 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.022263 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183514,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":499382,"threads_started":2,"wal-append.queue_time_us":530370}
I20260709 13:18:00.044960 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:00.045599 16310 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:59.990298 17816 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.990520 17945 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:17:59.996825 17951 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:00.049774 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:00.051537 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:00.008673 17902 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.012054 18039 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.065140 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.033416 18180 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.209543 17902 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:00.139014 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 87552.5us
I20260709 13:18:00.139729 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:00.170372 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 124790us
I20260709 13:18:00.340337 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:00.258682 18035 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.008373 18177 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.172169 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.345978 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:00.039817 18056 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.209367 18132 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.206387 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1680) took 1551 ms. Trace:
I20260709 13:18:00.063905 18176 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.297s
I20260709 13:18:00.139807 18157 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:00.139680 17839 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.206665 18075 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:00.205912 18186 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.063930 17935 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:00.206328 18156 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.190351 18185 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:00.039765 18076 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:00.141664 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:00.359422 18093 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.129276 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:00.152413 16310 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:00.208002 17993 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:00.148882 18094 consensus_meta.cc:287] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.002s
I20260709 13:18:00.043015 18149 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.047435 18080 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:00.126933 15673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1674) took 1493 ms (client timeout 1938 ms). Trace:
I20260709 13:18:00.218247 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1675) took 1446 ms. Trace:
W20260709 13:18:00.313961 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.027s	sys 0.060s
W20260709 13:18:00.321157 17973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.007s	user 0.005s	sys 0.026s
W20260709 13:18:00.324384 15593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.033s	sys 0.049s
I20260709 13:18:00.347389 15672 rpcz_store.cc:276] 0709 13:17:58.654765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.750170 (+ 95405us) service_pool.cc:224] Handling call
0709 13:17:58.784169 (+ 33999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.341070 (+556901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.206111 (+865041us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54000834d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:00.206326 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947419904}
W20260709 13:18:00.421797 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.027s	sys 0.062s
I20260709 13:18:00.352051 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 357) took 1770 ms. Trace:
I20260709 13:18:00.330513 18011 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:00.353195 17804 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:00.391607 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:00.354290 18016 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 13:18:00.354382 17816 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:00.354658 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:00.356148 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.356820 15642 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:00.393812 15749 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:00.204773 18183 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:00.404459 15669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.006s	sys 0.032s
I20260709 13:18:00.358345 18035 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:18:00.409005 15673 rpcz_store.cc:269] 0709 13:17:58.573189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.574877 (+  1688us) service_pool.cc:224] Handling call
0709 13:18:00.064534 (+1489657us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54001a6654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:00.066487 (+  1953us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265277696}
I20260709 13:18:00.439483 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.440193 15602 raft_consensus.cc:2393] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:00.422271 15599 rpcz_store.cc:276] 0709 13:17:58.582021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.582132 (+   111us) service_pool.cc:224] Handling call
0709 13:17:58.582455 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:58.582778 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.582806 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:58.608423 (+ 25617us) log.cc:844] Serialized 52 byte log entry
0709 13:17:59.813020 (+1204597us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b18003777a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1 00007faefe6aba0f
0709 13:18:00.020665 (+207645us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:00.036625 (+ 15960us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.043321 (+  6696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.043426 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.351667 (+308241us) raft_consensus.cc:1685] finished
0709 13:18:00.351783 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.351978 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2863,"prepare.queue_time_us":19166,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":11253,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":27287040,"thread_start_us":196063,"threads_started":1,"wal-append.queue_time_us":1740681}
I20260709 13:18:00.440999 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.405722 17839 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:00.359495 18180 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.433373 15714 leader_election.cc:400] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:18:00.445639 15714 leader_election.cc:403] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.361361 18157 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:00.426337 17973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.120s	user 0.005s	sys 0.026s
W20260709 13:18:00.426537 15593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.033s	sys 0.049s
W20260709 13:18:00.405627 18147 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.000s	sys 0.028s
W20260709 13:18:00.437137 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 80431.1us
I20260709 13:18:00.467818 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:00.439035 18149 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:00.353294 17945 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.421953 18080 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:00.390025 18186 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:00.428521 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:00.437089 17902 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.431766 17860 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:00.438176 15669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.032s
I20260709 13:18:00.454288 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.455535 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:00.403615 18185 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.408499 18094 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.469549 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:00.441744 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.447266 17839 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.487947 17945 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:00.486663 16305 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:00.493229 17945 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:00.493721 17945 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.494169 18185 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.494184 15601 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:00.496042 18185 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:00.496873 16299 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:00.496708 17902 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.488507 18056 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:00.498828 17902 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.499346 18200 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:00.499905 18200 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.471223 16309 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:00.473894 18102 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.502110 18200 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:00.405882 18076 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.502584 18035 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.437472 18016 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.504439 18076 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:00.466504 18147 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.000s	sys 0.029s
I20260709 13:18:00.443368 18183 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:00.505808 18183 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.506094 18016 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:00.421108 15594 rpcz_store.cc:276] 0709 13:17:58.772079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.168490 (+396411us) service_pool.cc:224] Handling call
0709 13:17:59.501854 (+333364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.031951 (+530097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.217861 (+185910us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400247a54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:00.218149 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083015936}
I20260709 13:18:00.507787 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:00.509389 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:00.509503 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:00.510226 15594 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.510913 15642 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:00.512332 18149 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.487443 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:00.514822 15673 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:00.502197 17839 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:00.515305 15672 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:18:00.515331 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:00.520080 15714 leader_election.cc:400] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:18:00.524482 15672 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:00.525779 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:00.470523 18191 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.481336 18080 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.521751 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:00.487507 18177 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:00.523181 18102 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:00.531342 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:00.488865 18157 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:00.531580 15596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1663) took 1891 ms (client timeout 2120 ms). Trace:
I20260709 13:18:00.551724 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:00.533200 15597 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:18:00.525252 18035 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:00.527699 17902 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:00.531852 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1879) took 1016 ms. Trace:
I20260709 13:18:00.551736 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.554064 15673 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:00.552495 15674 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:00.496080 18094 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:00.552452 15597 pending_rounds.cc:85] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 4
I20260709 13:18:00.564185 15597 pending_rounds.cc:107] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:18:00.564575 15597 raft_consensus.cc:2889] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:00.550930 15596 rpcz_store.cc:269] 0709 13:17:58.640588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.657325 (+ 16737us) service_pool.cc:224] Handling call
0709 13:18:00.531358 (+1874033us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b540020ba54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:00.531517 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688810368}
I20260709 13:18:00.566834 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:00.555843 15747 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:00.519028 18185 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.561935 18180 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.547966 18151 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:00.562989 18198 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:18:00.567893 15747 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:00.552861 18102 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:00.513456 18165 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.569797 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1448) took 1057 ms. Trace:
I20260709 13:18:00.565203 17902 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.571435 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.572850 15672 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:18:00.574493 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:00.573320 18193 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:18:00.555601 15676 rpcz_store.cc:276] 0709 13:17:59.515668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.515814 (+   146us) service_pool.cc:224] Handling call
0709 13:17:59.516155 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.641040 (+124885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.641084 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:59.641140 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:59.641188 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.531626 (+890438us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000843d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:00.531674 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.531797 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286611328}
I20260709 13:18:00.516810 17860 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.579393 15747 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.580369 18034 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:00.580467 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:00.582170 18185 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.582736 18151 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.583766 15674 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:00.584359 18148 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:00.545292 18056 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:00.703862 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:00.702756 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.705067 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 110357us
I20260709 13:18:00.704373 15673 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:00.607719 15596 rpcz_store.cc:276] 0709 13:17:59.512588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.568789 (+1056201us) service_pool.cc:224] Handling call
0709 13:18:00.569145 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.569356 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.569392 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.569451 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.569499 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.569571 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.569725 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.605608 18102 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:00.709301 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.713819 15747 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:00.716678 16310 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:00.668223 17902 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:00.730631 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.731873 16310 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:00.732231 16307 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:18:00.724893 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 193635us
I20260709 13:18:00.728820 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1449) took 1215 ms. Trace:
I20260709 13:18:00.733315 15596 rpcz_store.cc:276] 0709 13:17:59.512907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.728122 (+1215215us) service_pool.cc:224] Handling call
0709 13:18:00.728361 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.728502 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.728525 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.728559 (+    34us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:00.728587 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.728672 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.728769 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.735095 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1451) took 1063 ms. Trace:
I20260709 13:18:00.735466 15596 rpcz_store.cc:276] 0709 13:17:59.671583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.734279 (+1062696us) service_pool.cc:224] Handling call
0709 13:18:00.734566 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.734756 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:00.734781 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.734825 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:00.734864 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.734924 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.735040 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:00.737001 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:00.719673 18127 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:00.752723 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.754585 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:00.721274 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:00.759130 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1668) took 2071 ms (client timeout 1886 ms). Trace:
W20260709 13:18:00.759694 15598 rpcz_store.cc:269] 0709 13:17:58.687232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.779989 (+ 92757us) service_pool.cc:224] Handling call
0709 13:18:00.758864 (+1978875us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54003192d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:00.759029 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858659072}
I20260709 13:18:00.771108 15747 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:00.728763 18205 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:00.789096 18205 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:00.790364 18179 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.750s	user 0.005s	sys 0.000s
I20260709 13:18:00.723237 15743 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:00.784418 16307 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:00.729166 18186 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:00.843025 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 106115us
I20260709 13:18:00.830473 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:00.794771 15598 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:00.856971 18207 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:18:00.857142 18165 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:00.798611 18039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.013s	sys 0.053s
W20260709 13:18:00.857920 18039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.022s	sys 0.062s
I20260709 13:18:00.858453 15594 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:00.822036 17804 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:00.794389 18056 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:18:00.841778 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 87309.6us
I20260709 13:18:00.862308 16310 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
W20260709 13:18:00.854404 18201 log.cc:927] Time spent T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:00.741186 18035 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:00.842402 18148 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:00.876071 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:00.875135 15642 connection.cc:256] RPC call timeout handler was delayed by -1.3433736370000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:18:00.874657 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:00.877161 15642 connection.cc:256] RPC call timeout handler was delayed by -1.2524736370000937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
I20260709 13:18:00.861891 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:00.878619 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.879222 15673 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:00.879839 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:00.880419 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.877699 18206 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:18:00.881053 18208 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:00.881929 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.883538 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.884131 15673 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:18:00.886296 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.886912 15673 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:00.887220 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.871657 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1862) took 2411 ms. Trace:
I20260709 13:18:00.888482 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:00.890976 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:00.892246 15674 raft_consensus.cc:2376] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:18:00.876924 18186 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.877816 17860 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.897491 18151 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.897807 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1673) took 2155 ms. Trace:
I20260709 13:18:00.898336 15600 rpcz_store.cc:276] 0709 13:17:58.742062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.019820 (+277758us) service_pool.cc:224] Handling call
0709 13:17:59.020175 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.882512 (+862337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.897505 (+1014993us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b540020b2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:00.897719 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971281664}
I20260709 13:18:00.891649 15669 rpcz_store.cc:276] 0709 13:17:58.460658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.460887 (+   229us) service_pool.cc:224] Handling call
0709 13:17:59.852965 (+1392078us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:17:59.853126 (+   161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:59.882888 (+ 29762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.884541 (+  1653us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:59.886885 (+  2344us) log.cc:844] Serialized 26 byte log entry
0709 13:18:00.497827 (+610942us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:00.737142 (+239315us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.804281 (+ 67139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.820928 (+ 16647us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:00.821016 (+    88us) raft_consensus.cc:1685] finished
0709 13:18:00.862285 (+ 41269us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.868402 (+  6117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24779,"prepare.queue_time_us":387620,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":40,"raft.queue_time_us":71381,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":27610,"spinlock_wait_cycles":5671168,"thread_start_us":841891,"threads_started":2,"wal-append.queue_time_us":686757}
I20260709 13:18:00.883260 18056 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:18:00.884797 18202 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:00.875802 18185 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:18:00.906332 17736 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:18:00.907104 18208 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:00.914829 18208 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.915336 18208 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.904951 18186 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.923729 18186 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:00.891495 18213 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:00.927634 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:00.937068 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 57297.3us
I20260709 13:18:00.937939 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:00.939061 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:00.939011 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:00.942189 18076 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:00.943387 17680 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:00.943830 17680 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:00.944180 17680 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:00.942092 15677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1867) took 2421 ms (client timeout 2022 ms). Trace:
W20260709 13:18:00.945055 15677 rpcz_store.cc:269] 0709 13:17:58.519109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.519266 (+   157us) service_pool.cc:224] Handling call
0709 13:18:00.940092 (+2420826us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b5400364a54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:00.940195 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600210304}
I20260709 13:18:00.945428 18202 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:00.945920 18202 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:00.913600 18035 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.946872 18202 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:00.948702 18145 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.010s	sys 0.026s
W20260709 13:18:00.949110 18145 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.010s	sys 0.026s
W20260709 13:18:00.950958 16295 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 681) took 2886 ms (client timeout 1618 ms). Trace:
W20260709 13:18:00.951400 16295 rpcz_store.cc:269] 0709 13:17:58.064440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.083463 (+ 19023us) service_pool.cc:224] Handling call
0709 13:17:58.409608 (+326145us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:00.950740 (+2541132us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5400564354. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:00.950858 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135765632}
W20260709 13:18:00.955852 18190 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.805s	user 0.004s	sys 0.000s
I20260709 13:18:00.957291 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 598) took 2442 ms. Trace:
I20260709 13:18:00.945987 18205 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.958668 18149 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:00.959772 18132 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260709 13:18:00.959443 17945 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.961674 18183 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:00.962566 17945 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:00.963869 18183 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:00.964759 15599 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:00.966346 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1444) took 1594 ms. Trace:
I20260709 13:18:00.966806 15601 rpcz_store.cc:276] 0709 13:17:59.372253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.755973 (+383720us) service_pool.cc:224] Handling call
0709 13:18:00.966106 (+1210133us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54003903d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:00.966274 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694906112}
I20260709 13:18:00.944450 18076 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:00.968979 18076 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:00.969425 18076 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:00.969796 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.970350 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.970290 18125 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:00.957751 16309 rpcz_store.cc:276] 0709 13:17:58.514632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.515208 (+   576us) service_pool.cc:224] Handling call
0709 13:17:58.515503 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.500871 (+1985368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.957033 (+456162us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54004a60d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:00.957224 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4497318784}
I20260709 13:18:00.975282 16307 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
W20260709 13:18:00.985510 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.988039 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:00.949250 18191 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:18:01.003301 15747 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:18:01.007884 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 68846.5us
I20260709 13:18:01.009020 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.009559 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:00.978662 18185 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:01.009713 15747 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:00.978102 18149 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:00.966634 18102 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:00.986385 18145 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.997606 18213 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.035238 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 96341.9us
I20260709 13:18:01.013880 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:01.034121 17860 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:01.056263 17860 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:01.057749 18194 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.857s	user 0.003s	sys 0.002s
I20260709 13:18:01.049193 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:01.054209 18145 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:01.054917 18215 log.cc:927] Time spent T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:18:01.055531 18216 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:18:01.055018 18213 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.009799 18212 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:01.008148 18056 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:01.059216 17860 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:01.049059 18132 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:01.011159 18151 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:01.048951 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:01.105309 15671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1683) took 2442 ms (client timeout 1671 ms). Trace:
I20260709 13:18:01.093078 16265 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:01.105801 15671 rpcz_store.cc:269] 0709 13:17:58.662881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.693189 (+ 30308us) service_pool.cc:224] Handling call
0709 13:18:01.090148 (+2396959us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54000839d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:01.105227 (+ 15079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2115576064}
I20260709 13:18:01.044710 17902 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:01.046762 18185 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.065784 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.052992 18149 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:01.136435 18149 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.104662 18180 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:18:01.060097 18208 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.081360 18186 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:01.114972 18213 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:01.118393 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.121830 18102 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.122012 17902 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:01.087011 18212 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:01.122920 17680 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.123950 18185 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:01.088240 18056 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:01.125325 18080 consensus_meta.cc:287] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.002s
I20260709 13:18:01.126266 18223 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:01.126645 18132 raft_consensus.cc:697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:01.130607 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.131033 18221 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.131950 17651 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:01.132746 16265 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:01.160730 18080 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.166106 17651 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:01.166607 18080 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:01.166700 17651 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:01.167452 17651 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.168375 15602 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:01.170305 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 366) took 1139 ms. Trace:
I20260709 13:18:01.170500 18212 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:01.170697 15602 rpcz_store.cc:276] 0709 13:18:00.031228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.444473 (+413245us) service_pool.cc:224] Handling call
0709 13:18:01.170121 (+725648us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400247f54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:01.170242 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568600832}
I20260709 13:18:01.172246 18208 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:01.172492 15716 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:01.147142 18186 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:01.173237 18132 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.174993 18186 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.175654 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1679) took 1797 ms. Trace:
I20260709 13:18:01.176036 15597 rpcz_store.cc:276] 0709 13:17:59.378157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.778820 (+400663us) service_pool.cc:224] Handling call
0709 13:18:00.532715 (+753895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:00.565663 (+ 32948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.175467 (+609804us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b540020ba50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:01.175595 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726224256}
I20260709 13:18:01.176877 18056 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:01.179077 18035 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:01.163203 18221 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.180755 18221 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.180878 18035 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:01.181836 16308 raft_consensus.cc:2410] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:01.182061 16305 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:01.182384 17973 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.182957 17973 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.184007 17945 consensus_queue.cc:1059] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:01.134055 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.112035 17854 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:01.207297 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.208427 16310 raft_consensus.cc:2393] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:01.209132 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.158648 16309 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:01.133159 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:01.184784 18127 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:01.134034 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:01.185909 15716 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:01.188270 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.110864 18151 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.155965 18145 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.226969 15674 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.239456 15674 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:01.191990 18174 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:01.250013 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.250732 15671 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:18:01.251642 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.252409 15675 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:01.243741 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:01.259778 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.259900 15676 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.261248 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.261974 15675 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:18:01.262755 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.264103 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.264892 15671 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:01.180788 18191 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:18:01.297329 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.224124 18127 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:01.201908 18186 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:18:01.225497 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.181876 18035 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:18:01.206833 17854 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:01.299106 15672 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:01.301894 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.242193 17945 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:01.313388 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.299719 18185 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:01.314312 18185 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:01.309520 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 615) took 1274 ms. Trace:
I20260709 13:18:01.315237 18213 raft_consensus.cc:3055] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:01.310721 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.315732 18213 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:01.311594 18208 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.317282 15672 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:18:01.317133 18208 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.319432 18208 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.320751 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1455) took 1471 ms. Trace:
I20260709 13:18:01.321127 15599 rpcz_store.cc:276] 0709 13:17:59.849006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.441589 (+592583us) service_pool.cc:224] Handling call
0709 13:18:01.320540 (+878951us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54001d7c54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:01.320679 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074055936}
I20260709 13:18:01.315455 16299 rpcz_store.cc:276] 0709 13:18:00.034837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.039473 (+  4636us) service_pool.cc:224] Handling call
0709 13:18:01.308537 (+1269064us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400600ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:01.309453 (+   916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342830336}
I20260709 13:18:01.313575 17945 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.321961 18125 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:01.322485 17945 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.297292 18174 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.307464 17973 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.315255 18185 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:01.329594 16308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 611) took 2540 ms (client timeout 2116 ms). Trace:
I20260709 13:18:01.315549 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.336634 17680 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.325491 18174 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.338020 17854 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.338577 18151 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:01.339728 18127 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.341487 18127 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.345199 18076 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.348181 18076 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.336251 16305 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:01.329893 18213 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.356526 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.320530 18221 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:01.330245 16308 rpcz_store.cc:269] 0709 13:17:58.788931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.789058 (+   127us) service_pool.cc:224] Handling call
0709 13:18:01.329321 (+2540263us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400402ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:01.329498 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4965389184}
I20260709 13:18:01.358019 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.389773 18019 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:01.390437 18019 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.390759 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.391636 15669 raft_consensus.cc:2368] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:01.391723 18221 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.360554 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.392944 15675 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:01.396359 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 251798us
I20260709 13:18:01.360960 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.366750 17651 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.374920 15672 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.376410 18213 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:01.376817 18102 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:01.379132 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.429101 15676 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:01.379914 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.380321 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.431720 15670 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:01.434554 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.430055 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.436796 15676 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:18:01.379954 17945 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.397398 15673 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:18:01.415313 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.419145 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:01.424206 15675 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:01.447851 15672 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
W20260709 13:18:01.449779 15565 connection.cc:256] RPC call timeout handler was delayed by -1.1350887159999274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
I20260709 13:18:01.424021 18096 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:01.456880 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:01.458009 16306 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 616) took 1422 ms (client timeout 1783 ms). Trace:
W20260709 13:18:01.458418 16306 rpcz_store.cc:269] 0709 13:18:00.035304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.036073 (+   769us) service_pool.cc:224] Handling call
0709 13:18:01.415173 (+1379100us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:01.457942 (+ 42769us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19134848}
I20260709 13:18:01.392586 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.450951 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.458750 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.459501 15673 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.459576 15675 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:01.457890 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:01.460872 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.463796 15672 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:01.453744 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:01.468852 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.469484 15670 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.478931 15673 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:01.485304 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.486217 15675 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:01.487828 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:01.490645 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.432960 17839 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:01.432684 17816 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:01.494330 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.497319 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.497599 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.498288 15746 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:01.500684 15749 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
W20260709 13:18:01.500967 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.501425 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.501956 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.502504 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.498154 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.503755 15673 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.504091 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.498879 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.505118 15750 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:01.507982 17839 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:01.509987 15671 raft_consensus.cc:2410] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:01.502050 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.512815 15748 raft_consensus.cc:2368] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:01.455659 15668 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:01.483711 17973 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:01.521147 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:01.525491 15746 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.491400 18200 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:01.493599 18069 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:01.489919 18151 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:01.496521 17951 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:01.533082 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:01.491057 18019 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:01.457551 18186 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:18:01.535323 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.574205 15748 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:01.575078 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:01.575170 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.531514 15673 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:01.539234 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.541981 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.558921 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.576083 15674 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:01.547632 15745 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.576363 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.518622 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1447) took 2006 ms. Trace:
I20260709 13:18:01.548934 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.576215 15749 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:18:01.549476 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.551218 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.587536 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.549049 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.588430 15599 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:01.555177 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.550405 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.586812 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:01.577895 15748 raft_consensus.cc:2368] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:01.586994 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.590278 15750 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:01.590677 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.591466 15601 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
I20260709 13:18:01.531644 15670 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:01.589282 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:01.587564 15597 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:01.593567 15599 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:01.594756 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.595243 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.580996 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:01.577013 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.483520 18096 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.589354 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:01.518617 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.622164 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:01.623111 15668 raft_consensus.cc:2368] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6.
I20260709 13:18:01.623544 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:01.624486 15669 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:01.576962 15673 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:01.625747 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:01.626876 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.627802 15594 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:01.519007 18180 consensus_queue.cc:1059] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:01.597184 15749 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:01.597450 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:01.580286 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 126624us
I20260709 13:18:01.617738 15750 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:18:01.606901 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 48429.1us
W20260709 13:18:01.606983 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.517562 17816 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:01.539271 17935 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:01.592700 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:01.608067 16308 raft_consensus.cc:2368] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:18:01.546087 18200 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:01.546483 18080 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:01.709719 15745 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:02.019006 16307 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:01.605329 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 355) took 3056 ms. Trace:
I20260709 13:18:02.019654 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:01.573680 17902 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:01.630750 15598 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
W20260709 13:18:02.012226 15714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.671s (SENT) [suppressed 9 similar messages]
W20260709 13:18:01.653004 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.014134 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:01.857897 15599 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:02.013558 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:02.193301 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.194161 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.140758 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:02.051515 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.769454 15674 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:02.194406 15602 raft_consensus.cc:2368] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:02.041543 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.193969 15745 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:02.197160 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:02.197832 15750 raft_consensus.cc:2393] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:02.198532 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:01.876060 15567 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:02.196435 15748 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:18:02.109043 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.202905 15742 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:02.204284 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.205166 15745 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
W20260709 13:18:02.205272 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 329320us
I20260709 13:18:02.020476 15746 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
W20260709 13:18:02.050551 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.628206 17651 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.578052 18020 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:01.936079 18230 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.404s	user 0.000s	sys 0.000s
I20260709 13:18:01.585389 17951 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:02.137992 17816 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.123481 17935 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.958058 18127 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.000s
I20260709 13:18:01.573524 18151 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:01.938015 18034 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.317s
I20260709 13:18:01.740147 18164 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.626871 18096 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:01.937836 18233 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.360s	user 0.000s	sys 0.000s
I20260709 13:18:02.108356 18076 raft_consensus.cc:3055] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:01.595387 18175 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:01.956440 17945 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:01.755062 18075 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.858623 18051 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.858155 18011 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:02.191237 15595 rpcz_store.cc:276] 0709 13:17:58.548416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.548542 (+   126us) service_pool.cc:224] Handling call
0709 13:17:58.548905 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:58.549362 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.549390 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:58.550004 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:17:58.781910 (+231906us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:59.076817 (+294907us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.126473 (+1049656us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.389389 (+1262916us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800432fa0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:01.593251 (+203862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.593331 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:01.604979 (+ 11648us) raft_consensus.cc:1685] finished
0709 13:18:01.605019 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.605244 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10077,"prepare.queue_time_us":608060,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":1518386,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":346,"spinlock_wait_cycles":25588992,"thread_start_us":1649451,"threads_started":5,"wal-append.queue_time_us":587739,"wal-append.run_cpu_time_us":5869,"wal-append.run_wall_time_us":2052735}
W20260709 13:18:02.275568 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 69134.6us
W20260709 13:18:02.323824 15642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.016s	sys 0.019s
I20260709 13:18:01.586086 15593 rpcz_store.cc:276] 0709 13:17:59.512285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.798927 (+286642us) service_pool.cc:224] Handling call
0709 13:17:59.799289 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.811503 (+ 12214us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:59.823368 (+ 11865us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.454109 (+1630741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.457489 (+  3380us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:01.484398 (+ 26909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.493622 (+  9224us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.514491 (+ 20869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1068222,"prepare.queue_time_us":10496,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":980372,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":14201,"thread_start_us":629766,"threads_started":1,"wal-append.queue_time_us":611644,"wal-append.run_cpu_time_us":2233,"wal-append.run_wall_time_us":1283270}
W20260709 13:18:02.366762 15743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.016s	sys 0.097s
I20260709 13:18:02.470477 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 424) took 1432 ms. Trace:
W20260709 13:18:02.471318 15744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.017s	sys 0.034s
I20260709 13:18:02.471376 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 512) took 1229 ms. Trace:
I20260709 13:18:02.473503 15751 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:02.220669 18080 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.533095 15747 rpcz_store.cc:276] 0709 13:18:01.241968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.243019 (+  1051us) service_pool.cc:224] Handling call
0709 13:18:01.243352 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.593549 (+350197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.593578 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.593993 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.786412 (+192419us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:01.786468 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.786567 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.470739 (+684172us) raft_consensus.cc:1685] finished
0709 13:18:02.470777 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.471066 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200918,"raft.queue_time_us":198598,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9509,"thread_start_us":350188,"threads_started":2,"wal-append.queue_time_us":815678}
W20260709 13:18:02.536798 15642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.019s	sys 0.020s
W20260709 13:18:02.537526 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 940663us
I20260709 13:18:01.936905 18016 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.468s
I20260709 13:18:02.538987 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:02.404362 18164 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.547751 15640 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:02.402196 18206 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:02.548905 18039 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:02.549794 18206 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:02.286103 18213 consensus_meta.cc:287] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.853s	user 0.009s	sys 0.002s
I20260709 13:18:02.404938 17935 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.405174 18076 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:02.313212 18020 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.567032 18151 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:02.566823 18076 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.128870 15668 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:02.569808 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:02.574343 18149 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.575212 18149 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:02.575330 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:02.413130 18075 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.532474 15677 rpcz_store.cc:276] 0709 13:18:01.038217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.038345 (+   128us) service_pool.cc:224] Handling call
0709 13:18:01.038652 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.039034 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:01.160113 (+121079us) log.cc:844] Serialized 14 byte log entry
0709 13:18:01.416574 (+256461us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.460576 (+ 44002us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.460736 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:01.460777 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.460838 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.469591 (+1008753us) raft_consensus.cc:1685] finished
0709 13:18:02.469668 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.470109 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9758,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":35,"raft.queue_time_us":827,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":15012,"thread_start_us":360089,"threads_started":2,"wal-append.queue_time_us":335744}
I20260709 13:18:02.578995 18075 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.280915 17854 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:02.528818 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 51752.4us
I20260709 13:18:02.413383 18051 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:02.536087 15743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.016s	sys 0.100s
I20260709 13:18:02.535921 17925 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:02.537748 15744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.018s	sys 0.034s
I20260709 13:18:02.251017 18200 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.587445 17925 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.590842 17925 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.271116 17839 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:01.787425 17804 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.732s
W20260709 13:18:02.544354 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 245752us
I20260709 13:18:02.544927 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:02.584296 15565 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:02.458403 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.222393 17902 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.559971 18148 raft_consensus.cc:2764] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:02.559572 17951 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.561661 18011 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.591528 18051 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.250404 18221 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:02.593595 18164 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.595664 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 513) took 1353 ms. Trace:
I20260709 13:18:02.568266 18020 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.545321 18096 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:02.589320 18149 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:02.615257 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 70807.2us
I20260709 13:18:02.615855 18148 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.624439 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1427) took 1124 ms. Trace:
I20260709 13:18:02.625037 18080 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.626487 17804 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:02.665262 15751 rpcz_store.cc:276] 0709 13:18:01.499647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.503816 (+  4169us) service_pool.cc:224] Handling call
0709 13:18:02.624112 (+1120296us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b5400276fd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:02.624304 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2226496768}
I20260709 13:18:02.665714 17804 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:02.628859 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.667696 17804 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.663059 18096 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.670352 18096 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:02.673686 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:02.629601 18039 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.676930 18039 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.677534 17935 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.677711 18039 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.681186 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.681420 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:02.681932 18213 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:02.682375 16305 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:02.629454 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45429us
I20260709 13:18:02.682727 18213 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:02.633275 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 58274.1us
I20260709 13:18:02.634315 17902 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.637056 17973 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:02.634181 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 621845us
I20260709 13:18:02.639765 18076 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.634186 18206 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:02.663563 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.628901 18102 raft_consensus.cc:2764] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:02.673986 17804 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.638947 18011 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:02.693934 16307 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:02.693987 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.694793 18102 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:02.694696 17973 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.741755 17973 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:02.697052 15714 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.886s (SENT)
I20260709 13:18:02.700774 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46324 (request call id 313) took 7313 ms. Trace:
I20260709 13:18:02.744971 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:02.746392 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 49449.9us
I20260709 13:18:02.747483 17902 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:02.705139 18221 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.751549 18221 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:02.707122 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:02.753116 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 46278.6us
I20260709 13:18:02.754101 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:02.755182 18148 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:02.756331 17839 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:02.756927 17839 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:02.717687 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1694) took 1100 ms. Trace:
I20260709 13:18:02.757643 15598 rpcz_store.cc:276] 0709 13:18:01.557308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.576767 (+ 19459us) service_pool.cc:224] Handling call
0709 13:18:02.597159 (+1020392us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b54000aa354. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:02.658099 (+ 60940us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75954048}
I20260709 13:18:02.684350 15565 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:02.759476 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 75285.6us
I20260709 13:18:02.724547 15751 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:02.725415 18102 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.727377 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2026) took 1145 ms. Trace:
I20260709 13:18:02.659791 15744 rpcz_store.cc:276] 0709 13:18:01.242366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.242941 (+   575us) service_pool.cc:224] Handling call
0709 13:18:01.245479 (+  2538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.592561 (+347082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.592589 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.593067 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.267717 (+674650us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4800150258. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:18:02.587519 (+319802us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:02.587624 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.587792 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.595263 (+  7471us) raft_consensus.cc:1685] finished
0709 13:18:02.595287 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.595582 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190130,"raft.queue_time_us":196547,"raft.run_cpu_time_us":10067,"raft.run_wall_time_us":817416,"spinlock_wait_cycles":29727488,"thread_start_us":975592,"threads_started":2,"wal-append.queue_time_us":904519}
W20260709 13:18:02.709391 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 48462.7us
I20260709 13:18:02.756417 15642 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:02.766218 15565 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:02.766884 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:02.757376 17839 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.771870 18213 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:02.777451 17816 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.778548 17816 raft_consensus.cc:697] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:02.745034 15500 rpcz_store.cc:276] 0709 13:17:55.387693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.397699 (+ 10006us) service_pool.cc:224] Handling call
0709 13:18:02.700381 (+7302682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:59.069641 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:59.468563 (+398922us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:59.491043 (+ 22480us) write_op.cc:435] Acquired schema lock
0709 13:17:59.502472 (+ 11429us) tablet.cc:662] Decoding operations
0709 13:17:59.685733 (+183261us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:59.685815 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:59.685856 (+    41us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:17:59.690660 (+  4804us) tablet.cc:701] Row locks acquired
0709 13:17:59.690691 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:17:59.720058 (+ 29367us) write_op.cc:270] Start()
0709 13:17:59.725202 (+  5144us) write_op.cc:276] Timestamp: P: 1783603079714234 usec, L: 0
0709 13:17:59.728419 (+  3217us) op_driver.cc:348] REPLICATION: starting
0709 13:17:59.833731 (+105312us) log.cc:844] Serialized 4350 byte log entry
0709 13:18:00.793061 (+959330us) op_driver.cc:464] REPLICATION: finished
0709 13:18:00.926572 (+133511us) write_op.cc:301] APPLY: starting
0709 13:18:00.932543 (+  5971us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:01.035912 (+103369us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:01.053160 (+ 17248us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:01.113940 (+ 60780us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:01.114177 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:18:01.114219 (+    42us) write_op.cc:312] APPLY: finished
0709 13:18:01.114511 (+   292us) log.cc:844] Serialized 83 byte log entry
0709 13:18:01.114693 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.114855 (+   162us) write_op.cc:454] Released schema lock
0709 13:18:01.114932 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:01.115321 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.115350 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":731821,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":117614,"apply.run_cpu_time_us":4626,"apply.run_wall_time_us":188737,"num_ops":11,"prepare.queue_time_us":220257,"prepare.run_cpu_time_us":38465,"prepare.run_wall_time_us":1499301,"raft.queue_time_us":234081,"raft.run_cpu_time_us":11453,"raft.run_wall_time_us":93766,"replication_time_us":1061317,"thread_start_us":966719,"threads_started":4,"wal-append.queue_time_us":704158,"wal-append.run_cpu_time_us":14734,"wal-append.run_wall_time_us":1571870}]]}
I20260709 13:18:02.762176 15750 rpcz_store.cc:276] 0709 13:18:01.581448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.199277 (+617829us) service_pool.cc:224] Handling call
0709 13:18:02.199552 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.199887 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.199915 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.200326 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.673060 (+472734us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:02.673193 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.673339 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.726947 (+ 53608us) raft_consensus.cc:1685] finished
0709 13:18:02.726971 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.727163 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2280,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":42429,"thread_start_us":288576,"threads_started":1,"wal-append.queue_time_us":401855}
I20260709 13:18:02.783769 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.784372 17839 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.771885 18102 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.786782 17839 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:02.796432 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:02.797339 15744 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:02.804347 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 451261us
I20260709 13:18:02.805701 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:02.787925 15565 leader_election.cc:400] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6.
I20260709 13:18:02.787261 18016 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:02.809054 18213 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:02.807402 18261 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.143s	user 0.000s	sys 0.004s
I20260709 13:18:02.807325 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:02.815723 15565 leader_election.cc:403] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:18:02.818392 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.822129 18016 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:02.822641 18051 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.823973 18016 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.825337 18164 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:02.825778 15567 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:02.824883 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.828305 18164 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:02.822283 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 53821.8us
I20260709 13:18:02.831319 15565 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:02.832739 18259 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:02.833336 18259 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.833846 18259 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:02.837224 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:02.838778 18020 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:02.839128 18255 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.839406 18020 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:02.839735 18255 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.840205 15747 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:02.841205 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.840873 18020 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.843494 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:02.856387 15750 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:02.858667 17839 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:02.859422 17839 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.831923 18039 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.860538 18245 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:02.880954 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.880256 18051 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6.
I20260709 13:18:02.891263 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:02.845571 18213 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.894731 18148 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:02.900420 18148 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.902644 16305 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:02.906083 15746 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:02.906703 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 150457us
I20260709 13:18:02.869814 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 510) took 1698 ms. Trace:
I20260709 13:18:02.905321 18148 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:02.912371 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 44936.2us
I20260709 13:18:02.923543 17854 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.815178 17816 consensus_queue.cc:237] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.933207 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1889) took 1468 ms. Trace:
I20260709 13:18:02.913698 15743 rpcz_store.cc:276] 0709 13:18:01.171857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.191672 (+ 19815us) service_pool.cc:224] Handling call
0709 13:18:01.226108 (+ 34436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.875408 (+649300us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4800150258. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:18:02.585106 (+709698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.585234 (+   128us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.586118 (+   884us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.662747 (+ 76629us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:02.690753 (+ 28006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.763292 (+ 72539us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.816844 (+ 53552us) raft_consensus.cc:1685] finished
0709 13:18:02.816873 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.867909 (+ 51036us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181508,"raft.queue_time_us":157815,"raft.run_cpu_time_us":2995,"raft.run_wall_time_us":482435,"spinlock_wait_cycles":36572416,"thread_start_us":1203730,"threads_started":2,"wal-append.queue_time_us":182438}
I20260709 13:18:02.933816 15670 rpcz_store.cc:276] 0709 13:18:01.446616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.595561 (+148945us) service_pool.cc:224] Handling call
0709 13:18:02.295062 (+699501us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:02.295351 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.542893 (+247542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.554859 (+ 11966us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.570380 (+ 15521us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.655051 (+ 84671us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:02.655083 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.656860 (+  1777us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.806001 (+149141us) spinlock_profiling.cc:243] Waited 58.1 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:02.914344 (+108343us) raft_consensus.cc:1685] finished
0709 13:18:02.914373 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.914513 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21215,"raft.queue_time_us":229201,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":447,"spinlock_wait_cycles":153171968,"thread_start_us":84142,"threads_started":1,"wal-append.queue_time_us":92838}
I20260709 13:18:02.926062 18102 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:02.944391 15750 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:02.945289 17839 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:02.938961 18102 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.966473 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:02.968057 18102 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:02.970254 18148 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:02.971051 18245 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:02.970996 18148 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.971812 18245 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.973282 18183 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.973691 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.974181 18183 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:02.974583 15599 raft_consensus.cc:2393] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:02.975550 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.975485 18183 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.978854 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.978987 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.979202 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:02.980122 18019 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:02.936543 17935 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:02.980626 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:02.981528 15602 raft_consensus.cc:2368] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:02.982896 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.983472 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.983855 18127 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:02.981094 17935 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:02.986572 17902 consensus_queue.cc:1059] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:02.987056 15716 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:02.989100 18127 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:02.989765 18127 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:02.990259 18127 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:02.980523 18019 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:02.991844 18019 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:02.937142 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:02.991315 18127 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.962831 17854 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:02.937009 15496 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 4, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 4 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.009549 17902 consensus_queue.cc:1243] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:02.949342 18255 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:03.012174 15642 leader_election.cc:400] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:03.014540 15642 leader_election.cc:403] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.005024 18102 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:03.017922 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.019495 15744 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:02.991863 17935 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:03.033504 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.021406 15496 catalog_manager.cc:5697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:03.032922 17902 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:03.054072 18245 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.055133 18148 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.032298 18102 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.049261 15496 catalog_manager.cc:5697] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 5, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:03.042569 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.066454 15496 catalog_manager.cc:5697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:03.073551 15496 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 5, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 5 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:03.047638 17935 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.075634 15496 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 4, term changed from 4 to 6, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65), VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66), VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67), VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 6 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:18:03.085145 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.085747 18278 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:03.085911 15594 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:03.086486 18278 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.088938 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:03.089788 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50410.6us
I20260709 13:18:03.050964 17902 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:03.082378 15496 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 4, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:03.105163 15496 catalog_manager.cc:5697] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 5, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:03.056247 18019 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.108481 15496 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:03.111925 15567 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.118288 15496 catalog_manager.cc:5697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:03.119704 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.138060 15598 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:03.119271 18213 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:03.141078 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 181243us
W20260709 13:18:03.143631 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.136215 15496 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 5, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
W20260709 13:18:03.147542 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.149701 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:03.150028 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.151021 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.152870 18255 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:03.153316 18255 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.153682 18255 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:03.153808 18076 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.136783 17816 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.168883 17816 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:03.169334 17816 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.169225 17902 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.170423 17902 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.141664 18278 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:03.181082 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 91133.8us
I20260709 13:18:03.197782 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:03.198453 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.193518 18096 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.522s	user 0.013s	sys 0.003s
I20260709 13:18:03.204908 18151 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:03.205427 18151 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:03.206429 18151 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.218793 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:03.228777 18275 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:18:03.230605 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.231379 15600 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:03.209856 17935 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:03.233105 18259 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.235792 18277 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:18:03.236138 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.236680 18278 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:03.237486 18277 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.179278 18213 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:18:03.238095 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.238620 18213 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.239151 18213 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.239686 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:03.240393 18284 raft_consensus.cc:3055] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:03.210526 18096 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.241709 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.199952 18102 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:03.246415 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 87731us
I20260709 13:18:03.247176 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:03.248075 15597 raft_consensus.cc:2368] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:03.240881 18284 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:03.270008 18020 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.271128 15594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:03.271796 18281 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.272096 15594 raft_consensus.cc:606] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.272485 15594 raft_consensus.cc:614] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:03.272814 18165 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:03.277829 17854 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:03.278457 15567 leader_election.cc:400] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:18:03.278930 15567 leader_election.cc:403] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.278853 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:03.279791 18165 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.280794 18283 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:18:03.285429 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.286370 18020 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.286773 18020 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:03.287150 18020 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.289081 18102 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.289752 18102 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.291124 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:03.292037 15750 raft_consensus.cc:2410] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:18:03.292155 18102 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:03.296303 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.297595 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:03.318569 15745 raft_consensus.cc:2376] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5. Re-sending same reply.
W20260709 13:18:03.298746 18282 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:18:03.299580 18280 log.cc:927] Time spent T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:18:03.299955 15749 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:03.301824 18019 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.244351 18183 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.306053 18039 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:03.306528 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 111140us
I20260709 13:18:03.248255 18148 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:03.272456 18281 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:03.310431 18288 log.cc:927] Time spent T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:18:03.321202 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62331.9us
I20260709 13:18:03.323963 15749 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:03.327324 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.238108 18277 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:18:03.330569 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:03.341723 15595 raft_consensus.cc:606] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.299827 18255 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.343593 15602 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
W20260709 13:18:03.349989 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 241817us
W20260709 13:18:03.359997 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.342886 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.383813 15596 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:03.385917 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.389978 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:03.393801 15597 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:03.399168 15642 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.401582 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:03.406868 18148 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.311043 18284 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.394734 18076 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:03.407305 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.407399 18148 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.421727 18148 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.422488 18281 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:03.396839 18213 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:03.397100 18259 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:03.426347 15642 leader_election.cc:400] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:03.430464 15642 leader_election.cc:403] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.434497 15596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:03.440140 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:03.435220 15596 raft_consensus.cc:606] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.413793 18165 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:18:03.442840 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.443166 16265 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:03.411819 18277 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:03.424219 18020 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.449730 18102 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:03.426672 18096 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:03.436120 15749 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.461061 18213 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.491825 15749 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.419507 17816 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.458184 18284 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.459106 18278 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:03.501088 18202 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:03.490001 18213 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:03.521064 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.522032 16308 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:03.538400 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:03.540522 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:03.541050 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:03.542156 15746 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:03.549365 15749 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:18:03.574714 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 132016us
I20260709 13:18:03.550468 18213 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.583148 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.584738 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.585070 16307 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.585489 16306 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
W20260709 13:18:03.590827 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.592530 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.592257 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.597534 15602 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:03.599368 15599 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:03.574240 15593 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.507113 18157 consensus_queue.cc:1059] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.141s
W20260709 13:18:03.606931 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.607519 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:03.572713 18255 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:03.614588 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.615518 15597 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:03.624361 15749 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.625723 15599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:03.626279 15599 raft_consensus.cc:606] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:03.626567 15599 raft_consensus.cc:614] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:03.628883 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.666706 15598 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:03.669374 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:03.671753 15714 leader_election.cc:400] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:03.676702 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.627655 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.630132 18202 raft_consensus.cc:697] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:03.688225 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:03.690026 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.690683 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:03.691408 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.708583 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.696235 15714 leader_election.cc:403] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.699177 15749 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:03.634485 18102 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:03.713289 18102 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.714907 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.715727 18102 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.715966 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.717110 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.717859 18295 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:03.718585 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.719180 18281 raft_consensus.cc:2764] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:03.719573 16299 raft_consensus.cc:2410] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:18:03.718773 18295 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.720084 18295 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:03.720503 18295 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.717243 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.713079 18213 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.661805 18286 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:03.752828 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.725940 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.720578 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:03.726758 18281 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.754952 18281 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:03.755460 18281 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.726585 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.728955 15748 raft_consensus.cc:1240] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:03.763113 18276 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:03.762444 18298 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:03.739024 18020 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.761487 18202 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.743837 18286 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:03.778184 18286 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:03.761686 15747 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.724963 18278 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.782086 18278 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.718611 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.771405 18151 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.737295 17816 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:03.733165 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 45035us
I20260709 13:18:03.787469 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:03.787673 15601 consensus_meta.cc:287] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
I20260709 13:18:03.775955 18276 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:03.788087 15601 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:03.733103 18164 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:03.794901 15750 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:03.795238 15595 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:03.795377 15750 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:03.796772 18076 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:03.797802 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:03.798372 15746 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:03.785394 18298 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:03.799773 18298 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.800846 18298 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:03.801151 18276 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:03.797845 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.802021 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.803153 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:03.803788 15595 raft_consensus.cc:606] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:03.796234 15750 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.804733 15750 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:03.805240 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:03.810038 18011 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:03.810456 18011 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:03.810847 18011 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:03.815500 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.817566 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:03.818385 15597 raft_consensus.cc:2376] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5. Re-sending same reply.
I20260709 13:18:03.824760 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:03.829854 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.819985 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:03.836423 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:03.841327 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.837258 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:03.820634 18278 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.847775 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.766716 18148 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:03.845896 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:03.853399 15748 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:03.854810 18148 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:03.855489 18148 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.859612 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:03.860746 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.841543 18164 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:03.861243 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:03.861469 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:03.856006 18148 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.845456 18102 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.867578 18102 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:03.866350 15601 raft_consensus.cc:2376] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6. Re-sending same reply.
I20260709 13:18:03.845445 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.849115 18277 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:03.872361 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:03.873525 15594 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:03.874342 15747 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:03.878003 18102 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.879086 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:03.892113 16307 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:03.863368 18295 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.904997 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:03.906520 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.907323 15744 raft_consensus.cc:2410] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:03.910014 15745 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:03.850179 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:03.911394 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:03.923012 15748 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:03.939267 15749 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:03.943658 15749 pending_rounds.cc:85] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 6
I20260709 13:18:03.951793 15750 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:03.955355 18102 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.955943 18102 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:03.956298 18148 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:03.959203 15746 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:03.908360 18164 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:03.961869 18164 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:03.954003 15750 pending_rounds.cc:85] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 3
I20260709 13:18:03.893394 18213 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:03.944011 15749 pending_rounds.cc:107] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:03.974462 15749 raft_consensus.cc:2889] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.991029 15594 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
W20260709 13:18:03.991569 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 80270.5us
I20260709 13:18:03.992717 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:03.965301 15750 pending_rounds.cc:107] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:03.997040 15750 raft_consensus.cc:2889] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.995512 16310 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:04.016824 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:04.018570 15746 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:04.027292 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.100968 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.102108 18295 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:04.012840 18151 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:04.110769 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.078598 18284 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.001s
W20260709 13:18:04.022670 18304 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:18:04.121029 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:04.064491 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:04.112254 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:04.124995 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.126231 16305 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:04.126811 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:04.124060 15595 raft_consensus.cc:2376] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7. Re-sending same reply.
I20260709 13:18:04.128446 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:04.129143 16310 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:04.106179 18151 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:04.130247 15748 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:18:04.064800 18148 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:04.131908 18148 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.132282 17816 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:04.134469 18148 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.134078 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:04.137596 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:04.130834 15748 pending_rounds.cc:85] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 3
I20260709 13:18:04.147943 15748 pending_rounds.cc:107] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:04.148291 15748 raft_consensus.cc:2889] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:04.147176 15716 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:04.026751 18011 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.149521 18165 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.160293 15746 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:04.114234 18281 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.136406 18151 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.160727 18305 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:04.157334 17973 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:04.190352 18011 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.162981 18284 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:04.191671 18284 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:04.192818 18284 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.192308 18151 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.162323 18213 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:04.196237 18213 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.196718 18213 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.170670 18286 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.172271 18276 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:04.140930 18102 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:04.187305 18305 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:04.200275 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 100022us
I20260709 13:18:04.155496 18020 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:04.201871 15600 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:04.202500 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 202370us
I20260709 13:18:04.207540 15714 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.208010 18313 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.209883 18313 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.212304 18313 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:04.216248 18281 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:04.244779 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.249259 18151 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:04.255252 15673 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.256914 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:04.259104 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.264891 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 114232us
W20260709 13:18:04.265522 16263 leader_election.cc:336] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.548s (SENT)
I20260709 13:18:04.266014 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.219002 18277 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.267160 15670 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:04.272172 15567 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:04.272780 15642 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:04.287128 18183 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:04.288013 18305 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.302810 18310 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:04.303445 18310 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:04.303922 18310 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.306708 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:04.313282 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.314047 15670 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.347875 15670 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:04.354152 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.359869 18284 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.366210 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 100702us
I20260709 13:18:04.309618 18299 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.340173 18259 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:04.338538 18183 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.389019 15673 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:04.337356 17816 consensus_queue.cc:1059] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:18:04.394351 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.398015 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.398877 15677 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:04.402112 15675 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:04.402513 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.386438 18315 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:04.404628 15668 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:04.408301 18298 consensus_meta.cc:287] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 13:18:04.390250 18259 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.374709 18284 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.431241 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.375195 18164 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:04.436100 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 123999us
I20260709 13:18:04.424144 18276 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:04.440670 15673 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:04.436898 15567 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:04.439252 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.445611 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.435349 18286 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:04.446257 15677 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:18:04.444792 15640 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:04.453040 15671 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:18:04.461833 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 196316us
W20260709 13:18:04.466039 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.446079 18315 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:04.475800 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.513s (SENT)
I20260709 13:18:04.480495 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.483278 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.483989 15672 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.484138 18299 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.487519 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:04.480679 18148 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.480481 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.489157 15677 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.452152 18164 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.495237 15672 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:04.497706 18148 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:18:04.498380 18326 log.cc:927] Time spent T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:04.498522 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.498860 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.499572 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.500131 15673 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:18:04.501037 18322 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:04.500206 15674 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:18:04.501971 18321 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:04.500447 18202 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:04.493970 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.500165 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:04.505323 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.512349 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.513239 15672 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:04.525790 15671 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
W20260709 13:18:04.504768 15714 connection.cc:256] RPC call timeout handler was delayed by -1.9030452609999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:18:04.543373 15714 connection.cc:256] RPC call timeout handler was delayed by -1.8634452610001517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:18:04.543829 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7698452610000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 13:18:04.544176 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7599452609999844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260709 13:18:04.544525 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7419452609999553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:18:04.545014 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7014452610001172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:18:04.545418 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6627452610000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:18:04.545794 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6600452610000502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 13:18:04.546175 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6573452610000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:18:04.546553 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6105452609999702s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:18:04.546924 15714 connection.cc:256] RPC call timeout handler was delayed by -1.5700452610001321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 13:18:04.547295 15714 connection.cc:256] RPC call timeout handler was delayed by -1.5574452610001117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 13:18:04.547878 15714 connection.cc:256] RPC call timeout handler was delayed by -1.461145260999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:18:04.549633 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 101714us
I20260709 13:18:04.500458 18096 raft_consensus.cc:3055] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:18:04.548372 15714 connection.cc:256] RPC call timeout handler was delayed by -1.3396452609999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:18:04.449235 18183 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.515173 18324 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:04.514091 18202 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:04.560019 15674 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:04.533354 18305 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.570547 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.561902 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:04.573961 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 73851.2us
I20260709 13:18:04.571312 15671 raft_consensus.cc:2376] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7. Re-sending same reply.
I20260709 13:18:04.577451 16263 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:04.557302 17973 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.556479 18096 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.527469 18011 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:18:04.489356 18259 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.569698 18202 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:04.562741 18324 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:04.586943 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.587419 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.584349 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.525043 18329 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:18:04.600364 15674 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:04.604018 15672 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:04.616976 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.609910 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:04.618855 15749 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:04.605454 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.624102 15744 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.627241 15750 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:04.631959 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:04.634186 15671 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:04.601681 18299 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:04.605197 18338 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:18:04.649055 15748 raft_consensus.cc:1240] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:04.650615 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:04.604221 18284 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:04.662751 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:04.653720 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.604926 18315 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.664944 15748 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:04.605588 18276 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.667549 15750 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:04.677065 15670 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:04.631963 18020 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:04.694934 15642 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:04.695825 18102 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.682588 16305 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:04.644234 18299 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:04.703207 18299 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.704670 18102 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.704842 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.704456 15677 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:04.667310 18165 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:04.707453 18183 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:04.708107 18183 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.708633 18020 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.709609 18020 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.710556 18183 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.710857 18020 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:04.711199 18183 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:04.711724 18183 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.712855 18164 consensus_queue.cc:1059] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:04.713114 18315 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.714510 18164 raft_consensus.cc:3055] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:04.714323 18343 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:18:04.714924 18164 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.715312 18165 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.716411 18165 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.720852 18332 raft_consensus.cc:3055] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:04.721398 18332 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:04.722096 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.722270 18332 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:04.723126 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.723351 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.723807 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.723994 15674 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:04.725360 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:04.726639 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.727201 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.667672 18096 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.729768 18096 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:04.731330 18327 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:18:04.735069 15674 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:04.737125 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:04.738457 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.739382 15670 raft_consensus.cc:2410] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 6 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:18:04.740767 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.741364 15670 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:04.741736 18164 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:04.743121 18164 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:04.745194 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:04.750041 18336 log.cc:927] Time spent T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:04.763496 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.766598 15671 raft_consensus.cc:2368] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
I20260709 13:18:04.737205 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.769567 15674 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:04.773717 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.776320 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.776841 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.632476 18310 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.787889 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:04.788964 15672 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:04.788020 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:04.792547 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.685693 18276 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.675678 17816 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
W20260709 13:18:04.817078 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.667479 18325 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:18:04.795691 15676 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:04.831663 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.832688 18276 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.833882 18344 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:04.834652 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:04.835314 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 71895.3us
I20260709 13:18:04.835544 15668 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:04.799662 18213 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.594s	user 0.013s	sys 0.000s
I20260709 13:18:04.834420 18344 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.836122 15750 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:18:04.836886 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.838340 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.789687 18341 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:04.837598 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.846663 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.836619 18213 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.835355 18310 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.850647 18096 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.873744 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:04.875125 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 166694us
W20260709 13:18:04.872352 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 82294.9us
W20260709 13:18:04.883589 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 46071.5us
I20260709 13:18:04.884251 18358 consensus_queue.cc:1059] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:04.889039 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:04.899888 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 411835us
I20260709 13:18:04.784739 18324 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:04.900035 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:04.906489 18011 raft_consensus.cc:3055] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:04.867982 18340 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:04.912853 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.850348 18329 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:18:04.927114 15745 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:04.908268 18310 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.929876 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.936733 18183 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.938390 18344 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.921372 18011 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:04.941073 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 61285.7us
W20260709 13:18:04.942188 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 55758.6us
W20260709 13:18:04.966127 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 127023us
I20260709 13:18:04.943876 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:04.968237 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.929237 18324 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:04.968808 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.975335 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.975281 15748 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.977449 15565 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:04.981384 15749 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:04.982757 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:04.983184 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:04.984004 15748 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:04.970443 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:04.941242 18310 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.001226 18213 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:04.979836 18352 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.979602 17816 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:04.965263 18350 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:18:04.988816 18344 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:04.978691 18325 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:04.986397 18340 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:05.011299 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.022029 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.022974 18346 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:05.023129 18340 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.025652 18355 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.026288 18355 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.029024 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:04.979769 18183 consensus_queue.cc:1059] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:18:05.020910 18344 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:05.038861 18344 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.039489 18360 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.036700 18329 consensus_queue.cc:1059] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:05.043020 18360 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:05.043699 18329 raft_consensus.cc:3055] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:05.035923 16295 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:05.044104 18329 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:05.045002 18329 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.046285 18329 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.047932 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:05.048959 18183 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:05.049227 15595 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.049443 18183 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:05.050462 18183 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.051859 18183 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.053617 15595 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:05.053725 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.055403 18310 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.055475 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.055840 18202 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.056463 15594 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:05.057870 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.010829 18352 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.059612 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.061124 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.061561 18305 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:05.062379 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.062686 16302 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:05.062858 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.063320 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.064028 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.071523 15748 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:05.072561 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:05.073660 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 97420.8us
I20260709 13:18:05.067837 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:05.095562 15640 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.829s (SENT)
I20260709 13:18:05.080983 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:05.036350 16304 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:05.101807 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.105091 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.102955 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:05.104938 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.102932 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.106302 15747 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:05.105342 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.107477 15744 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:05.064934 18165 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:18:05.109912 18305 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:05.112062 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:05.101449 15640 leader_election.cc:336] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.971s (SENT)
I20260709 13:18:05.103092 15748 raft_consensus.cc:2376] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5. Re-sending same reply.
I20260709 13:18:05.115051 15749 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:05.114991 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:05.115880 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.113286 15640 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:04.990670 18011 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.121559 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:05.116010 15743 raft_consensus.cc:2376] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5. Re-sending same reply.
I20260709 13:18:05.120270 16263 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:05.118471 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.122285 15598 raft_consensus.cc:2368] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:05.075009 18213 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.126269 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:05.100185 18076 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:05.132683 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:05.134338 15750 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:05.135605 18349 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.136242 18349 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.117849 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.137835 15593 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:18:05.139338 18349 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:05.136260 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.141392 15742 raft_consensus.cc:2368] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:05.140107 18354 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:05.144027 18310 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:05.144452 18213 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.147159 18213 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:05.147835 18362 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.155s	user 0.003s	sys 0.000s
I20260709 13:18:05.147898 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:05.148964 18354 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:05.149474 18354 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:05.150398 18354 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.151541 18340 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:05.193198 15593 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:04.900629 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:05.205899 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.297175 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.288519 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:05.353684 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 199903us
I20260709 13:18:05.312997 15594 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:05.361724 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:05.389613 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.201231 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.338469 15642 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:05.390962 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 52599.1us
W20260709 13:18:05.219914 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.391850 15600 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:05.135006 18305 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:05.324105 15500 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.399718 15742 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
W20260709 13:18:05.400938 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 299502us
W20260709 13:18:05.163589 17973 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.002s
I20260709 13:18:05.411890 15500 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.419770 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.420459 15744 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
W20260709 13:18:05.293633 18356 log.cc:927] Time spent T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:18:05.158771 18350 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:05.432505 18350 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.432982 18350 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:05.399861 18324 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:05.437083 18324 raft_consensus.cc:697] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:05.437999 18324 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:05.241165 18299 consensus_meta.cc:287] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:18:05.424763 15496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 324) took 2680 ms. Trace:
I20260709 13:18:05.439584 18299 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.375797 18355 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.442575 18299 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.157539 18076 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.201481 18363 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.311s
I20260709 13:18:05.442261 16305 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:05.425433 15640 leader_election.cc:336] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.075s (SENT)
I20260709 13:18:05.376000 18352 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.430361 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:05.420956 15500 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 5, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:05.394850 18332 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:05.445677 17973 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:05.439544 15496 rpcz_store.cc:276] 0709 13:18:02.730941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.731267 (+   326us) service_pool.cc:224] Handling call
0709 13:18:05.411408 (+2680141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:03.459626 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:03.728963 (+269337us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:03.729024 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:18:03.729052 (+    28us) tablet.cc:662] Decoding operations
0709 13:18:03.730295 (+  1243us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:03.730386 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:03.730418 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:18:03.731561 (+  1143us) tablet.cc:701] Row locks acquired
0709 13:18:03.731608 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:18:03.731786 (+   178us) write_op.cc:270] Start()
0709 13:18:03.731967 (+   181us) write_op.cc:276] Timestamp: P: 1783603083731718 usec, L: 0
0709 13:18:03.731991 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:03.802073 (+ 70082us) log.cc:844] Serialized 4431 byte log entry
0709 13:18:04.161226 (+359153us) op_driver.cc:464] REPLICATION: finished
0709 13:18:04.336029 (+174803us) write_op.cc:301] APPLY: starting
0709 13:18:04.366762 (+ 30733us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:04.400685 (+ 33923us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:04.400859 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:04.402339 (+  1480us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:04.402682 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:18:04.402733 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:04.403124 (+   391us) log.cc:844] Serialized 83 byte log entry
0709 13:18:04.403310 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.403438 (+   128us) write_op.cc:454] Released schema lock
0709 13:18:04.403503 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:04.403902 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.403935 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":752,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":143717,"apply.run_cpu_time_us":4056,"apply.run_wall_time_us":98632,"num_ops":11,"prepare.queue_time_us":119733,"prepare.run_cpu_time_us":36216,"prepare.run_wall_time_us":519574,"raft.queue_time_us":139536,"raft.run_cpu_time_us":43062,"raft.run_wall_time_us":111356,"replication_time_us":429080,"thread_start_us":345172,"threads_started":4,"wal-append.queue_time_us":135779,"wal-append.run_cpu_time_us":21748,"wal-append.run_wall_time_us":1479806}]]}
I20260709 13:18:05.459018 18202 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.473495 18076 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.473893 18310 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.475060 18335 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.475211 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 49683.4us
I20260709 13:18:05.318404 18346 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.475674 18329 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.477056 18183 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:05.478011 15593 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:05.400265 18305 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:05.479666 18350 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.480894 18349 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.425771 18277 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.481657 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:05.405493 18344 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.471040 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.484942 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:05.481515 18341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.032s
W20260709 13:18:05.554450 18341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.001s	sys 0.032s
I20260709 13:18:05.495406 15500 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.500636 15751 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:05.500694 15746 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:05.556771 18349 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.556865 15500 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 5, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:05.558724 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.558543 15500 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.560314 18350 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:05.549317 18305 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.561254 15500 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:05.502002 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 76604.6us
I20260709 13:18:05.518920 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.519821 15600 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:05.527774 16304 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:05.532279 16263 leader_election.cc:336] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.547s (SENT)
I20260709 13:18:05.534360 18359 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:05.537810 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:05.553275 18183 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.529371 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:05.569836 15675 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
W20260709 13:18:05.573351 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 91796.2us
I20260709 13:18:05.539847 18360 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:05.563127 15500 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.582278 15640 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:05.580101 15602 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:05.582638 15500 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 5, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.588234 15748 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:05.589243 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:05.584779 15500 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 5, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.551421 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:05.597837 15746 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:05.597990 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 68729.4us
I20260709 13:18:05.597859 15745 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:05.591346 15500 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 6, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 6 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:05.538296 18329 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.606287 18329 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:05.606475 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.608426 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:05.601063 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:05.609822 16307 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:05.538656 18346 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.614423 18164 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:05.616364 18346 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:05.616688 18344 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.568719 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:05.621582 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.622538 15594 raft_consensus.cc:2410] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:05.621959 18305 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.623394 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:05.566114 18277 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.624259 18305 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:05.625723 18277 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:05.627434 18183 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:05.629357 15598 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:05.534022 18310 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.527684 18335 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:05.636104 18164 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:05.642011 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.642207 18164 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.642904 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:05.643544 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.645313 15747 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:05.646260 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:05.646668 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 54292.4us
I20260709 13:18:05.591845 18298 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.631546 16310 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:05.637287 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:05.579142 18213 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:05.638127 15500 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:05.710168 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 61598.4us
I20260709 13:18:05.633104 16307 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:05.651288 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:05.715219 15500 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:05.665632 18277 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:05.569607 18359 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.601051 18350 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:05.665920 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:05.666607 18076 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.667392 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 100811us
W20260709 13:18:05.738824 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 91503.1us
I20260709 13:18:05.631816 15594 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:05.637967 16302 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:05.742833 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.697484 18312 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:18:05.724051 15500 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.743513 18329 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:05.746094 18359 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:05.733963 18299 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:18:05.755566 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:05.592237 18360 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.767359 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.773989 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:05.763626 18358 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:05.783905 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 201706us
I20260709 13:18:05.733734 18183 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:18:05.787768 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45959.1us
I20260709 13:18:05.788311 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.784801 15640 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:05.739372 17816 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:18:05.698750 18298 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.773087 18276 raft_consensus.cc:2764] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:18:05.752068 18076 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:05.759670 15744 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:05.792467 15594 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:05.750661 18165 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:18:05.772787 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.852909 16307 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:05.848752 16310 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:18:05.782783 18329 consensus_queue.cc:1243] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:05.780809 18350 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:05.857637 16305 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:18:05.859817 18373 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:18:05.872129 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:05.873138 15594 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:05.874142 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:05.875151 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 131796us
W20260709 13:18:05.879706 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 232987us
W20260709 13:18:05.881472 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.882062 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.888123 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:05.888983 15601 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:05.838577 18352 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:05.891539 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:05.891851 15716 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:05.928042 16263 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:05.946182 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.946475 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:05.864394 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:05.997707 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:05.998122 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:05.999203 16309 raft_consensus.cc:2393] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:06.006790 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:05.915334 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:06.010668 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:06.038697 15675 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:06.013890 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:06.018720 15594 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
W20260709 13:18:06.007114 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 410768us
I20260709 13:18:06.037750 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:05.838526 18358 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.044817 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:06.041932 16306 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:05.943066 18341 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:06.051606 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:06.054329 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 269589us
I20260709 13:18:06.054608 15671 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:05.993233 18325 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:06.064976 15640 leader_election.cc:400] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:05.880158 18379 consensus_queue.cc:1059] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:18:06.080574 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:06.083473 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:06.098608 15673 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:06.058593 15594 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:05.915154 18329 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 13:18:06.105192 15601 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:05.982571 18352 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.110010 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:06.107818 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:06.058112 18341 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:06.111882 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 48487.9us
I20260709 13:18:06.107967 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:06.117853 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:06.118098 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 191964us
I20260709 13:18:06.113750 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:06.119287 15747 raft_consensus.cc:2410] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:06.064399 18165 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.136404 15751 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:06.138113 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:06.162019 15596 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:06.106164 18310 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:06.136440 18341 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:06.064714 18164 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:18:06.237598 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:06.250813 15602 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:06.119650 18386 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:06.256654 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:06.257817 15673 raft_consensus.cc:2410] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:06.140179 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:06.164862 18315 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.275184 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:06.230731 16305 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:06.160204 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:06.276959 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:06.145053 18183 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
W20260709 13:18:06.287014 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 224581us
I20260709 13:18:06.295251 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:06.295567 15601 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:06.265770 18310 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:06.161204 18165 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.299808 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:06.302999 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.271340 18312 raft_consensus.cc:3055] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:06.305178 15750 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:06.289451 15593 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:06.295993 18011 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:06.284417 18378 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:06.325871 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 208062us
W20260709 13:18:06.313616 18332 consensus_meta.cc:287] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.001s
I20260709 13:18:06.297123 18310 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:06.309228 18312 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:06.348434 15597 raft_consensus.cc:2410] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:18:06.281298 18315 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:06.326973 18372 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:18:06.369889 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:06.317299 18389 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:06.357909 18310 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:06.392815 18391 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:06.393771 18076 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:06.399582 15673 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:06.417168 18377 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.465s	user 0.010s	sys 0.000s
I20260709 13:18:06.356683 18388 consensus_queue.cc:1059] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.359s
I20260709 13:18:06.394600 18358 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:06.437891 15675 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:06.408792 18298 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:06.440615 15675 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:06.406762 18391 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:06.442687 18352 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:06.496057 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2070) took 1012 ms. Trace:
I20260709 13:18:06.564817 15744 rpcz_store.cc:276] 0709 13:18:05.483861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.492898 (+  9037us) service_pool.cc:224] Handling call
0709 13:18:05.512889 (+ 19991us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:05.536033 (+ 23144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.536067 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:05.557167 (+ 21100us) log.cc:844] Serialized 582 byte log entry
0709 13:18:05.759446 (+202279us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:06.008004 (+248558us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.008279 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.008379 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.495804 (+487425us) raft_consensus.cc:1685] finished
0709 13:18:06.495824 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.495994 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":307978,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":31578,"thread_start_us":194000,"threads_started":1,"wal-append.queue_time_us":284151}
I20260709 13:18:06.494055 18165 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:06.610567 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1496) took 1351 ms. Trace:
I20260709 13:18:06.611312 15598 rpcz_store.cc:276] 0709 13:18:05.258872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.259053 (+   181us) service_pool.cc:224] Handling call
0709 13:18:06.610271 (+1351218us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54000aa854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:06.610478 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551885440}
I20260709 13:18:06.506311 15672 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:06.467471 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.646685 15671 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:18:06.496091 18399 log.cc:927] Time spent T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:06.551800 15593 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
W20260709 13:18:06.565201 18350 consensus_meta.cc:287] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.005s
W20260709 13:18:06.503847 18394 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:18:06.669638 18350 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:06.496940 18390 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:18:06.671017 18391 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:06.494072 18407 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:06.495313 18395 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:06.672640 18395 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:06.673012 15593 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:06.673880 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 405) took 1146 ms. Trace:
I20260709 13:18:06.674332 15593 rpcz_store.cc:276] 0709 13:18:05.528284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.672256 (+1143972us) service_pool.cc:224] Handling call
0709 13:18:06.672637 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.673570 (+   933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.673805 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:06.674914 18395 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:06.510689 18409 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.675777 18409 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.678359 18409 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:06.500774 18392 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.230s
I20260709 13:18:06.493796 18403 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:06.681550 15595 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:06.682014 18403 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.698302 18403 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:06.406579 18389 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:06.706918 18310 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:06.708133 18389 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:06.494227 18381 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:06.741782 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:06.749823 18350 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.750435 18344 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:06.750917 18344 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:06.750730 18350 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.751861 18344 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.753767 18350 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:06.458266 18312 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.777897 18312 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:06.509564 18315 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:06.780642 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 403) took 1297 ms. Trace:
W20260709 13:18:06.780493 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 453535us
I20260709 13:18:06.761160 18389 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.774690 18344 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:06.791559 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 432818us
W20260709 13:18:06.788393 15568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.008s	sys 0.027s
W20260709 13:18:06.798276 15568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.008s	sys 0.027s
I20260709 13:18:06.800374 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:06.508121 18341 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.874740 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 732) took 1375 ms. Trace:
W20260709 13:18:06.885443 15750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.042s	sys 0.047s
W20260709 13:18:06.891495 15750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.043s	sys 0.047s
W20260709 13:18:06.893936 15745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.021s	sys 0.024s
W20260709 13:18:06.895244 15745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.022s	sys 0.024s
I20260709 13:18:06.891409 16304 rpcz_store.cc:276] 0709 13:18:05.426382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.426586 (+   204us) service_pool.cc:224] Handling call
0709 13:18:05.426922 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.567407 (+140485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.796184 (+1228777us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400600ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:06.802076 (+  5892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231473024}
I20260709 13:18:06.723940 18386 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:06.894994 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 413) took 1161 ms. Trace:
I20260709 13:18:06.898249 15596 rpcz_store.cc:276] 0709 13:18:05.733720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.053037 (+319317us) service_pool.cc:224] Handling call
0709 13:18:06.894720 (+841683us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b540020bf54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:06.894907 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185138432}
I20260709 13:18:06.883263 18165 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.793793 18389 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:06.930047 18165 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:06.965131 18370 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:18:06.889549 18148 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:06.892628 18409 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.993680 15747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.069s	sys 0.143s
W20260709 13:18:06.994133 15747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.069s	sys 0.143s
I20260709 13:18:06.992712 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 407) took 1460 ms. Trace:
I20260709 13:18:06.996274 15596 rpcz_store.cc:276] 0709 13:18:05.532481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.914070 (+1381589us) service_pool.cc:224] Handling call
0709 13:18:06.976585 (+ 62515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.991556 (+ 14971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.991686 (+   130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.991882 (+   196us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:06.991970 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.992168 (+   198us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.992518 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:06.894362 18324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.254s	user 0.027s	sys 0.025s
I20260709 13:18:06.985205 18298 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:07.008082 18324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.369s	user 0.028s	sys 0.025s
I20260709 13:18:07.002336 18310 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:06.997049 18358 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.990732 18148 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:06.990309 18409 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:07.042070 18414 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:18:07.046262 18341 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:07.049235 15597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1482) took 1987 ms (client timeout 2075 ms). Trace:
W20260709 13:18:07.049654 15597 rpcz_store.cc:269] 0709 13:18:05.062297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.063046 (+   749us) service_pool.cc:224] Handling call
0709 13:18:07.049032 (+1985986us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400296dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:07.049180 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952957184}
I20260709 13:18:07.050621 16302 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:07.051168 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 410) took 1447 ms. Trace:
I20260709 13:18:07.051255 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:07.051739 18420 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:18:07.051546 15597 rpcz_store.cc:276] 0709 13:18:05.603668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.050445 (+1446777us) service_pool.cc:224] Handling call
0709 13:18:07.050716 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.050876 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.050899 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.050937 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:07.050967 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.051012 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.051105 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:07.052971 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.053529 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 587) took 1162 ms. Trace:
I20260709 13:18:07.054132 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:07.054656 15673 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:07.054025 15747 rpcz_store.cc:276] 0709 13:18:05.891522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.278044 (+386522us) service_pool.cc:224] Handling call
0709 13:18:06.292312 (+ 14268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.452591 (+160279us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:06.452640 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.453353 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.994732 (+541379us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:06.994779 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.994866 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.053268 (+ 58402us) raft_consensus.cc:1685] finished
0709 13:18:07.053295 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.053459 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":690000,"threads_started":2,"wal-append.queue_time_us":574805}
I20260709 13:18:07.057471 15672 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.058173 18379 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.058702 18379 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.060523 18341 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:07.061128 18341 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.061769 18418 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:07.062301 15676 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:07.063199 18341 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:07.070786 15675 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:18:07.040199 18398 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.623s	user 0.019s	sys 0.018s
I20260709 13:18:07.076382 15672 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:07.021271 18298 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.024808 18358 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.100417 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:07.026116 18386 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.087641 18324 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.097823 18379 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:07.116056 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.140230 16305 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:07.136204 18324 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.144104 18324 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.146071 18298 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:07.146284 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2086) took 1010 ms. Trace:
I20260709 13:18:07.148006 18409 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.150326 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:07.152519 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.159927 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.161116 18165 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.162703 18148 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.164680 15745 rpcz_store.cc:276] 0709 13:18:06.136212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.354549 (+218337us) service_pool.cc:224] Handling call
0709 13:18:06.354888 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.355242 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.355272 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.355752 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.895763 (+540011us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:06.895823 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.895941 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.146062 (+250121us) raft_consensus.cc:1685] finished
0709 13:18:07.146080 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.146221 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":539576,"threads_started":1,"wal-append.queue_time_us":697019}
W20260709 13:18:07.181597 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 207139us
I20260709 13:18:07.176777 18425 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:07.183209 15640 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.969s (SENT) [suppressed 46 similar messages]
W20260709 13:18:07.183455 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 150030us
I20260709 13:18:07.198848 15673 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
W20260709 13:18:07.200366 15642 leader_election.cc:336] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.523s (SENT)
I20260709 13:18:07.201016 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:07.204051 15642 leader_election.cc:336] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.523s (SENT)
I20260709 13:18:07.204461 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.184298 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.205185 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 576) took 1566 ms. Trace:
I20260709 13:18:07.205497 16302 raft_consensus.cc:2393] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:07.205632 15742 rpcz_store.cc:276] 0709 13:18:05.639193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.639322 (+   129us) service_pool.cc:224] Handling call
0709 13:18:07.204422 (+1565100us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:07.204591 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.204822 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.204852 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.204900 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:07.204935 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.204995 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.205122 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5266944}
W20260709 13:18:07.209012 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.209751 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.214147 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.201876 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:07.215727 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.217126 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.181295 16305 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:07.192371 18425 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:07.219964 15642 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.529s (SENT)
I20260709 13:18:07.225874 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:07.220722 15673 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:07.230230 16263 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.232095 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 404) took 1739 ms. Trace:
I20260709 13:18:07.232894 15598 rpcz_store.cc:276] 0709 13:18:05.482989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.683207 (+1200218us) service_pool.cc:224] Handling call
0709 13:18:06.738198 (+ 54991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.781980 (+ 43782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.782012 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.787592 (+  5580us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.064053 (+276461us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:07.219811 (+155758us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.222512 (+  2701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.222592 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.222636 (+    44us) raft_consensus.cc:1685] finished
0709 13:18:07.222647 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.222769 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45664,"prepare.queue_time_us":127363,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":48445,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3351,"thread_start_us":305843,"threads_started":2,"wal-append.queue_time_us":283291}
I20260709 13:18:07.241526 15642 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:07.242298 18310 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:07.242859 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.242918 18310 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:07.244251 18310 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.247381 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.248236 15672 raft_consensus.cc:2410] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:07.248092 16263 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.221280 18322 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:18:07.252612 15642 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.801s (SENT)
I20260709 13:18:07.224490 18425 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.253115 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:07.222512 18409 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.244544 18310 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:07.269359 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 409) took 1689 ms. Trace:
W20260709 13:18:07.270848 15642 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.805s (SENT)
I20260709 13:18:07.239526 18298 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:07.271396 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:07.272876 15642 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.829s (SENT)
I20260709 13:18:07.273399 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:07.271050 15596 rpcz_store.cc:276] 0709 13:18:05.579658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.997724 (+1418066us) service_pool.cc:224] Handling call
0709 13:18:07.012779 (+ 15055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:07.013414 (+   635us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:07.193095 (+179681us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.253847 (+ 60752us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.253902 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:07.253942 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.269106 (+ 15164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.269280 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":177736,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":167,"thread_start_us":227640,"threads_started":2}
I20260709 13:18:07.252038 18389 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:07.283670 15642 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.064s (SENT)
W20260709 13:18:07.284818 15642 leader_election.cc:336] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.091s (SENT)
I20260709 13:18:07.276404 18379 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:07.276628 18148 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:07.280789 18395 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:07.285288 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:07.286943 18395 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:07.288259 15642 leader_election.cc:336] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.319s (SENT)
I20260709 13:18:07.291738 15596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "693cb838c6224bb88e8195042cafa653"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:07.293859 15596 raft_consensus.cc:606] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:07.295339 15596 raft_consensus.cc:614] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:07.300207 15596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:07.301409 15596 raft_consensus.cc:606] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:07.303433 15596 raft_consensus.cc:614] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:07.308772 15598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e105ea6267284f22bdfda14678176b49"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:07.309523 15598 raft_consensus.cc:606] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.310143 15598 raft_consensus.cc:614] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:07.309384 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:07.312098 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1500) took 1780 ms. Trace:
I20260709 13:18:07.312541 15594 rpcz_store.cc:276] 0709 13:18:05.531294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.144891 (+613597us) service_pool.cc:224] Handling call
0709 13:18:07.309166 (+1164275us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:07.312023 (+  2857us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35432192}
I20260709 13:18:07.314445 15594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:07.315240 15594 raft_consensus.cc:606] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:07.315711 15594 raft_consensus.cc:614] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:07.319231 15594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:07.321173 15594 raft_consensus.cc:606] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
W20260709 13:18:07.326514 15595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1481) took 2264 ms (client timeout 2122 ms). Trace:
W20260709 13:18:07.339576 15595 rpcz_store.cc:269] 0709 13:18:05.061993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.062103 (+   110us) service_pool.cc:224] Handling call
0709 13:18:07.326215 (+2264112us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540012c854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:07.326375 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3722174720}
I20260709 13:18:07.329120 18349 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:07.253621 18374 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:07.337754 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.256933 18435 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:07.253736 18341 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
W20260709 13:18:07.363590 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.369015 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 119802us
I20260709 13:18:07.377923 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.379457 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:07.381278 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:07.358880 18442 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.080s	user 0.007s	sys 0.000s
W20260709 13:18:07.358589 18439 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.006s
W20260709 13:18:07.363409 18416 log.cc:927] Time spent T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.398s	user 0.005s	sys 0.000s
I20260709 13:18:07.386040 18322 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:07.387576 18322 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:07.377595 18434 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.125s	user 0.003s	sys 0.000s
I20260709 13:18:07.359582 18354 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:07.397938 18425 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.402603 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:07.406140 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1934) took 1376 ms. Trace:
I20260709 13:18:07.409906 18360 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:07.397439 18312 consensus_meta.cc:287] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.002s
I20260709 13:18:07.412240 15669 rpcz_store.cc:276] 0709 13:18:06.029629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.117038 (+ 87409us) service_pool.cc:224] Handling call
0709 13:18:06.159795 (+ 42757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.239543 (+ 79748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.239573 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.270889 (+ 31316us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.442344 (+171455us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:06.442602 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.443491 (+   889us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.296948 (+853457us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:07.405807 (+108859us) raft_consensus.cc:1685] finished
0709 13:18:07.405833 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.406072 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78813,"raft.queue_time_us":99832,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":17053,"spinlock_wait_cycles":4496256,"thread_start_us":129366,"threads_started":1,"wal-append.queue_time_us":591006}
W20260709 13:18:07.411484 18277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.668s	user 0.006s	sys 0.039s
I20260709 13:18:07.429278 18435 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:07.429704 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 78002.8us
I20260709 13:18:07.413901 18374 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:07.438057 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 457) took 1901 ms. Trace:
I20260709 13:18:07.437810 18374 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.438477 15670 rpcz_store.cc:276] 0709 13:18:05.536964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.537150 (+   186us) service_pool.cc:224] Handling call
0709 13:18:05.557452 (+ 20302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.699817 (+142365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.699846 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.739412 (+ 39566us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.070511 (+331099us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:06.326195 (+255684us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.326397 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.437680 (+1111283us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000834d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:07.437728 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.437770 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:07.437859 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.437996 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37944,"prepare.queue_time_us":284672,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":314110,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":96670,"spinlock_wait_cycles":324340992,"thread_start_us":462602,"threads_started":2,"wal-append.queue_time_us":503635}
I20260709 13:18:07.430171 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 406) took 1895 ms. Trace:
I20260709 13:18:07.440725 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.440879 15593 rpcz_store.cc:276] 0709 13:18:05.532221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.675836 (+1143615us) service_pool.cc:224] Handling call
0709 13:18:06.676229 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:06.784354 (+108125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:06.785523 (+  1169us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.938622 (+153099us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.183693 (+245071us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:07.187208 (+  3515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.188960 (+  1752us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.320568 (+131608us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4800100758. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:18:07.413100 (+ 92532us) raft_consensus.cc:1685] finished
0709 13:18:07.415030 (+  1930us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.427462 (+ 12432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44539,"raft.queue_time_us":48797,"raft.run_cpu_time_us":3064,"raft.run_wall_time_us":549757,"spinlock_wait_cycles":2380160,"thread_start_us":165171,"threads_started":1,"wal-append.queue_time_us":201326}
I20260709 13:18:07.442596 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 456) took 1912 ms. Trace:
I20260709 13:18:07.429840 18358 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.443009 15677 rpcz_store.cc:276] 0709 13:18:05.530119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.530441 (+   322us) service_pool.cc:224] Handling call
0709 13:18:05.551297 (+ 20856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.837122 (+285825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.837177 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.857706 (+ 20529us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.008810 (+151104us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:06.420129 (+411319us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.442164 (+1022035us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54002e0520. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe66b733 00007faefe6f0dbf 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c
0709 13:18:07.442217 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.442305 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.442344 (+    39us) raft_consensus.cc:1685] finished
0709 13:18:07.442416 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.442541 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21307,"prepare.queue_time_us":345940,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":126550,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":6085,"spinlock_wait_cycles":23892864,"thread_start_us":717552,"threads_started":3,"wal-append.queue_time_us":403085}
I20260709 13:18:07.445036 18382 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:07.445865 18425 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.490091 18335 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:07.492256 18404 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:07.493034 18404 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.446434 18454 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:07.495170 18454 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:07.495373 18404 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:07.453545 18371 log.cc:927] Time spent T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.719s	user 0.012s	sys 0.016s
I20260709 13:18:07.453588 18349 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:07.457193 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:07.431740 18277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.687s	user 0.006s	sys 0.039s
I20260709 13:18:07.466703 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1932) took 1437 ms. Trace:
W20260709 13:18:07.498181 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 120373us
I20260709 13:18:07.444227 18310 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.483485 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1706) took 1982 ms. Trace:
I20260709 13:18:07.512943 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:06.781142 15601 rpcz_store.cc:276] 0709 13:18:05.482706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.308450 (+825744us) service_pool.cc:224] Handling call
0709 13:18:06.308867 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.309079 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:06.322581 (+ 13502us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.728953 (+406372us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.780228 (+ 51275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.780294 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:06.780341 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.780415 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.780553 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50932,"prepare.queue_time_us":13965,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":72,"raft.queue_time_us":292736,"raft.run_wall_time_us":7665,"spinlock_wait_cycles":10644992,"thread_start_us":139339,"threads_started":1}
I20260709 13:18:07.486838 18435 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.495826 18454 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:07.498281 18349 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.500851 18410 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:07.500950 18406 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:07.514000 15677 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:07.520709 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1492) took 2393 ms. Trace:
I20260709 13:18:07.505511 15676 rpcz_store.cc:276] 0709 13:18:06.028964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.077752 (+ 48788us) service_pool.cc:224] Handling call
0709 13:18:07.061559 (+983807us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:07.061761 (+   202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.062185 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:07.349797 (+287612us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.428011 (+ 78214us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.432541 (+  4530us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.432730 (+   189us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:07.432793 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.432893 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.466281 (+ 33388us) raft_consensus.cc:1685] finished
0709 13:18:07.466426 (+   145us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.466614 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1403,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":2484,"spinlock_wait_cycles":4119936,"thread_start_us":37217,"threads_started":1,"wal-append.queue_time_us":84614}
I20260709 13:18:07.528131 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.513294 15602 rpcz_store.cc:276] 0709 13:18:05.480115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.258810 (+778695us) service_pool.cc:224] Handling call
0709 13:18:06.895261 (+636451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.908366 (+ 13105us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:07.181144 (+272778us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.301277 (+120133us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:07.455595 (+154318us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b180026b840. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faf020e83c7 00007faefe6fa9a7 00007faefe70a0bf 00007faefe70a038
0709 13:18:07.455903 (+   308us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.456134 (+   231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.456195 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:07.456242 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.456316 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.461958 (+  5642us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b540020bf50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:07.462085 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":631,"prepare.queue_time_us":487593,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":76,"raft.queue_time_us":2481,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":16494,"spinlock_wait_cycles":1514556800,"thread_start_us":238946,"threads_started":2,"wal-append.queue_time_us":88964}
I20260709 13:18:07.533146 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2082) took 1639 ms. Trace:
I20260709 13:18:07.560846 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.561823 15670 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:07.564579 15676 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:07.518959 16295 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.568056 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:07.523216 15599 rpcz_store.cc:276] 0709 13:18:05.112156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.113059 (+   903us) service_pool.cc:224] Handling call
0709 13:18:05.125242 (+ 12183us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.125442 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.125466 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.156894 (+ 31428us) log.cc:844] Serialized 26 byte log entry
0709 13:18:05.499273 (+342379us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:05.636947 (+137674us) log.cc:844] Serialized 14 byte log entry
0709 13:18:05.744786 (+107839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.744860 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.452967 (+1708107us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:07.502504 (+ 49537us) raft_consensus.cc:1685] finished
0709 13:18:07.504924 (+  2420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.505113 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107599,"prepare.queue_time_us":139078,"prepare.run_cpu_time_us":636,"prepare.run_wall_time_us":35880,"raft.queue_time_us":108005,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":12052352,"thread_start_us":365438,"threads_started":2,"wal-append.queue_time_us":426598}
I20260709 13:18:07.521559 18410 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:07.577360 18410 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:07.527487 18406 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:07.581699 18406 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:07.584264 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.583940 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2084) took 1657 ms. Trace:
I20260709 13:18:07.602383 15750 rpcz_store.cc:276] 0709 13:18:05.926750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.312381 (+385631us) service_pool.cc:224] Handling call
0709 13:18:06.312742 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.312991 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:06.313310 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.583473 (+1270163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.583530 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:07.583588 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.583687 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.583860 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":698026,"prepare.queue_time_us":2381,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"thread_start_us":578312,"threads_started":1,"wal-append.queue_time_us":724723}
I20260709 13:18:07.608783 18298 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:07.645746 18298 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.648736 18213 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:07.649431 18213 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.651631 18213 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.651667 18310 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.652205 18213 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:07.652791 18404 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:07.652968 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.653602 15747 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
W20260709 13:18:07.654917 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 854621us
I20260709 13:18:07.655682 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:07.656980 18419 raft_consensus.cc:2764] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:07.657377 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.657789 18419 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:07.658035 15743 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:07.658900 15714 leader_election.cc:400] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:07.661304 15750 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:07.653344 18404 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.664525 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:07.669574 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.669842 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:07.671474 18411 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:07.672209 18411 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.671555 18406 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.674619 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.677456 15749 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:07.668856 15668 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:07.683192 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:07.683131 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.687801 18386 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:07.688015 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.692713 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:07.688531 18374 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:07.695677 18374 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.696166 18374 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.698021 18411 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.670429 18213 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.700141 15743 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.705518 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.686869 18277 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:07.718088 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:07.718822 16302 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:07.719054 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:07.724464 15668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 1923) took 1714 ms (client timeout 1712 ms). Trace:
W20260709 13:18:07.724947 15668 rpcz_store.cc:269] 0709 13:18:06.009725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.036850 (+ 27125us) service_pool.cc:224] Handling call
0709 13:18:07.402485 (+1365635us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:07.724248 (+321763us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54003007d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:07.724357 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30197888}
I20260709 13:18:07.728803 18403 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:07.729624 18403 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:07.730911 18403 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.716102 18157 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:18:07.713716 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:07.739775 18404 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:07.741048 18277 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:07.741665 18277 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.557868 15748 rpcz_store.cc:276] 0709 13:18:05.894155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.313723 (+419568us) service_pool.cc:224] Handling call
0709 13:18:06.326363 (+ 12640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:06.326562 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:06.359493 (+ 32931us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.532747 (+1173254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:07.532818 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:07.532871 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.532944 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.533084 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":739762,"prepare.queue_time_us":43644,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":764637,"thread_start_us":433009,"threads_started":1,"wal-append.queue_time_us":637930}
I20260709 13:18:07.743150 18380 raft_consensus.cc:3055] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:07.743574 18380 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:07.699958 18413 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:07.744458 18380 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.745594 18380 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:07.746387 18349 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.747695 18352 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.748205 18352 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.748862 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.750129 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:07.750913 18352 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:07.753391 18259 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:07.753703 18276 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:07.754166 18259 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:07.754293 18276 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:07.754690 18259 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.720214 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:07.755805 18413 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:07.756313 18413 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:07.756914 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:07.757189 18413 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.758026 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:07.758846 18411 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:07.759369 18411 raft_consensus.cc:697] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:07.760205 18411 consensus_queue.cc:237] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.763055 18447 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:07.763607 18447 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.763931 18447 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.764163 18360 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:07.764865 18360 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.765758 18358 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.766278 18358 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.767479 18360 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.768132 18360 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.770321 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:07.765202 18417 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.771795 18417 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.755118 18259 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:07.774158 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.755587 18276 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.791720 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:07.792902 15668 raft_consensus.cc:2393] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 4: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:07.796850 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:07.797555 15668 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:07.805876 15743 raft_consensus.cc:2410] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:07.820293 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.824450 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:07.824877 15751 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:07.825594 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:07.825809 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.824903 18386 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:07.825316 15671 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:07.754383 18213 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.829825 15677 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:07.831883 15670 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:07.846045 16295 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:07.778072 18335 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:07.851679 18454 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.853796 18157 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.778602 18360 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:07.827280 18346 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:18:07.855785 18374 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.856484 18417 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.807600 18358 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:07.890416 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:07.893204 15642 leader_election.cc:336] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.762s (SENT)
I20260709 13:18:07.893832 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:07.837728 15565 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:07.810562 18359 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:07.899179 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.899837 15749 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:07.899869 18359 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:07.901051 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 63474.9us
I20260709 13:18:07.905390 18410 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:07.909340 15486 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5433f0c9863e427d88ba5916819e28e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:07.811529 18404 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:18:07.911001 18404 raft_consensus.cc:3055] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:07.911496 18404 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:07.912688 18404 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.874239 18447 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.880540 18157 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:07.886245 18460 log.cc:927] Time spent T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:07.895917 18277 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:07.837073 18388 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:07.918182 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.890365 18374 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:07.848275 18386 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:07.877653 18276 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:08.103673 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 210492us
I20260709 13:18:08.072263 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2088) took 1925 ms. Trace:
I20260709 13:18:07.948133 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:07.919881 15745 raft_consensus.cc:1240] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:08.105661 15744 rpcz_store.cc:276] 0709 13:18:06.147144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.567594 (+420450us) service_pool.cc:224] Handling call
0709 13:18:06.667511 (+ 99917us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.516470 (+848959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.516518 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.531285 (+ 14767us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.847593 (+316308us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:07.847653 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.847753 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.071943 (+224190us) raft_consensus.cc:1685] finished
0709 13:18:08.071976 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.072176 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":934096,"raft.queue_time_us":853188,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6040,"thread_start_us":263926,"threads_started":1,"wal-append.queue_time_us":502004}
I20260709 13:18:08.050505 15668 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
W20260709 13:18:08.102813 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 192597us
W20260709 13:18:08.110456 15642 leader_election.cc:336] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.931s (SENT)
I20260709 13:18:08.112434 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:08.033121 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:08.116281 15749 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:08.033121 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:08.134027 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:08.082746 18433 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.794s	user 0.006s	sys 0.000s
I20260709 13:18:08.142342 15668 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:08.142354 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.123428 18358 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.143623 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.144359 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.156358 15670 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:08.147459 16302 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:08.136579 18417 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:18:08.123778 18382 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:08.148885 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2087) took 2007 ms. Trace:
I20260709 13:18:08.136469 18352 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:18:08.153697 18447 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:07.946741 18425 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.156348 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.164755 15746 rpcz_store.cc:276] 0709 13:18:06.141793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.554670 (+412877us) service_pool.cc:224] Handling call
0709 13:18:06.555176 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.501556 (+946380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.501591 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.502100 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.690187 (+188087us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:07.690231 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.690295 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.148671 (+458376us) raft_consensus.cc:1685] finished
0709 13:18:08.148692 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.148829 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1044780,"raft.queue_time_us":960868,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":12100,"thread_start_us":187674,"threads_started":1,"wal-append.queue_time_us":307873}
I20260709 13:18:08.073503 18454 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:08.145500 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:08.160953 15642 leader_election.cc:336] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.970s (SENT)
I20260709 13:18:07.991616 18407 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:07.920174 18410 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:07.946851 18359 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.136269 18404 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.169389 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.169541 15673 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:08.169520 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.172748 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:08.173636 15675 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:08.179225 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 464778us
W20260709 13:18:08.183405 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 466482us
I20260709 13:18:08.183531 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:08.133520 18388 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:08.145440 18335 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:18:08.188110 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.170499 18349 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:08.200106 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.190732 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:08.207626 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.164387 18358 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.214381 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 462) took 1168 ms. Trace:
I20260709 13:18:08.191210 18409 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:18:08.218199 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.218683 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.197616 18454 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:08.192864 18360 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:08.237907 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.276701 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.319276 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:08.214800 15674 rpcz_store.cc:276] 0709 13:18:07.046009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.047212 (+  1203us) service_pool.cc:224] Handling call
0709 13:18:07.047625 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.048054 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.048093 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.048698 (+   605us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.221663 (+172965us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:07.389117 (+167454us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.389319 (+   202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.389394 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.884163 (+494769us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:08.208566 (+324403us) raft_consensus.cc:1685] finished
0709 13:18:08.214167 (+  5601us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.214321 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":176329,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":15311,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":218,"spinlock_wait_cycles":104124672,"thread_start_us":314368,"threads_started":2,"wal-append.queue_time_us":208064}
I20260709 13:18:08.208824 18349 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:08.187264 18359 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.181102 18407 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.224144 18435 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:18:08.373809 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 183191us
I20260709 13:18:08.413867 18157 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:08.415972 15746 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:08.297272 18417 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:08.417091 18417 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.418030 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:08.418843 15742 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.419883 18417 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:08.421078 18433 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:08.260077 18454 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.431032 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:08.425205 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 299640us
W20260709 13:18:08.427855 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 52338.7us
I20260709 13:18:08.436113 15565 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:08.487525 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.306353 18403 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:08.358865 18425 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:08.503605 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 60827.4us
I20260709 13:18:08.397302 18435 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:08.444290 18454 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:08.442337 18417 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.535384 18358 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:08.489063 18157 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:18:08.512337 18011 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:08.498147 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 67207.1us
W20260709 13:18:08.493453 18259 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.002s
I20260709 13:18:08.492364 18360 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:08.544310 15742 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:08.566602 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.523402 18435 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:08.566766 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:08.507177 18352 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.500041 18346 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:18:08.579895 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.583001 16309 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:08.586117 16305 raft_consensus.cc:1240] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:08.560371 18277 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:08.649112 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.652912 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.653430 18360 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:08.653666 16299 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:08.654470 18360 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:08.655224 18468 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:18:08.661695 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.662904 18407 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:08.521920 18425 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:08.546486 18403 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:08.560931 18417 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:08.579996 18474 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:08.681324 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:08.675101 18467 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:18:08.574546 18259 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:08.691655 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 188702us
I20260709 13:18:08.692870 15565 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:08.587988 18011 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.097s
W20260709 13:18:08.698997 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.714242 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.581175 18349 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.694972 18388 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:08.711133 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.686522 18474 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:08.735656 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:08.737596 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.738677 16307 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:08.739265 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1868254290000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
I20260709 13:18:08.749377 16265 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:08.750504 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.752058 18471 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:18:08.756860 18480 raft_consensus.cc:993] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:18:08.757426 18480 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:18:08.759195 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1787254289999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:18:08.759706 15714 connection.cc:256] RPC call timeout handler was delayed by -2.0410254290000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:18:08.760761 18478 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:08.761538 18478 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:08.720244 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.762677 18474 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:08.760025 15714 connection.cc:256] RPC call timeout handler was delayed by -1.983425428999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
W20260709 13:18:08.764219 15714 connection.cc:256] RPC call timeout handler was delayed by -1.9699254289998862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:18:08.764519 15714 connection.cc:256] RPC call timeout handler was delayed by -1.80072542899984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:18:08.764883 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6846254289998797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 13:18:08.765276 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6693254289998549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
W20260709 13:18:08.765677 15714 connection.cc:256] RPC call timeout handler was delayed by -1.645025429000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 13:18:08.766093 15714 connection.cc:256] RPC call timeout handler was delayed by -1.6009254289999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
W20260709 13:18:08.766549 15714 connection.cc:256] RPC call timeout handler was delayed by -1.564025428999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22010000000000002s for a response
W20260709 13:18:08.766970 15714 connection.cc:256] RPC call timeout handler was delayed by -1.411025428999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2371s for a response
W20260709 13:18:08.770615 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 203936us
I20260709 13:18:08.771446 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:08.782372 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.796412 15714 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.798183 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:08.799228 18474 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:08.800231 18474 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:08.800761 18474 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:08.801262 18474 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:08.802706 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.805583 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.806800 18482 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.808475 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.809525 18482 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:08.810204 18417 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:08.810963 18417 raft_consensus.cc:1081] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:18:08.811729 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.764052 18157 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.813269 18403 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:08.814393 18259 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:08.815024 18259 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:08.815402 18259 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:08.815783 18259 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:08.763621 18359 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:08.816923 18482 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:08.818600 18425 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:08.817108 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 592) took 1165 ms. Trace:
I20260709 13:18:08.821486 15745 rpcz_store.cc:276] 0709 13:18:07.651858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.656716 (+  4858us) service_pool.cc:224] Handling call
0709 13:18:07.656996 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.106063 (+449067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.816881 (+710818us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54002cfbd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:08.817052 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596154624}
I20260709 13:18:08.515455 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:08.831187 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.778261 18354 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:08.834164 18406 consensus_meta.cc:287] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.147s	user 0.008s	sys 0.005s
I20260709 13:18:08.853906 15746 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:08.838635 18425 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:08.846740 18482 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:08.850224 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 157471us
I20260709 13:18:08.762708 18478 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.863876 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:08.864957 15602 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:08.858628 18425 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:08.813316 18157 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.854748 18417 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.871726 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:08.874164 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:08.875087 15593 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:08.846740 18454 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.885026 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:08.881954 15714 leader_election.cc:400] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6.
W20260709 13:18:08.890622 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 117911us
I20260709 13:18:08.891669 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:08.892352 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:08.893067 15599 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.892360 15601 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
W20260709 13:18:08.894640 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 166778us
I20260709 13:18:08.898209 15602 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:08.898443 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:08.899045 15598 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:08.899421 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:08.902901 15601 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:08.903298 15601 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:08.905506 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:08.905846 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.906455 15676 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:08.908742 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.910027 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.910848 15669 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:08.912256 15602 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:08.912319 18157 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:08.914160 15674 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:08.915376 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.915980 15676 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:08.920044 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.920936 15676 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:18:08.926307 15642 leader_election.cc:336] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.122s (SENT)
I20260709 13:18:08.926893 18474 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:08.928298 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:08.932714 18349 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:08.933480 18349 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:08.936038 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:08.939599 15642 leader_election.cc:336] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.197s (SENT)
I20260709 13:18:08.939754 15599 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:08.941980 15642 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:08.944109 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.874162 18417 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:08.952250 15642 leader_election.cc:336] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.216s (SENT)
I20260709 13:18:08.958750 15642 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:08.947913 18404 consensus_meta.cc:287] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.758s	user 0.007s	sys 0.006s
I20260709 13:18:08.935138 18406 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:08.956035 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 52079.2us
I20260709 13:18:08.943851 15601 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:08.963678 15601 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:08.955432 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.965533 15676 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:08.951256 15567 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.953280 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:08.940867 18382 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:08.969159 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:08.970551 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:08.957587 18213 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:08.977089 18157 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:08.955972 18411 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:08.948415 18476 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:08.957422 18409 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:08.983323 15601 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:18:08.984251 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.947376 18388 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:08.963070 18406 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:08.988914 15601 pending_rounds.cc:85] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 8
I20260709 13:18:09.008082 15601 pending_rounds.cc:107] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:08.987982 18466 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:08.978091 18484 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:08.992043 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:08.993851 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:08.982555 18476 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.995211 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:08.997393 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.002895 18411 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:08.987972 15567 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.978260 18404 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:09.009238 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.020778 15751 raft_consensus.cc:2410] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:18:08.957973 18346 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:18:09.008502 15601 raft_consensus.cc:2889] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:08.990991 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:08.985046 18410 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:09.014325 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:08.987785 18213 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:09.013190 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.055469 15748 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
W20260709 13:18:09.025595 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 73393.9us
I20260709 13:18:09.057297 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:09.057574 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.012799 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.061223 15675 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:09.062655 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:09.063509 15673 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
W20260709 13:18:09.017328 18490 log.cc:927] Time spent T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:09.018491 15749 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:09.071800 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.072448 15749 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:09.073027 18259 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.023581 18277 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:09.073971 18454 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:09.074223 18277 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:09.075421 18259 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:09.009685 18406 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:08.981974 18382 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:09.065117 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.076910 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:09.009488 18322 raft_consensus.cc:2764] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:09.024359 18410 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:09.083498 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.084388 15751 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:09.087920 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:09.088627 15671 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:09.089812 15671 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:09.090437 18417 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:09.080226 18425 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:08.985000 18157 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:09.058844 18477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:18:09.065977 18453 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:09.067406 18076 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:09.067720 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:09.108232 15669 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.073385 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:08.994644 18499 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.080295 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.023912 18404 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:09.077754 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 89848.2us
I20260709 13:18:09.081553 15595 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:09.078263 15745 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:09.078811 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.093828 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.097205 15642 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:09.066672 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 100927us
I20260709 13:18:09.110783 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.127744 15601 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:09.128921 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.111974 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.113184 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.113523 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.132480 15594 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:09.133849 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.135423 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.136759 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.025063 18476 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:09.076541 18277 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:09.146828 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:09.093783 18493 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:18:09.093572 18410 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:09.108445 18435 consensus_meta.cc:287] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.004s
I20260709 13:18:09.161322 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:09.161561 18435 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.162014 18157 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:09.162511 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.163642 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.164275 15751 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
W20260709 13:18:09.147334 15640 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.798s (SENT)
I20260709 13:18:09.085471 18484 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:09.143978 16306 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:09.148620 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.203089 15600 raft_consensus.cc:2410] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:09.148856 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.147586 15597 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:09.094110 18474 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:09.095966 18298 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:09.094317 18382 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:09.157459 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:09.122058 18453 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:09.164783 18277 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:09.146574 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:09.165679 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:09.054977 18411 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:09.138954 18443 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:09.148087 18504 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:09.149212 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.092515 18213 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:09.309228 16299 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:09.139461 18404 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.390960 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 605) took 1165 ms. Trace:
W20260709 13:18:09.278321 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.384807 18492 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.391446 15743 rpcz_store.cc:276] 0709 13:18:08.225563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.225677 (+   114us) service_pool.cc:224] Handling call
0709 13:18:08.225962 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.493021 (+267059us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:08.691199 (+198178us) log.cc:844] Serialized 14 byte log entry
0709 13:18:08.896005 (+204806us) log.cc:844] Serialized 14 byte log entry
0709 13:18:08.896220 (+   215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:08.896265 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:08.896309 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.390720 (+494411us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b5400259ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:09.390769 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.390897 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":302771,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":111,"raft.queue_time_us":151,"raft.run_wall_time_us":3601,"spinlock_wait_cycles":671841536,"thread_start_us":375328,"threads_started":2,"wal-append.queue_time_us":212793}
I20260709 13:18:09.393106 18492 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:09.393667 15640 leader_election.cc:336] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.969s (SENT)
I20260709 13:18:09.395246 18492 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:09.387988 18474 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.332650 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.397213 15671 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.397580 15600 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:09.350019 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.390944 15716 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:09.399436 16304 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:09.367583 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:09.213155 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.401129 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.405524 15602 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:09.406828 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.407750 15602 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:09.408301 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 225965us
I20260709 13:18:09.370499 15599 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:09.366598 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.415141 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:09.398674 16308 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:09.418663 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.418289 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.419498 15598 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:09.421833 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.163642 18435 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:09.422878 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:09.424293 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 56852.5us
I20260709 13:18:09.422374 15716 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:09.426164 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:09.427743 18506 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.427343 18466 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:18:09.431443 18506 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:09.309479 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:09.433619 18506 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:09.434108 18388 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:09.434697 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.435853 15597 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:09.437147 18411 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:09.225184 18419 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.437552 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.437909 18419 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.439945 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:09.440951 18407 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:09.263793 18298 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.417642 18453 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.428139 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:09.428570 18504 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:09.443626 18504 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.324841 18202 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:18:09.441416 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.429518 18277 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.449025 18277 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:09.201232 18484 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.455034 18454 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:09.455502 18454 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.455895 18454 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.202221 18276 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:09.458974 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:09.459885 18076 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:09.459959 18276 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.461764 18076 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:09.462998 18276 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:09.463706 18352 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:09.464160 18352 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.464435 18466 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:09.324399 16302 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:09.427745 18358 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:09.427511 18474 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.452486 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.471238 15597 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:09.474086 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.474658 15671 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:09.458839 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:09.462705 18448 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:09.423234 18443 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.471692 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:09.472256 15640 leader_election.cc:336] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.122s (SENT)
I20260709 13:18:09.495806 15601 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:09.481736 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.527781 15597 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:09.420522 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.529819 15640 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:09.489511 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 67204.7us
I20260709 13:18:09.474768 15600 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:09.459154 15669 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:09.429548 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:09.542841 15598 raft_consensus.cc:2393] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:09.543717 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.543994 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.544951 15598 raft_consensus.cc:2393] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:09.527168 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.546829 15601 raft_consensus.cc:2368] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6.
I20260709 13:18:09.547974 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.549314 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.549984 15601 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:09.552402 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.553587 15597 raft_consensus.cc:2393] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:09.554484 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 125086us
W20260709 13:18:09.554818 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 83210us
I20260709 13:18:09.555243 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:09.555903 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:09.557085 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 84868.6us
I20260709 13:18:09.559124 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:09.426551 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.425036 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.564632 15602 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.568832 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.584398 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:09.426164 15565 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:09.602420 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:10.058177 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 473868us
I20260709 13:18:09.489850 18388 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:09.997963 18483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.049s	sys 0.057s
W20260709 13:18:09.617784 18403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.021s	sys 0.036s
I20260709 13:18:09.795279 15602 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:10.059664 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:09.552474 18480 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:10.060735 18480 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.061046 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:10.061789 15602 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:10.062697 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:10.063020 18480 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:09.602229 18358 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:09.484457 18454 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.603018 18500 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:09.969098 18410 consensus_meta.cc:287] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.743s	user 0.010s	sys 0.000s
I20260709 13:18:10.065093 18410 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.066077 18454 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:09.998627 18504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.002s	sys 0.026s
W20260709 13:18:10.073254 18504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.002s	sys 0.027s
W20260709 13:18:10.059844 18403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.026s	sys 0.046s
W20260709 13:18:10.022475 15676 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.040s	user 0.015s	sys 0.075s
I20260709 13:18:09.687500 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.076656 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1478) took 1076 ms. Trace:
I20260709 13:18:10.077253 15746 rpcz_store.cc:276] 0709 13:18:08.999768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.687130 (+687362us) service_pool.cc:224] Handling call
0709 13:18:10.076550 (+389420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.068163 18410 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:10.067837 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 512631us
I20260709 13:18:09.731918 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:10.081518 15567 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:10.082266 15596 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.083284 15567 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:09.783142 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.084481 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.705761 18404 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:09.463693 18076 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:10.086462 18404 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:09.647918 18499 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:10.086788 18076 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.087493 18499 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:10.087957 18499 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:09.440161 18419 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:10.029532 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.008s	sys 0.014s
I20260709 13:18:09.603117 18492 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:09.778129 15601 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:09.441493 18407 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.057878 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.705492 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:10.057981 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.091758 15676 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.016s	sys 0.076s
I20260709 13:18:09.452885 18484 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:09.719051 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 308879us
I20260709 13:18:10.079886 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.482014 18474 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.101735 15668 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:09.793807 18276 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.107254 15669 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:10.107335 18492 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.058308 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:09.464509 18352 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:10.108209 18407 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.092449 18480 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.109513 15600 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:10.109722 18480 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.110209 18480 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.110903 15600 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:09.441828 18298 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:09.689201 16309 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:10.078711 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.113014 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 651) took 1399 ms. Trace:
I20260709 13:18:10.113152 15746 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:09.688663 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:10.028019 18443 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:09.999120 18213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.014s	sys 0.009s
I20260709 13:18:09.493439 18506 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:09.686754 18386 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:09.705852 18425 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:09.702589 18406 consensus_meta.cc:287] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.003s
I20260709 13:18:10.143404 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:10.089249 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.008s	sys 0.014s
W20260709 13:18:10.059279 18483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.049s	sys 0.059s
I20260709 13:18:10.092509 15750 raft_consensus.cc:2393] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:10.097993 15601 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:10.101234 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:10.107105 18276 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:09.603288 18382 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:10.113643 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.108242 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.114333 15598 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:10.154146 15598 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:10.113368 16309 rpcz_store.cc:276] 0709 13:18:08.713601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.713785 (+   184us) service_pool.cc:224] Handling call
0709 13:18:09.688713 (+974928us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:09.688965 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.112794 (+423829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.112961 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3272448}
I20260709 13:18:10.118924 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:10.125788 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1473) took 1127 ms. Trace:
I20260709 13:18:10.133386 18500 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:10.114051 18476 consensus_meta.cc:287] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.000s
I20260709 13:18:10.145872 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1733) took 1026 ms. Trace:
I20260709 13:18:10.146082 16310 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:10.150692 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1489) took 1128 ms. Trace:
I20260709 13:18:10.166429 15601 rpcz_store.cc:276] 0709 13:18:09.119370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.097278 (+977908us) service_pool.cc:224] Handling call
0709 13:18:10.097591 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.145515 (+ 47924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.145802 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.167140 15750 rpcz_store.cc:276] 0709 13:18:09.022021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.705186 (+683165us) service_pool.cc:224] Handling call
0709 13:18:10.150632 (+445446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.157572 15746 rpcz_store.cc:276] 0709 13:18:08.998269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.078380 (+1080111us) service_pool.cc:224] Handling call
0709 13:18:10.125708 (+ 47328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.093024 18358 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.159243 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.160266 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.142676 18506 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.160967 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.176535 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.158954 18410 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.150795 18406 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.092011 18485 consensus_queue.cc:1059] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:18:10.139480 18492 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:10.139254 18202 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.164566 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.211788 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.165715 15668 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:10.175156 18358 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.173556 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.174638 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.177146 15669 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:10.195524 18410 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.217567 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.177516 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.180101 18500 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.179096 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:10.218583 18500 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.219322 15746 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:10.219491 18410 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.162848 18276 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.197314 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:10.172582 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:10.208420 15672 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:10.217748 15669 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.213956 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:10.222162 15674 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.223377 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.216777 15750 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:10.224234 15668 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
W20260709 13:18:10.225708 15593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.023s	sys 0.023s
I20260709 13:18:10.225775 15751 raft_consensus.cc:2393] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:10.224269 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2105) took 1079 ms. Trace:
I20260709 13:18:10.228102 15750 rpcz_store.cc:276] 0709 13:18:09.145037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.173262 (+1028225us) service_pool.cc:224] Handling call
0709 13:18:10.224214 (+ 50952us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.171335 18476 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:10.232380 15593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.023s	sys 0.023s
I20260709 13:18:10.222970 18358 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.237452 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.239106 15750 raft_consensus.cc:2410] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:10.244359 15669 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:10.228842 18458 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:10.255897 15742 raft_consensus.cc:2393] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:10.226105 18500 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.227007 18507 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.260298 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1483) took 1259 ms. Trace:
I20260709 13:18:10.260754 15750 rpcz_store.cc:276] 0709 13:18:09.001299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.237198 (+1235899us) service_pool.cc:224] Handling call
0709 13:18:10.260231 (+ 23033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.261905 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:10.260833 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 834675us
I20260709 13:18:10.215518 18492 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.222512 18202 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.271912 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1490) took 1249 ms. Trace:
I20260709 13:18:10.274658 15750 rpcz_store.cc:276] 0709 13:18:09.022299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.261569 (+1239270us) service_pool.cc:224] Handling call
0709 13:18:10.271813 (+ 10244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.265599 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.265588 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:10.278927 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 185230us
W20260709 13:18:10.279567 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.257349 18475 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.538s	user 0.011s	sys 0.016s
I20260709 13:18:10.254990 15669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:18:10.306262 15669 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.306825 15669 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.253064 18448 consensus_queue.cc:1059] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:18:10.276850 18458 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:10.292263 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:10.320578 15750 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:10.320201 18475 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.601s	user 0.012s	sys 0.016s
I20260709 13:18:10.264074 18276 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:18:10.310580 18506 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:10.253643 18322 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:18:10.273171 18507 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:10.339079 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 185598us
I20260709 13:18:10.340014 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:10.341519 18507 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:10.346370 18515 log.cc:927] Time spent T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:18:10.346859 18510 log.cc:927] Time spent T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 13:18:10.347970 18509 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:10.348712 18513 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:10.349318 18513 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.350770 18492 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.351452 18513 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:10.352535 18202 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:10.355083 18453 consensus_meta.cc:287] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.913s	user 0.008s	sys 0.000s
I20260709 13:18:10.355557 18453 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.360880 16302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 756) took 2183 ms. Trace:
I20260709 13:18:10.361378 16302 rpcz_store.cc:276] 0709 13:18:08.177405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.182467 (+  5062us) service_pool.cc:224] Handling call
0709 13:18:08.260388 (+ 77921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.465490 (+1205102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.360570 (+895080us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b5400702bd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:10.360784 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011804416}
I20260709 13:18:10.362685 18521 raft_consensus.cc:3055] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:10.363137 18521 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:10.364050 18521 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.365512 18521 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.366086 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 425) took 1468 ms. Trace:
I20260709 13:18:10.366477 15595 rpcz_store.cc:276] 0709 13:18:08.897836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.898341 (+   505us) service_pool.cc:224] Handling call
0709 13:18:08.902581 (+  4240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.124562 (+221981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.365822 (+1241260us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b5400248954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:10.366007 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405899648}
I20260709 13:18:10.367229 18406 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:10.324666 18447 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:10.372184 15674 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:10.380555 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:10.304082 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 220838us
I20260709 13:18:10.385787 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:10.451634 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 71227.9us
I20260709 13:18:10.445060 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1960) took 1482 ms. Trace:
I20260709 13:18:10.459277 15677 rpcz_store.cc:276] 0709 13:18:08.962832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.962992 (+   160us) service_pool.cc:224] Handling call
0709 13:18:08.980080 (+ 17088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.196464 (+216384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.196519 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:09.551227 (+354708us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.144866 (+593639us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:10.323463 (+178597us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.335724 (+ 12261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.335832 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.444819 (+108987us) raft_consensus.cc:1685] finished
0709 13:18:10.444843 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.444992 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2122,"prepare.queue_time_us":207478,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":108480,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":12213,"thread_start_us":740182,"threads_started":3,"wal-append.queue_time_us":648419}
I20260709 13:18:10.462363 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.392521 15669 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.333271 16305 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:10.488637 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 102962us
I20260709 13:18:10.480059 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:10.346374 18511 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:18:10.345636 15642 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.831s (SENT)
I20260709 13:18:10.483696 15750 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
W20260709 13:18:10.501322 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 235790us
W20260709 13:18:10.506210 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.377635 18276 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.516330 18382 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:10.528254 18512 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.528309 18382 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.528892 18512 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.530345 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.531271 15677 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:10.512672 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.513598 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:10.515343 18298 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.516742 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:10.527192 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 420) took 1643 ms. Trace:
I20260709 13:18:10.533355 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2113) took 1113 ms. Trace:
I20260709 13:18:10.537678 15750 rpcz_store.cc:276] 0709 13:18:09.419630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.512374 (+1092744us) service_pool.cc:224] Handling call
0709 13:18:10.533271 (+ 20897us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.535912 15593 rpcz_store.cc:276] 0709 13:18:08.883837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.883966 (+   129us) service_pool.cc:224] Handling call
0709 13:18:08.893794 (+  9828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.894130 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.894156 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.899734 (+  5578us) log.cc:844] Serialized 26 byte log entry
0709 13:18:09.698335 (+798601us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b180041a820. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1 00007faefe6aba0f
0709 13:18:10.234699 (+536364us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:10.451938 (+217239us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.489966 (+ 38028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.490043 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.490080 (+    37us) raft_consensus.cc:1685] finished
0709 13:18:10.526901 (+ 36821us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.527109 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37757,"raft.queue_time_us":1203,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7203,"spinlock_wait_cycles":28540672,"thread_start_us":742561,"threads_started":2,"wal-append.queue_time_us":1387023}
I20260709 13:18:10.532557 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:10.543372 15677 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:10.555294 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 209682us
W20260709 13:18:10.556139 15642 leader_election.cc:336] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.850s (SENT)
I20260709 13:18:10.556627 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:10.487176 18406 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:10.567982 15669 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.563874 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:10.569327 15642 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.957s (SENT)
I20260709 13:18:10.569795 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:10.566066 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:10.570876 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:10.573629 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:10.574506 15673 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.578270 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:10.579442 18403 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:10.579828 18403 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:10.580191 18403 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.559937 18276 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:10.581039 18276 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.583374 18276 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:10.584565 18507 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.585304 18507 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.576634 18407 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:18:10.586382 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1724) took 1469 ms. Trace:
I20260709 13:18:10.588688 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:10.590255 15642 leader_election.cc:336] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.994s (SENT)
I20260709 13:18:10.590823 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:10.586851 15596 rpcz_store.cc:276] 0709 13:18:09.116828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.083178 (+966350us) service_pool.cc:224] Handling call
0709 13:18:10.083495 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.083849 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.083885 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.108855 (+ 24970us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.263946 (+155091us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:10.263986 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.264082 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.586125 (+322043us) raft_consensus.cc:1685] finished
0709 13:18:10.586149 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.586317 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9686,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7463,"thread_start_us":154673,"threads_started":1,"wal-append.queue_time_us":376020}
I20260709 13:18:10.450961 18492 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 13:18:10.576647 18518 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.602208 18498 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:10.587499 18386 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:18:10.560462 18322 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:10.568385 18406 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.560111 18410 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.530856 18523 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.571455 18213 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:10.588590 18359 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.465973 18447 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:10.611140 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.666254 15673 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:10.572291 18474 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:10.660703 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.576819 18504 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:10.662099 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:10.659853 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 146791us
I20260709 13:18:10.669588 15669 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:10.669946 15743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2107) took 1522 ms (client timeout 1829 ms). Trace:
I20260709 13:18:10.485823 18480 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:10.670353 15743 rpcz_store.cc:269] 0709 13:18:09.148015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.661859 (+1513844us) service_pool.cc:224] Handling call
0709 13:18:10.669889 (+  8030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.671305 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.665441 15670 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:10.667483 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:10.510456 18352 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.617606 16295 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 6. Ops: []
I20260709 13:18:10.674237 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.687480 15669 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:10.687969 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:10.665668 18406 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:10.593370 18419 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:10.628785 18499 consensus_meta.cc:287] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.002s
I20260709 13:18:10.668331 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.664956 18523 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:10.675683 15677 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:10.672169 15743 raft_consensus.cc:2410] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:10.669996 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:10.676860 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 187188us
W20260709 13:18:10.584671 18517 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:10.687934 15750 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:10.593061 18425 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.612056 18500 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:10.553949 18458 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.659811 18506 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:10.611918 18507 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.618371 18484 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.753620 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:10.777655 15751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1495) took 1598 ms (client timeout 1899 ms). Trace:
I20260709 13:18:10.718454 15602 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:10.695984 15599 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:10.690699 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.799242 15751 rpcz_store.cc:269] 0709 13:18:09.179349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.480483 (+301134us) service_pool.cc:224] Handling call
0709 13:18:10.777400 (+1296917us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400276fd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:10.777570 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530754432}
I20260709 13:18:10.672683 18322 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:10.782836 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 94937.4us
W20260709 13:18:10.801115 15640 leader_election.cc:336] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.571s (SENT)
I20260709 13:18:10.677310 18213 consensus_queue.cc:1243] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:18:10.805305 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 135379us
I20260709 13:18:10.800777 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:10.824848 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2106) took 1679 ms. Trace:
I20260709 13:18:10.800166 15673 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 3.
W20260709 13:18:10.851812 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50748us
I20260709 13:18:10.852238 15594 raft_consensus.cc:2393] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:10.852914 15640 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.628s (SENT)
I20260709 13:18:10.852133 15743 rpcz_store.cc:276] 0709 13:18:09.145353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.671078 (+1525725us) service_pool.cc:224] Handling call
0709 13:18:10.824789 (+153711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.825187 15677 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:10.854722 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:10.856278 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:10.856859 18213 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.859000 18213 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.821918 18359 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:10.859506 18213 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.859869 18359 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.860504 18359 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:10.718900 18276 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:10.781608 18534 log.cc:927] Time spent T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:18:10.825510 18419 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:10.762279 18504 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.864820 18419 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.858210 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.865692 18504 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.865351 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1961) took 1891 ms. Trace:
I20260709 13:18:10.866472 15673 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:10.813493 18506 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.866624 15676 rpcz_store.cc:276] 0709 13:18:08.974509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.974762 (+   253us) service_pool.cc:224] Handling call
0709 13:18:08.975562 (+   800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.092167 (+1116605us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:10.266638 (+174471us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.515139 (+248501us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.516033 (+   894us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.516171 (+   138us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:10.516205 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.517189 (+   984us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:10.865086 (+347897us) raft_consensus.cc:1685] finished
0709 13:18:10.865106 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.865281 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":260137,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":112481,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":213,"thread_start_us":1466154,"threads_started":3,"wal-append.queue_time_us":278156}
I20260709 13:18:10.863433 15671 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:10.782546 18533 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:10.672143 18410 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.873608 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.854032 15565 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:10.693248 18404 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:10.797178 18298 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:10.875990 18447 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:10.877648 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 77026.7us
I20260709 13:18:10.884702 15750 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:18:10.863543 18276 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.797012 18498 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.878597 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:10.889014 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1493) took 1866 ms. Trace:
I20260709 13:18:10.782428 18453 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:10.894162 15676 raft_consensus.cc:1275] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:18:10.870500 18506 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:10.840046 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:10.799316 18523 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:10.926237 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 51231us
I20260709 13:18:10.926807 15743 rpcz_store.cc:276] 0709 13:18:09.022988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.855508 (+1832520us) service_pool.cc:224] Handling call
0709 13:18:10.888956 (+ 33448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:10.929245 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:10.930625 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:10.933418 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.933135 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:10.935477 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:10.935940 18528 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:18:10.726238 18538 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.249s
I20260709 13:18:10.889487 18474 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:10.936216 15743 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:18:10.937719 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.968436 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1491) took 1945 ms. Trace:
I20260709 13:18:10.968742 15676 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:10.937642 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:10.969051 15743 rpcz_store.cc:276] 0709 13:18:09.022535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.935063 (+1912528us) service_pool.cc:224] Handling call
0709 13:18:10.968365 (+ 33302us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:10.971812 15640 leader_election.cc:336] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.704s (SENT)
I20260709 13:18:10.965322 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:10.976369 16302 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:10.965556 18346 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:10.977404 18346 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.977625 18504 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.977780 18346 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.926085 18404 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:10.925830 18276 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:10.936067 18352 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.872030 18406 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:10.993076 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 139112us
I20260709 13:18:10.804514 18499 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.932680 18512 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:10.920343 18403 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:10.937093 18498 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.916982 18322 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:10.995285 15601 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:11.265429 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1522) took 2051 ms. Trace:
I20260709 13:18:11.467828 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.468204 15598 rpcz_store.cc:276] 0709 13:18:09.214251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.156038 (+941787us) service_pool.cc:224] Handling call
0709 13:18:10.156290 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.296064 (+139774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.296108 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:10.296167 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:10.296213 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.265178 (+968965us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400087fd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:11.265228 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.265363 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320897408}
W20260709 13:18:11.265872 18521 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.900s	user 0.010s	sys 0.003s
I20260709 13:18:11.249110 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 659) took 2105 ms. Trace:
I20260709 13:18:10.969686 18474 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:11.254137 16304 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:11.290079 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:10.965433 18540 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.475931 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 658) took 1356 ms. Trace:
I20260709 13:18:11.068142 15751 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:11.111457 18542 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:18:11.476446 16304 rpcz_store.cc:276] 0709 13:18:10.119440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.119567 (+   127us) service_pool.cc:224] Handling call
0709 13:18:11.253634 (+1134067us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:11.253882 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.475609 (+221727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.475873 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3230976}
I20260709 13:18:10.991111 18480 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:11.471742 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:11.471850 15674 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:11.499368 16263 connection.cc:256] RPC call timeout handler was delayed by -1.4375955220000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 13:18:11.501765 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 669) took 1158 ms. Trace:
I20260709 13:18:11.502312 16309 rpcz_store.cc:276] 0709 13:18:10.343546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.343678 (+   132us) service_pool.cc:224] Handling call
0709 13:18:10.344081 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:10.374488 (+ 30407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.374519 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:10.480722 (+106203us) log.cc:844] Serialized 52 byte log entry
0709 13:18:10.677053 (+196331us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:10.677111 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.677172 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.501439 (+824267us) raft_consensus.cc:1685] finished
0709 13:18:11.501467 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.501683 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30627,"raft.queue_time_us":30704,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":40138,"thread_start_us":106438,"threads_started":1,"wal-append.queue_time_us":415107}
W20260709 13:18:11.173760 18358 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.919s	user 0.003s	sys 0.008s
W20260709 13:18:11.006585 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 69009.4us
I20260709 13:18:11.111140 18541 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:11.166823 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:11.246816 15746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1482) took 2245 ms (client timeout 2369 ms). Trace:
I20260709 13:18:11.230504 18213 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:11.527251 15715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.004s	sys 0.021s
W20260709 13:18:11.527725 15715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.004s	sys 0.021s
I20260709 13:18:11.473574 18499 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:11.213299 18382 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:11.023465 18482 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:10.970045 18386 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:11.248433 15742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1480) took 2248 ms (client timeout 1571 ms). Trace:
I20260709 13:18:11.250626 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1732) took 2131 ms. Trace:
I20260709 13:18:11.544373 15599 rpcz_store.cc:276] 0709 13:18:09.119120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.091476 (+972356us) service_pool.cc:224] Handling call
0709 13:18:10.106955 (+ 15479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.801535 (+694580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.250325 (+448790us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54001c98d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:11.250549 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354065152}
W20260709 13:18:11.235960 15640 leader_election.cc:336] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.840s (SENT)
W20260709 13:18:11.478799 15567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.003s
W20260709 13:18:11.247684 15594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1721) took 2131 ms (client timeout 1729 ms). Trace:
W20260709 13:18:11.592000 15567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.009s	sys 0.003s
I20260709 13:18:11.188779 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 619) took 1603 ms. Trace:
W20260709 13:18:11.592651 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 659626us
I20260709 13:18:11.592856 15750 rpcz_store.cc:276] 0709 13:18:09.585059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.565687 (+980628us) service_pool.cc:224] Handling call
0709 13:18:11.188452 (+622765us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002599d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.188687 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268850048}
I20260709 13:18:11.593428 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:11.594233 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 358315us
I20260709 13:18:11.473731 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 433) took 2059 ms. Trace:
I20260709 13:18:11.475857 18474 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:11.257083 15597 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:18:11.628062 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.994751 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1516) took 1788 ms. Trace:
I20260709 13:18:11.251809 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.628872 15602 rpcz_store.cc:276] 0709 13:18:09.206655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.079638 (+872983us) service_pool.cc:224] Handling call
0709 13:18:10.994527 (+914889us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54002d7dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:10.994692 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433575168}
W20260709 13:18:11.482928 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.288574 18349 consensus_queue.cc:1059] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.183s
W20260709 13:18:11.472745 15747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1471) took 2478 ms (client timeout 2122 ms). Trace:
I20260709 13:18:11.525861 18512 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
W20260709 13:18:11.634388 15747 rpcz_store.cc:269] 0709 13:18:08.994775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.994914 (+   139us) service_pool.cc:224] Handling call
0709 13:18:11.472534 (+2477620us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540025a3d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.472677 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2585723648}
I20260709 13:18:11.626852 15595 rpcz_store.cc:276] 0709 13:18:09.414514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.367415 (+952901us) service_pool.cc:224] Handling call
0709 13:18:10.367777 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.662002 (+294225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.662041 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.662987 (+   946us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.804662 (+141675us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:10.804701 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.804769 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.473510 (+668741us) raft_consensus.cc:1685] finished
0709 13:18:11.473533 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.473676 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120183,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":40447,"thread_start_us":384595,"threads_started":2,"wal-append.queue_time_us":393840}
I20260709 13:18:11.635488 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.636334 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1503) took 1032 ms. Trace:
I20260709 13:18:11.636229 18504 consensus_queue.cc:1059] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:11.636832 15747 rpcz_store.cc:276] 0709 13:18:10.603884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.635230 (+1031346us) service_pool.cc:224] Handling call
0709 13:18:11.636274 (+  1044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.637218 18504 raft_consensus.cc:3055] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:11.637651 18504 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:11.637822 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.638468 18504 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.497512 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:11.640170 18504 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.002454 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.641165 15743 raft_consensus.cc:2393] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:11.641631 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1501) took 1038 ms. Trace:
I20260709 13:18:11.641965 15743 rpcz_store.cc:276] 0709 13:18:10.603347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.970994 (+367647us) service_pool.cc:224] Handling call
0709 13:18:11.641558 (+670564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.643020 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.643745 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1505) took 1039 ms. Trace:
I20260709 13:18:11.644075 15743 rpcz_store.cc:276] 0709 13:18:10.604418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.642684 (+1038266us) service_pool.cc:224] Handling call
0709 13:18:11.643689 (+  1005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.021209 18447 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:11.517833 15744 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:11.519809 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:11.395569 18424 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.472540 18498 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:11.242247 18484 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:10.991612 18492 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:11.240437 18410 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:11.144558 18453 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.526161 15746 rpcz_store.cc:269] 0709 13:18:09.001007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.169651 (+1168644us) service_pool.cc:224] Handling call
0709 13:18:11.246590 (+1076939us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b540002c954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.246741 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5639424}
W20260709 13:18:11.046077 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.517088 18419 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.036s
W20260709 13:18:11.536289 18276 consensus_meta.cc:287] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.516s	user 0.004s	sys 0.004s
I20260709 13:18:11.517460 18540 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:11.171025 18359 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:18:11.570052 18346 consensus_meta.cc:287] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:18:11.111882 18404 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.644780 18447 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:11.470829 16299 rpcz_store.cc:276] 0709 13:18:09.143648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.149432 (+  5784us) service_pool.cc:224] Handling call
0709 13:18:09.160528 (+ 11096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.429578 (+269050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.183687 (+1754109us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540034ea20. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe667dc0 00007faefe6f3a02 00007faefe6efdd6 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2
0709 13:18:11.249016 (+ 65329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312248704}
W20260709 13:18:11.543380 15742 rpcz_store.cc:269] 0709 13:18:09.000371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.014581 (+ 14210us) service_pool.cc:224] Handling call
0709 13:18:11.248172 (+2233591us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400304dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.248320 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2704634112}
I20260709 13:18:11.567858 18482 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.564796 18552 consensus_queue.cc:1059] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:11.661747 18492 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.245976 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:11.592136 15594 rpcz_store.cc:269] 0709 13:18:09.115801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.135087 (+ 19286us) service_pool.cc:224] Handling call
0709 13:18:11.247444 (+2112357us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54001478d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.247600 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3920271616}
I20260709 13:18:11.594504 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:11.682925 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1502) took 1079 ms. Trace:
I20260709 13:18:11.683279 15750 rpcz_store.cc:276] 0709 13:18:10.603625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.594178 (+990553us) service_pool.cc:224] Handling call
0709 13:18:11.682866 (+ 88688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.684185 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:11.625681 15745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1467) took 2639 ms (client timeout 1801 ms). Trace:
W20260709 13:18:11.529243 18537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.017s
I20260709 13:18:11.678643 18447 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:11.686188 18537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.006s	sys 0.018s
I20260709 13:18:11.676708 18276 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.688169 18276 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:11.674564 18540 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.689548 18540 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:11.693002 18403 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:11.673278 18558 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:11.693903 18558 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.696249 18558 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:11.656181 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.638653 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1504) took 1034 ms. Trace:
W20260709 13:18:11.658922 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 65571.7us
I20260709 13:18:11.704239 15747 rpcz_store.cc:276] 0709 13:18:10.604148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.637556 (+1033408us) service_pool.cc:224] Handling call
0709 13:18:11.638598 (+  1042us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.659838 18541 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.672894 18410 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.661401 18424 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:11.665994 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.716718 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1498) took 1125 ms. Trace:
I20260709 13:18:11.717046 15746 rpcz_store.cc:276] 0709 13:18:10.594155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.662294 (+1068139us) service_pool.cc:224] Handling call
0709 13:18:11.716657 (+ 54363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.666302 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:11.719246 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.719981 15673 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:11.667222 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 147494us
I20260709 13:18:11.721546 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:11.668785 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.722855 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1506) took 1118 ms. Trace:
I20260709 13:18:11.723286 15743 rpcz_store.cc:276] 0709 13:18:10.604677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.657341 (+1052664us) service_pool.cc:224] Handling call
0709 13:18:11.722784 (+ 65443us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:11.727566 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 414222us
I20260709 13:18:11.729986 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.678766 18406 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:11.669492 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.523643 18358 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:11.672966 18419 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.009s	sys 0.037s
W20260709 13:18:11.726826 18550 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:18:11.684821 15745 rpcz_store.cc:269] 0709 13:18:08.986174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.990207 (+  4033us) service_pool.cc:224] Handling call
0709 13:18:11.625408 (+2635201us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5400217354. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.625589 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41068288}
I20260709 13:18:11.676740 18560 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:11.629455 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 627) took 1254 ms. Trace:
W20260709 13:18:11.699074 15748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1492) took 2676 ms (client timeout 3195 ms). Trace:
W20260709 13:18:11.761155 15748 rpcz_store.cc:269] 0709 13:18:09.022772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.245633 (+2222861us) service_pool.cc:224] Handling call
0709 13:18:11.698995 (+453362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.708328 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.762213 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1474) took 2763 ms. Trace:
I20260709 13:18:11.762528 15742 rpcz_store.cc:276] 0709 13:18:08.998584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.681451 (+2682867us) service_pool.cc:224] Handling call
0709 13:18:11.762159 (+ 80708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.659999 18480 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.713225 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:11.763574 15673 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:11.674264 18453 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.684749 15750 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:11.771286 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1500) took 1176 ms. Trace:
I20260709 13:18:11.771410 15748 raft_consensus.cc:1240] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:11.771660 15750 rpcz_store.cc:276] 0709 13:18:10.595428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.683982 (+1088554us) service_pool.cc:224] Handling call
0709 13:18:11.771229 (+ 87247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.772035 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2110) took 2617 ms. Trace:
I20260709 13:18:11.745137 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:11.772359 15748 rpcz_store.cc:276] 0709 13:18:09.154437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.770942 (+2616505us) service_pool.cc:224] Handling call
0709 13:18:11.771241 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.771810 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.771984 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.774374 15600 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 6. Ops: []
I20260709 13:18:11.774396 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:11.775967 15668 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:11.777447 15750 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:11.778118 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1496) took 2367 ms. Trace:
I20260709 13:18:11.743337 18213 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:11.676960 18346 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:11.785686 18346 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:11.786404 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.787489 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.789115 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:11.789472 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 753) took 3626 ms. Trace:
I20260709 13:18:11.790318 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.790939 15599 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:11.791124 16305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 656) took 1672 ms. Trace:
I20260709 13:18:11.778764 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.791589 16305 rpcz_store.cc:276] 0709 13:18:10.118863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.133584 (+ 14721us) service_pool.cc:224] Handling call
0709 13:18:10.157458 (+ 23874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.490259 (+332801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.790854 (+1300595us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400554954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:11.791052 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349820800}
I20260709 13:18:11.779575 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:11.753319 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:11.797211 15742 raft_consensus.cc:2410] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:18:11.797333 15746 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.756489 16304 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:11.698668 18492 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:11.765251 15642 leader_election.cc:336] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.098s (SENT)
I20260709 13:18:11.715757 18546 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:11.760751 15749 rpcz_store.cc:276] 0709 13:18:10.375507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.251462 (+875955us) service_pool.cc:224] Handling call
0709 13:18:11.629381 (+377919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.778522 15750 rpcz_store.cc:276] 0709 13:18:09.410591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.772304 (+2361713us) service_pool.cc:224] Handling call
0709 13:18:11.772565 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.777894 (+  5329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.778056 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.799824 16306 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:11.788463 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.770021 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:11.780543 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.744269 18276 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:11.746203 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:11.783042 18499 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:11.783186 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.783532 18498 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:11.783680 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1762) took 1304 ms. Trace:
I20260709 13:18:11.809127 15670 rpcz_store.cc:276] 0709 13:18:10.479643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.588352 (+108709us) service_pool.cc:224] Handling call
0709 13:18:11.783480 (+1195128us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b5400002dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.783618 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174714752}
I20260709 13:18:11.809597 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.810279 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:11.810889 15670 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:11.811686 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.783800 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:11.800163 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.801877 15602 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:11.813548 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.802206 15676 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:11.800009 15642 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:11.818095 16304 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:18:11.818529 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.803922 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:11.820410 16307 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.782501 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.769955 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.821075 15668 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.812263 15670 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.821444 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:11.824182 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 58963.9us
W20260709 13:18:11.824710 15642 connection.cc:256] RPC call timeout handler was delayed by -1.4656706179998764s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2884s for a response
I20260709 13:18:11.825192 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:11.826122 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.776945 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:11.828457 15640 leader_election.cc:336] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.001s (SENT)
I20260709 13:18:11.837426 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.866921 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:11.865962 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:11.867295 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.870343 15676 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
W20260709 13:18:11.872818 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 61241us
I20260709 13:18:11.866340 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.866614 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 612) took 2334 ms. Trace:
I20260709 13:18:11.796118 18564 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.773788 18560 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.881172 15749 rpcz_store.cc:276] 0709 13:18:09.531777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.838221 (+2306444us) service_pool.cc:224] Handling call
0709 13:18:11.866097 (+ 27876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.866296 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.866321 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.866363 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:11.866392 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.866443 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.866552 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:11.918464 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.905596 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.919018 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 614) took 2386 ms. Trace:
I20260709 13:18:11.881911 15594 raft_consensus.cc:2368] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:11.923868 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:11.919114 15567 connection.cc:256] RPC call timeout handler was delayed by -1.1341586989999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:18:11.926791 15567 connection.cc:256] RPC call timeout handler was delayed by -1.063958699000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 13:18:11.928215 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:11.912472 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.929481 15676 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:11.916821 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:11.773937 18480 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:11.919327 16309 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:11.865150 15673 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:11.939127 15596 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:11.941248 15668 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:11.932403 15594 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:11.778414 18512 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 13:18:11.805217 18532 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:11.919687 15749 rpcz_store.cc:276] 0709 13:18:09.532359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.918033 (+2385674us) service_pool.cc:224] Handling call
0709 13:18:11.918386 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.918596 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.918633 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.918700 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:11.918744 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.918811 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.918952 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.963402 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:11.963799 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:11.964715 15673 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:11.857195 15640 leader_election.cc:336] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.086s (SENT)
I20260709 13:18:11.943929 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.808324 18521 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:11.972545 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:11.974462 15673 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
W20260709 13:18:11.975009 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52909.7us
I20260709 13:18:11.975531 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:11.946688 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 613) took 2414 ms. Trace:
W20260709 13:18:11.950251 15671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1745) took 1849 ms (client timeout 1568 ms). Trace:
I20260709 13:18:11.976641 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:11.976882 15743 rpcz_store.cc:276] 0709 13:18:09.532072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.866656 (+2334584us) service_pool.cc:224] Handling call
0709 13:18:11.946242 (+ 79586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.946400 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.946425 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.946463 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:11.946493 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.946542 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.946637 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:11.978839 15746 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:11.980161 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:11.950831 15669 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:11.789958 16295 rpcz_store.cc:276] 0709 13:18:08.162953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.163289 (+   336us) service_pool.cc:224] Handling call
0709 13:18:09.602997 (+1439708us) spinlock_profiling.cc:243] Waited 6.61 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:09.691460 (+ 88463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.692878 (+1001418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.789217 (+1096339us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400600ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:11.789407 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079906304}
I20260709 13:18:11.952000 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 432) took 2537 ms. Trace:
W20260709 13:18:11.953652 15672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1749) took 1836 ms (client timeout 2203 ms). Trace:
W20260709 13:18:11.982499 16263 leader_election.cc:336] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 2.224s (SENT)
W20260709 13:18:11.976970 15671 rpcz_store.cc:269] 0709 13:18:10.100809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.100949 (+   140us) service_pool.cc:224] Handling call
0709 13:18:11.950066 (+1849117us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54003af2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.950182 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627673344}
W20260709 13:18:11.982879 15672 rpcz_store.cc:269] 0709 13:18:10.117507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.117772 (+   265us) service_pool.cc:224] Handling call
0709 13:18:11.953451 (+1835679us) spinlock_profiling.cc:243] Waited 64.3 ms on lock 0x7b5400084dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.953581 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147930880}
I20260709 13:18:11.954715 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1968) took 1733 ms. Trace:
I20260709 13:18:11.983956 15674 rpcz_store.cc:276] 0709 13:18:10.221085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.373673 (+152588us) service_pool.cc:224] Handling call
0709 13:18:10.442084 (+ 68411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.499445 (+1057361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.954445 (+455000us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001a6654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:11.954646 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367874816}
I20260709 13:18:11.955816 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.965875 15594 raft_consensus.cc:2393] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:11.966167 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 109030us
I20260709 13:18:11.985790 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.866798 18349 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:11.984534 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.950434 15670 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:11.983966 15671 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:11.982008 15601 rpcz_store.cc:276] 0709 13:18:09.414241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.168757 (+754516us) service_pool.cc:224] Handling call
0709 13:18:10.994965 (+826208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.467901 (+472936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.951757 (+483856us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b54002d7dd0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:11.951929 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899249408}
I20260709 13:18:11.994293 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:11.994932 15601 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:11.995558 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.987891 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.995990 15670 raft_consensus.cc:1240] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 7. Ops: []
I20260709 13:18:11.997488 15601 raft_consensus.cc:2393] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:11.988112 15746 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:11.998383 15670 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:11.989704 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.996032 15676 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:11.990240 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.990600 15673 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:11.999845 15676 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:12.000756 16308 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 657) took 1866 ms (client timeout 1828 ms). Trace:
I20260709 13:18:12.000994 15673 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 13:18:12.002801 15668 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:11.996423 16304 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:12.002338 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:12.001174 16308 rpcz_store.cc:269] 0709 13:18:10.119168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.119393 (+   225us) service_pool.cc:224] Handling call
0709 13:18:11.955619 (+1836226us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:11.985405 (+ 29786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3672448}
I20260709 13:18:12.005131 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.005537 16307 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:12.005985 15594 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:12.007112 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.007761 15594 raft_consensus.cc:2376] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7. Re-sending same reply.
W20260709 13:18:12.005517 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.009446 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:11.947778 18483 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.015829 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:11.823637 18499 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.025978 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.019750 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.028077 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.017215 15743 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:12.028231 15673 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:11.961081 18563 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:12.029175 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 615) took 2496 ms. Trace:
I20260709 13:18:12.041066 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:12.041178 15743 rpcz_store.cc:276] 0709 13:18:09.532666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.978073 (+2445407us) service_pool.cc:224] Handling call
0709 13:18:12.016805 (+ 38732us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.028906 (+ 12101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.029120 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.029991 15593 raft_consensus.cc:2368] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6.
I20260709 13:18:12.035892 15746 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:11.984208 18335 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.048164 18569 consensus_queue.cc:1059] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:12.048547 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.049182 16295 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:12.049614 18569 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:12.049994 18569 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:12.050271 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 616) took 2517 ms. Trace:
I20260709 13:18:12.050688 15743 rpcz_store.cc:276] 0709 13:18:09.532953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.042525 (+2509572us) service_pool.cc:224] Handling call
0709 13:18:12.049781 (+  7256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.049943 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.049969 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.050015 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:12.050056 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.050115 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.050215 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.050817 18569 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.825858 18447 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.052685 18538 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:12.053104 18538 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:12.053473 18538 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.015528 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:11.819048 18546 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.056860 15750 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:12.057195 15602 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:12.058151 18407 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.058655 18407 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:18:12.060429 15744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1488) took 3057 ms (client timeout 1994 ms). Trace:
I20260709 13:18:12.061425 18551 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:12.061882 18551 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:12.062254 18354 raft_consensus.cc:3055] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:12.062608 18499 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.062745 18551 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.063795 18358 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:11.944984 18213 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:18:12.065025 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.065361 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:11.827800 18498 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.066843 18425 raft_consensus.cc:3055] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.067226 18425 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:12.067982 18498 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.043591 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:12.068897 15593 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:12.070791 18548 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.403s	user 0.002s	sys 0.000s
I20260709 13:18:12.072259 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1766) took 1405 ms. Trace:
I20260709 13:18:11.986459 18541 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.073320 18541 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.074175 18476 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:12.074066 18541 consensus_queue.cc:1059] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:12.075043 18541 raft_consensus.cc:3055] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.075402 18541 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:12.054241 18447 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.072623 15677 rpcz_store.cc:276] 0709 13:18:10.666719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.888949 (+222230us) service_pool.cc:224] Handling call
0709 13:18:10.889305 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:10.922354 (+ 33049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.922383 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.922828 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.064951 (+142123us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:11.065023 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.065120 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.070099 (+1004979us) spinlock_profiling.cc:243] Waited 9.2 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:12.071981 (+  1882us) raft_consensus.cc:1685] finished
0709 13:18:12.072000 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.072196 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36511,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":34924,"spinlock_wait_cycles":21170432,"thread_start_us":141661,"threads_started":1,"wal-append.queue_time_us":661383}
I20260709 13:18:12.108855 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:12.109635 15677 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:12.060992 15744 rpcz_store.cc:269] 0709 13:18:09.002660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.753277 (+1750617us) service_pool.cc:224] Handling call
0709 13:18:12.060143 (+1306866us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b54003ded54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:12.060341 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648483584}
I20260709 13:18:12.043619 15746 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:12.096166 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1507) took 2938 ms. Trace:
I20260709 13:18:12.115504 15744 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:12.116264 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 621) took 2350 ms. Trace:
I20260709 13:18:12.116650 15744 rpcz_store.cc:276] 0709 13:18:09.765557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.114960 (+2349403us) service_pool.cc:224] Handling call
0709 13:18:12.115280 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.116005 (+   725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.116207 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.117758 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 617) took 2566 ms. Trace:
I20260709 13:18:12.118124 15746 rpcz_store.cc:276] 0709 13:18:09.551788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.043187 (+2491399us) service_pool.cc:224] Handling call
0709 13:18:12.043463 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.114332 (+ 70869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.117697 (+  3365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.112828 15600 rpcz_store.cc:276] 0709 13:18:09.157803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.111585 (+953782us) service_pool.cc:224] Handling call
0709 13:18:10.111849 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.774778 (+1662929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.095807 (+321029us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001cb6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:12.096076 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3823041408}
I20260709 13:18:12.139528 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 618) took 2580 ms. Trace:
I20260709 13:18:12.140252 15743 rpcz_store.cc:276] 0709 13:18:09.558685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.051893 (+2493208us) service_pool.cc:224] Handling call
0709 13:18:12.052259 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.052452 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.052483 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.052533 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:12.052569 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.139247 (+ 86678us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.139446 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:12.144729 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.066179 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.146792 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:12.119959 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.147846 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:12.149446 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 349108us
I20260709 13:18:12.153163 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:12.044687 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 219520us
I20260709 13:18:12.170187 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 622) took 2071 ms. Trace:
I20260709 13:18:12.170784 15744 rpcz_store.cc:276] 0709 13:18:10.099289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.169258 (+2069969us) service_pool.cc:224] Handling call
0709 13:18:12.169587 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.169784 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.169809 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.169856 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:12.169900 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.169973 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.170123 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.148835 15595 raft_consensus.cc:2376] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7. Re-sending same reply.
I20260709 13:18:12.182186 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.192011 15593 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:12.192167 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:12.037947 18523 consensus_meta.cc:287] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.097s	user 0.012s	sys 0.000s
I20260709 13:18:12.193245 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:12.193611 16263 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.984s (SENT) [suppressed 54 similar messages]
I20260709 13:18:12.194679 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:12.179348 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:12.210177 15593 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:12.018535 18482 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.198451 15672 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:12.199577 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:12.231314 15744 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.232113 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.233687 15595 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:12.235459 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:12.194561 15642 connection.cc:256] RPC call timeout handler was delayed by -1.4338972549999198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3195s for a response
W20260709 13:18:12.237335 15642 leader_election.cc:336] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.925s (SENT)
I20260709 13:18:12.237877 15642 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.131762 18569 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.208431 15677 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:12.054080 18560 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:12.019234 18424 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:12.227816 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:12.254637 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.255638 15593 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:11.990806 18521 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:12.229370 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 53815.1us
I20260709 13:18:12.031213 18566 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.247170 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.056353 18546 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.094110 18386 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:12.062683 18354 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:11.947351 18564 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.256528 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.268396 15593 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:12.272852 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.169509 18476 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:12.192341 18552 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.286343 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:12.261981 15744 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:12.290591 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:12.291218 15744 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:18:12.292016 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:12.284297 15640 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:12.241143 18349 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:12.068161 18425 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.295087 15599 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:12.313935 15596 raft_consensus.cc:2410] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:12.168977 18454 consensus_queue.cc:1059] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:18:12.317276 18454 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:12.076318 18541 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:11.982775 18532 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.320487 18532 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.321395 18541 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.313761 15593 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:12.197907 18335 consensus_queue.cc:1059] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:18:12.324683 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:12.197576 18358 consensus_queue.cc:1059] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 13:18:12.295539 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 101993us
I20260709 13:18:12.274825 18386 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.329178 15671 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:12.299110 18349 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:12.336114 18382 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.335978 18575 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:12.336556 18335 raft_consensus.cc:3055] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.264364 18403 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:18:12.352238 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:12.046489 18483 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.349115 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:12.325703 18474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.004s	sys 0.013s
I20260709 13:18:12.230182 18523 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.257459 18346 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:18:12.258231 18482 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:18:12.349064 15675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.012s	sys 0.008s
W20260709 13:18:12.350474 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.080457 18563 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.344655 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:12.284765 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.354072 15744 raft_consensus.cc:2393] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:12.411253 15594 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:12.411805 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:12.378391 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 91452.4us
W20260709 13:18:12.412353 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 60198.8us
I20260709 13:18:12.412959 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:12.413335 15714 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:12.413821 15744 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:12.414999 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:12.415699 15744 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
W20260709 13:18:12.338596 18259 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.005s	sys 0.010s
I20260709 13:18:12.335986 18349 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.294955 18476 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.295935 18546 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:18:12.407806 15675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.013s	sys 0.008s
I20260709 13:18:12.355602 18403 consensus_queue.cc:1243] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:12.337523 18453 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:12.335978 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.346596 18335 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:12.417126 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:12.423220 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.419169 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.355079 18499 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:12.423564 18259 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.005s	sys 0.013s
I20260709 13:18:12.358798 18354 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.437853 16310 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:12.430680 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:12.366015 18474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.004s	sys 0.013s
I20260709 13:18:12.287539 18566 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.358830 18552 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:12.447415 15642 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.459882 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:12.428630 18504 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.000s
I20260709 13:18:12.458055 16310 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:12.436036 18447 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.441049 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:12.426163 18480 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.443373 18476 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.482465 15642 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.458639 18382 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:12.440470 18563 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.458997 18499 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:12.472190 18567 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.468168 18403 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:12.379671 18404 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:18:12.483832 18354 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:12.486747 15744 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.445922 18576 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:12.490694 15642 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.535429 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:12.536063 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 76459.7us
I20260709 13:18:12.537940 15714 leader_election.cc:400] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:12.538285 15714 leader_election.cc:403] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:18:12.539453 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 48829us
I20260709 13:18:12.540230 15642 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.484002 16310 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:12.486327 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 202105us
I20260709 13:18:12.439304 18335 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.521338 18590 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.522352 18523 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.529800 18382 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.525194 15749 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:18:12.483603 18504 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.492422 18499 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.569752 18500 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.479902 18552 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.571070 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.571875 15596 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:12.572803 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.574057 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:12.543037 16310 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:12.545521 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:12.542336 15640 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.553332 15642 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.577077 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.493482 18403 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.560119 18564 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:12.561385 18573 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:18:12.522993 18559 consensus_queue.cc:1059] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:12.551812 18575 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:12.567528 18567 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.536557 18521 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.588240 15744 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:12.578922 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:12.565658 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.534610 18576 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.578446 18504 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.591645 18582 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:12.591954 18483 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.593020 18596 raft_consensus.cc:3055] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:12.593223 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 623) took 2480 ms. Trace:
I20260709 13:18:12.595829 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:12.577922 18590 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:12.641563 15746 rpcz_store.cc:276] 0709 13:18:10.113243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.179741 (+2066498us) service_pool.cc:224] Handling call
0709 13:18:12.180169 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.180666 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.180706 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:12.219382 (+ 38676us) log.cc:844] Serialized 26 byte log entry
0709 13:18:12.436527 (+217145us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:12.436648 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.436801 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.592970 (+156169us) raft_consensus.cc:1685] finished
0709 13:18:12.592991 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.593156 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8692,"raft.queue_time_us":11295,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":28931,"thread_start_us":149239,"threads_started":1,"wal-append.queue_time_us":292749}
W20260709 13:18:12.643604 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 47861.2us
W20260709 13:18:12.639394 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 202233us
I20260709 13:18:12.581573 18335 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:12.634200 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 68595.7us
I20260709 13:18:12.643705 15746 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:12.581298 18403 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.581898 18500 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.646102 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 625) took 2372 ms. Trace:
W20260709 13:18:12.640285 15747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.003s	sys 0.021s
I20260709 13:18:12.646135 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:12.590449 18575 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:12.652977 18575 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.580758 18458 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.566231 18386 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:12.648996 15747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.022s
I20260709 13:18:12.648492 15746 rpcz_store.cc:276] 0709 13:18:10.273735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.643222 (+2369487us) service_pool.cc:224] Handling call
0709 13:18:12.643524 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.645822 (+  2298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.646041 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.637161 18404 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:12.658092 15746 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:18:12.658531 18500 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:12.660503 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 626) took 2316 ms. Trace:
I20260709 13:18:12.660992 15746 rpcz_store.cc:276] 0709 13:18:10.343946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.657535 (+2313589us) service_pool.cc:224] Handling call
0709 13:18:12.657868 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:12.660295 (+  2427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.660461 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.661754 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2109) took 3508 ms. Trace:
I20260709 13:18:12.662235 18566 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.641259 18596 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:12.653801 18482 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.675114 18595 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:12.675987 18549 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.676209 18386 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:12.676643 18478 raft_consensus.cc:3055] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.677037 18478 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:12.657418 18582 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:12.682879 18504 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.647176 18587 consensus_queue.cc:1059] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:18:12.684252 18587 raft_consensus.cc:3055] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:12.687391 18594 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:12.690445 18492 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.864s	user 0.008s	sys 0.003s
I20260709 13:18:12.681273 18478 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:12.689623 18538 consensus_meta.cc:287] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.006s
I20260709 13:18:12.693406 18478 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.689239 18587 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:12.723737 18552 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.698336 18538 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:12.723140 18540 consensus_meta.cc:287] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.033s	user 0.012s	sys 0.000s
I20260709 13:18:12.687485 18407 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.745529 18576 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:12.696080 18349 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.746589 18403 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.692490 18492 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.705087 18596 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.767565 18596 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:12.767179 18587 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:12.770431 18587 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.754930 18540 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.779273 18407 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:12.780503 18538 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.766561 18499 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:12.800482 18567 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5.
I20260709 13:18:12.801296 18349 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.844669 18594 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:12.887987 18540 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.890370 18492 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.891834 18499 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:12.904104 18404 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:12.959164 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.182214 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.962433 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.579330 15596 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:12.964931 15598 raft_consensus.cc:1240] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:12.966384 15600 raft_consensus.cc:2410] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:18:12.967113 15595 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:12.969592 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.977419 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 434962us
W20260709 13:18:12.981815 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 402969us
I20260709 13:18:12.986285 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 492) took 1676 ms. Trace:
I20260709 13:18:12.650192 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:13.001919 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.003093 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 354597us
I20260709 13:18:12.662128 15747 rpcz_store.cc:276] 0709 13:18:09.153419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.714255 (+2560836us) service_pool.cc:224] Handling call
0709 13:18:11.714646 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.714914 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:11.992720 (+277806us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.661434 (+668714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.661482 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:12.661529 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.661602 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.661706 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":544526,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":2264,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":904473,"threads_started":2}
I20260709 13:18:13.006500 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2112) took 3586 ms. Trace:
W20260709 13:18:13.007375 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.114827 18358 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:13.179034 18417 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.179868 18478 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.180204 18403 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:12.919189 18575 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.248032 18575 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.255050 15746 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:13.258668 18404 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.259701 18404 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.261221 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.262734 16305 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:13.263657 18404 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.264159 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:13.266620 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.267227 15747 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:18:13.269994 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.271338 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 621102us
I20260709 13:18:13.272282 18358 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.279997 18556 consensus_queue.cc:1059] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:13.275437 18417 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.281337 18556 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:13.281774 18556 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:13.283115 18417 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.283466 18556 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.285022 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:13.284940 18478 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.286666 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:13.287472 15596 raft_consensus.cc:2376] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4. Re-sending same reply.
I20260709 13:18:13.287575 18478 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.288106 18560 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:13.289083 18358 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.289012 18560 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.294466 18560 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:13.289086 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.296931 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.288586 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:13.305298 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1497) took 2711 ms. Trace:
I20260709 13:18:13.310619 15747 rpcz_store.cc:276] 0709 13:18:10.591419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.265787 (+2674368us) service_pool.cc:224] Handling call
0709 13:18:13.266594 (+   807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.300840 (+ 34246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.301052 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.311811 18404 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:13.371881 15596 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:18:13.363269 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:13.240463 15748 rpcz_store.cc:276] 0709 13:18:09.419341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.775772 (+2356431us) service_pool.cc:224] Handling call
0709 13:18:11.776081 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:11.777863 (+  1782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.777890 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:11.804638 (+ 26748us) log.cc:844] Serialized 52 byte log entry
0709 13:18:12.031044 (+226406us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:12.031100 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.031204 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.005613 (+974409us) raft_consensus.cc:1685] finished
0709 13:18:13.005666 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.006128 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":143101,"raft.queue_time_us":27226,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":60346,"thread_start_us":110110,"threads_started":1,"wal-append.queue_time_us":404418}
I20260709 13:18:13.184116 15675 rpcz_store.cc:276] 0709 13:18:11.310191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.476411 (+166220us) service_pool.cc:224] Handling call
0709 13:18:11.476809 (+   398us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:12.453802 (+976993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.453836 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:12.454656 (+   820us) log.cc:844] Serialized 78 byte log entry
0709 13:18:12.647357 (+192701us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:12.984024 (+336667us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.985031 (+  1007us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.985353 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.985535 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.985655 (+   120us) raft_consensus.cc:1685] finished
0709 13:18:12.985672 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.985992 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62910,"prepare.queue_time_us":882147,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":109,"raft.queue_time_us":179205,"raft.run_cpu_time_us":581,"raft.run_wall_time_us":56965,"thread_start_us":1083252,"threads_started":2,"wal-append.queue_time_us":211708}
I20260709 13:18:13.402642 15747 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:18:13.403132 15747 pending_rounds.cc:85] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 6
I20260709 13:18:13.403469 15747 pending_rounds.cc:107] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:13.403769 15747 raft_consensus.cc:2889] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.407742 18556 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:13.416985 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.418375 18349 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.419432 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:13.419338 18349 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:13.420966 18596 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:13.421489 18596 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.421914 18596 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:13.405553 18404 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:13.396306 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:13.428481 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1499) took 2811 ms. Trace:
I20260709 13:18:13.429059 15747 rpcz_store.cc:276] 0709 13:18:10.594882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.351905 (+2757023us) service_pool.cc:224] Handling call
0709 13:18:13.395735 (+ 43830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.404383 (+  8648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.406423 (+  2040us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.436785 15596 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:13.435371 18417 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.447023 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1751) took 1634 ms. Trace:
I20260709 13:18:13.447482 15596 rpcz_store.cc:276] 0709 13:18:11.804539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.414248 (+1609709us) service_pool.cc:224] Handling call
0709 13:18:13.434881 (+ 20633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.438767 (+  3886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.439000 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.448156 18417 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:13.449273 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 126528us
I20260709 13:18:13.445218 18349 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:13.456378 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 93444.9us
I20260709 13:18:13.462936 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.468458 18551 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.476684 16302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 679) took 1159 ms. Trace:
I20260709 13:18:13.479290 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:13.480865 18404 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:13.479063 16302 rpcz_store.cc:276] 0709 13:18:12.285832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.286305 (+   473us) service_pool.cc:224] Handling call
0709 13:18:12.380142 (+ 93837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.423052 (+ 42910us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:12.679593 (+256541us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.437683 (+758090us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.442471 (+  4788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.443056 (+   585us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.443685 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.444271 (+   586us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.445558 (+  1287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194839,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":138,"raft.queue_time_us":65527,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":416,"thread_start_us":703511,"threads_started":3,"wal-append.queue_time_us":408030}
I20260709 13:18:13.485673 18453 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.486493 18453 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.487996 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 764) took 1705 ms. Trace:
I20260709 13:18:13.489671 18417 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.491065 18359 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:13.497294 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 47261.8us
I20260709 13:18:13.511773 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:13.513278 15602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 439) took 1698 ms (client timeout 1579 ms). Trace:
W20260709 13:18:13.514062 15602 rpcz_store.cc:269] 0709 13:18:11.814501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.825960 (+ 11459us) service_pool.cc:224] Handling call
0709 13:18:13.512740 (+1686780us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54001013d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.512992 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530106624}
W20260709 13:18:13.517778 15601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1531) took 1709 ms (client timeout 1840 ms). Trace:
W20260709 13:18:13.518411 15601 rpcz_store.cc:269] 0709 13:18:11.807966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.995360 (+187394us) service_pool.cc:224] Handling call
0709 13:18:13.517280 (+1521920us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b540012b454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.517536 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3002752}
I20260709 13:18:13.519968 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:13.522864 15599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1748) took 1741 ms (client timeout 1867 ms). Trace:
W20260709 13:18:13.523478 15599 rpcz_store.cc:269] 0709 13:18:11.799372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.811781 (+ 12409us) service_pool.cc:224] Handling call
0709 13:18:13.522186 (+1710405us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54002d73d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.522610 (+   424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966349568}
W20260709 13:18:13.526144 15594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1756) took 1720 ms (client timeout 2030 ms). Trace:
W20260709 13:18:13.526922 15594 rpcz_store.cc:269] 0709 13:18:11.806004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.008500 (+202496us) service_pool.cc:224] Handling call
0709 13:18:13.525632 (+1517132us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54001009d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.525890 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921171712}
I20260709 13:18:13.529073 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1510) took 4370 ms. Trace:
I20260709 13:18:13.529660 15597 rpcz_store.cc:276] 0709 13:18:09.158622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.125476 (+966854us) service_pool.cc:224] Handling call
0709 13:18:11.256729 (+1131253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.630412 (+373683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.528482 (+1898070us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001478d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.528822 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562780032}
W20260709 13:18:13.531769 15751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1481) took 4531 ms (client timeout 2891 ms). Trace:
I20260709 13:18:13.536512 18608 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:13.537653 18608 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:13.539297 16310 consensus_meta.cc:287] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.964s	user 0.007s	sys 0.012s
W20260709 13:18:13.532364 15751 rpcz_store.cc:269] 0709 13:18:09.000688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.803102 (+1802414us) service_pool.cc:224] Handling call
0709 13:18:13.531243 (+2728141us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003057d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.531522 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325217664}
I20260709 13:18:13.542878 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:13.545261 18453 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:13.552568 16304 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:18:13.556890 15747 raft_consensus.cc:1240] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:13.557467 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 669) took 1568 ms. Trace:
I20260709 13:18:13.557952 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 630) took 2679 ms. Trace:
I20260709 13:18:13.558481 15747 rpcz_store.cc:276] 0709 13:18:10.878257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.439600 (+2561343us) service_pool.cc:224] Handling call
0709 13:18:13.459516 (+ 19916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.557568 (+ 98052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.557819 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.560055 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:13.561561 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1746) took 1780 ms. Trace:
I20260709 13:18:13.562048 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 435) took 1748 ms. Trace:
I20260709 13:18:13.558027 16304 rpcz_store.cc:276] 0709 13:18:11.999607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.004321 (+  4714us) service_pool.cc:224] Handling call
0709 13:18:13.551743 (+1547422us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:13.552074 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.557159 (+  5085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.557413 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26880384}
I20260709 13:18:13.568682 18346 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:13.569722 18352 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:13.581193 15598 rpcz_store.cc:276] 0709 13:18:11.780988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.781105 (+   117us) service_pool.cc:224] Handling call
0709 13:18:11.781360 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.248675 (+1467315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.561278 (+312603us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540012c854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:13.561483 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720350592}
I20260709 13:18:13.488547 16306 rpcz_store.cc:276] 0709 13:18:11.782137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.782265 (+   128us) service_pool.cc:224] Handling call
0709 13:18:11.792918 (+ 10653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.801375 (+  8457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.487311 (+1685936us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b5400603454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:13.487767 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15126784}
I20260709 13:18:13.575904 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:13.577595 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 624) took 3311 ms. Trace:
I20260709 13:18:13.516301 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:13.582563 15599 rpcz_store.cc:276] 0709 13:18:11.813395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.560721 (+1747326us) service_pool.cc:224] Handling call
0709 13:18:13.561142 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.561563 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.561599 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.561682 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:13.561747 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.561826 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.561959 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.585459 18352 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:13.590200 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 164683us
I20260709 13:18:13.586040 15743 rpcz_store.cc:276] 0709 13:18:10.266353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.142475 (+1876122us) service_pool.cc:224] Handling call
0709 13:18:12.228667 (+ 86192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.446241 (+217574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:12.446270 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.446310 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:12.446343 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.577063 (+1130720us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400303ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:13.577136 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.577398 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499913984}
I20260709 13:18:13.594117 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:13.594280 18352 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:13.583310 18346 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:13.595469 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:13.597352 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:13.599119 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:13.606158 15598 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:13.601023 18404 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.607419 18346 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:13.607690 18404 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.603322 18352 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.608820 18346 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:13.610921 18404 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:13.618290 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.618769 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:13.649307 15599 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.649506 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:13.656265 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 153769us
I20260709 13:18:13.660851 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:13.666908 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:13.669804 18498 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:18:13.675478 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.677160 15601 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:13.677932 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 441) took 1857 ms. Trace:
I20260709 13:18:13.678301 15601 rpcz_store.cc:276] 0709 13:18:11.820649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.627049 (+1806400us) service_pool.cc:224] Handling call
0709 13:18:13.676961 (+ 49912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.677641 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.677833 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.682647 18382 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.683552 18382 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.668463 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:13.647578 18608 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.660290 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:13.701980 15747 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:13.714282 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 55806.3us
I20260709 13:18:13.719285 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:13.721035 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:13.708688 18608 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.728789 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 129982us
I20260709 13:18:13.730484 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.738991 16295 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:13.739184 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 1970) took 3517 ms. Trace:
I20260709 13:18:13.747145 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.728463 18477 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:13.739732 15669 rpcz_store.cc:276] 0709 13:18:10.221688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.693078 (+471390us) service_pool.cc:224] Handling call
0709 13:18:11.950628 (+1257550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.981170 (+ 30542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.738682 (+1757512us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54003af2d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.738948 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2891215232}
I20260709 13:18:13.730942 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:13.759701 15599 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:13.760388 15565 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:13.765694 16310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 682) took 1337 ms. Trace:
W20260709 13:18:13.731524 18619 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:18:13.766680 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.765390 15601 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:13.769937 15743 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:13.766096 16310 rpcz_store.cc:276] 0709 13:18:12.428210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.429917 (+  1707us) service_pool.cc:224] Handling call
0709 13:18:12.437729 (+  7812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.712572 (+1274843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.718307 (+  5735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.722932 (+  4625us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:13.722973 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.727149 (+  4176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.765624 (+ 38475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7705,"raft.queue_time_us":46006,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":6211,"thread_start_us":120512,"threads_started":1}
W20260709 13:18:13.776144 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.734589 18425 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:13.761672 18575 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:13.762656 16299 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 674) took 2019 ms (client timeout 1896 ms). Trace:
I20260709 13:18:13.782176 18623 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:13.782405 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.783018 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.783808 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 631) took 2892 ms. Trace:
I20260709 13:18:13.794831 15751 rpcz_store.cc:276] 0709 13:18:10.891003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.708976 (+2817973us) service_pool.cc:224] Handling call
0709 13:18:13.757787 (+ 48811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.783346 (+ 25559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.783386 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.783463 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.783504 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.783581 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.783736 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.784721 18544 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:13.784790 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:13.786067 15743 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:13.799314 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2115) took 2091 ms. Trace:
I20260709 13:18:13.799631 15743 rpcz_store.cc:276] 0709 13:18:11.707378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.774176 (+2066798us) service_pool.cc:224] Handling call
0709 13:18:13.785829 (+ 11653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.799026 (+ 13197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.799228 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.800642 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:13.801301 15743 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:13.788800 18554 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.803182 18554 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:13.792191 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.792623 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.796723 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72866.7us
I20260709 13:18:13.744344 18608 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:13.805701 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.833002 18360 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:13.798784 18544 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:13.825202 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.809218 15599 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:13.835644 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1550) took 1565 ms. Trace:
I20260709 13:18:13.812674 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.836160 15599 rpcz_store.cc:276] 0709 13:18:12.270260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.777784 (+1507524us) service_pool.cc:224] Handling call
0709 13:18:13.809004 (+ 31220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.835298 (+ 26294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.835570 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.825835 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.834343 16307 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:13.806278 18621 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.855085 15598 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
W20260709 13:18:13.804783 18512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.638s	user 0.018s	sys 0.055s
W20260709 13:18:13.873052 18512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.827s	user 0.018s	sys 0.056s
I20260709 13:18:13.873461 18512 consensus_queue.cc:1243] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:13.833966 18544 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:13.874156 15598 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:13.874212 18424 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:13.875133 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 447) took 1603 ms. Trace:
I20260709 13:18:13.875597 15598 rpcz_store.cc:276] 0709 13:18:12.271303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.873287 (+1601984us) service_pool.cc:224] Handling call
0709 13:18:13.873711 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.874808 (+  1097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.875040 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.827527 18608 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:13.796362 16299 rpcz_store.cc:269] 0709 13:18:11.728546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.732205 (+  3659us) service_pool.cc:224] Handling call
0709 13:18:13.746883 (+2014678us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:13.748380 (+  1497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22029568}
I20260709 13:18:13.806635 16302 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:18:13.876892 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.814085 18382 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.833876 18360 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:13.834076 18358 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.877924 18358 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:13.878436 18360 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:13.868896 16308 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:13.881546 18358 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:13.881649 18382 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.882340 18382 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.886821 18349 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.884514 18382 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.887888 18382 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:13.887531 18349 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:13.889348 18558 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.850s	user 0.023s	sys 0.057s
W20260709 13:18:13.889725 18558 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.908s	user 0.023s	sys 0.057s
W20260709 13:18:13.890981 18622 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:18:13.892385 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 438) took 2078 ms. Trace:
I20260709 13:18:13.892771 15602 rpcz_store.cc:276] 0709 13:18:11.814281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.602444 (+1788163us) service_pool.cc:224] Handling call
0709 13:18:13.653171 (+ 50727us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.673395 (+ 20224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.673424 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.674020 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.704808 (+ 30788us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.704849 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.704913 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.892146 (+187233us) raft_consensus.cc:1685] finished
0709 13:18:13.892168 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.892309 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7020,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":30346,"threads_started":1,"wal-append.queue_time_us":45576}
I20260709 13:18:13.896512 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.897409 16305 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:13.898380 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:13.901912 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 446) took 1630 ms. Trace:
I20260709 13:18:13.902311 15599 rpcz_store.cc:276] 0709 13:18:12.271076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.842540 (+1571464us) service_pool.cc:224] Handling call
0709 13:18:13.901286 (+ 58746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.901535 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.901576 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.901632 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.901665 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.901716 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.901860 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.906755 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:13.909713 18359 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.910245 18359 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:13.911482 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.912195 16302 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:13.913329 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.914448 18560 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:13.914866 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.915059 18560 raft_consensus.cc:697] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:13.915560 16305 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:13.916913 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.917569 18544 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.888623 18382 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:13.918147 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.919926 15600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1546) took 2107 ms (client timeout 2183 ms). Trace:
W20260709 13:18:13.925653 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.918233 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:13.918851 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:13.859515 18621 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:13.919615 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50823.8us
I20260709 13:18:13.869262 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:13.925838 15600 rpcz_store.cc:269] 0709 13:18:11.812091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.119716 (+307625us) service_pool.cc:224] Handling call
0709 13:18:13.919694 (+1799978us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400390dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.919872 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878803712}
W20260709 13:18:13.932212 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.827749 18575 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.807418 18623 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:13.936185 16263 leader_election.cc:336] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.542s (SENT)
I20260709 13:18:13.936779 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:13.937790 18613 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:13.938303 18623 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:13.938894 18623 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:13.939425 18623 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.942564 18544 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.942967 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 213) took 10085 ms. Trace:
I20260709 13:18:13.945988 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 442) took 2079 ms. Trace:
I20260709 13:18:13.946419 15601 rpcz_store.cc:276] 0709 13:18:11.866594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.679014 (+1812420us) service_pool.cc:224] Handling call
0709 13:18:13.760715 (+ 81701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.773931 (+ 13216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.945748 (+171817us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b54001d7c50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.945919 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186937216}
I20260709 13:18:13.947695 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:13.948413 18382 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.937840 15751 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:13.948362 15601 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:13.949717 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2118) took 2241 ms. Trace:
I20260709 13:18:13.950050 15751 rpcz_store.cc:276] 0709 13:18:11.707869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.933038 (+2225169us) service_pool.cc:224] Handling call
0709 13:18:13.937646 (+  4608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.949472 (+ 11826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.949663 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.856043 18477 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.916102 18560 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:13.949270 18382 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.969120 18477 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.970255 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 611) took 4438 ms. Trace:
I20260709 13:18:13.943321 15500 rpcz_store.cc:276] 0709 13:18:03.856983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.857204 (+   221us) service_pool.cc:224] Handling call
0709 13:18:13.942712 (+10085508us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:06.354776 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:06.355330 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:06.355365 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:06.355380 (+    15us) tablet.cc:662] Decoding operations
0709 13:18:06.497850 (+142470us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:06.497925 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:06.497961 (+    36us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:18:06.499336 (+  1375us) tablet.cc:701] Row locks acquired
0709 13:18:06.499360 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:18:06.499547 (+   187us) write_op.cc:270] Start()
0709 13:18:06.499681 (+   134us) write_op.cc:276] Timestamp: P: 1783603086499487 usec, L: 0
0709 13:18:06.499708 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:06.500480 (+   772us) log.cc:844] Serialized 5470 byte log entry
0709 13:18:07.391850 (+891370us) op_driver.cc:464] REPLICATION: finished
0709 13:18:07.583607 (+191757us) write_op.cc:301] APPLY: starting
0709 13:18:07.604924 (+ 21317us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:07.644757 (+ 39833us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:07.644897 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:07.646507 (+  1610us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:07.646771 (+   264us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:18:07.646819 (+    48us) write_op.cc:312] APPLY: finished
0709 13:18:07.647198 (+   379us) log.cc:844] Serialized 101 byte log entry
0709 13:18:07.648876 (+  1678us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.649036 (+   160us) write_op.cc:454] Released schema lock
0709 13:18:07.649088 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:07.649529 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:07.649565 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49831,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":127999,"apply.run_cpu_time_us":3914,"apply.run_wall_time_us":89336,"num_ops":14,"prepare.queue_time_us":506721,"prepare.run_cpu_time_us":142656,"prepare.run_wall_time_us":665125,"raft.queue_time_us":120775,"raft.run_cpu_time_us":2009,"raft.run_wall_time_us":185520,"replication_time_us":874363,"thread_start_us":680246,"threads_started":4,"wal-append.queue_time_us":618408,"wal-append.run_cpu_time_us":23738,"wal-append.run_wall_time_us":1523360}]]}
I20260709 13:18:13.970661 15750 rpcz_store.cc:276] 0709 13:18:09.531441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.801614 (+2270173us) service_pool.cc:224] Handling call
0709 13:18:11.801931 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.057353 (+255422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.969823 (+1912470us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54002698d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:13.970054 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585717120}
I20260709 13:18:13.971827 18621 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:13.965458 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:13.976158 15600 raft_consensus.cc:2410] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:18:13.983058 15745 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:13.983728 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 632) took 2204 ms. Trace:
I20260709 13:18:13.984095 15745 rpcz_store.cc:276] 0709 13:18:11.779514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.949158 (+2169644us) service_pool.cc:224] Handling call
0709 13:18:13.965073 (+ 15915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.983492 (+ 18419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.983674 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:13.984557 15714 connection.cc:256] RPC call timeout handler was delayed by -1.4670053810000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:18:13.985301 15714 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:13.985469 15745 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:14.006259 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2123) took 2028 ms. Trace:
I20260709 13:18:14.006778 15745 rpcz_store.cc:276] 0709 13:18:11.978199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.984886 (+2006687us) service_pool.cc:224] Handling call
0709 13:18:13.985263 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.005877 (+ 20614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.006185 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.015772 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.973050 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:14.019549 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2122) took 2044 ms. Trace:
I20260709 13:18:14.022258 15750 rpcz_store.cc:276] 0709 13:18:11.974693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.971757 (+1997064us) service_pool.cc:224] Handling call
0709 13:18:13.972264 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.972557 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.974281 (+  1724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.979841 (+  5560us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.019294 (+ 39453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.019359 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.019485 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.024209 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 84789.6us
I20260709 13:18:14.025425 15599 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:14.027781 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:13.983748 18575 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.028373 15600 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:14.033027 18554 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.035291 15750 raft_consensus.cc:1240] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:14.035455 18382 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.036015 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2126) took 2055 ms. Trace:
I20260709 13:18:14.036198 15742 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:14.036829 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1509) took 1829 ms. Trace:
I20260709 13:18:14.037190 15744 rpcz_store.cc:276] 0709 13:18:12.156078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.416420 (+260342us) service_pool.cc:224] Handling call
0709 13:18:13.979250 (+1562830us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b540030e8d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:13.985727 (+  6477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114675584}
I20260709 13:18:14.037658 15742 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:14.038434 18382 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.038589 15642 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.039572 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.040438 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.043254 15671 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:14.043845 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:14.039521 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.036360 15750 rpcz_store.cc:276] 0709 13:18:11.980198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.023276 (+2043078us) service_pool.cc:224] Handling call
0709 13:18:14.035073 (+ 11797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.035757 (+   684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.035937 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.046831 15601 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:14.029855 15595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 448) took 1758 ms (client timeout 1744 ms). Trace:
W20260709 13:18:14.044979 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 82168.3us
I20260709 13:18:14.050861 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:14.044754 18359 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:14.052834 15751 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:14.053514 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 633) took 2256 ms. Trace:
I20260709 13:18:14.053855 15751 rpcz_store.cc:276] 0709 13:18:11.797471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.965831 (+2168360us) service_pool.cc:224] Handling call
0709 13:18:14.033601 (+ 67770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.053272 (+ 19671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.053441 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.054838 18419 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:14.055250 18419 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.055570 18419 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:14.055832 18596 consensus_meta.cc:287] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.006s
I20260709 13:18:14.060992 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.062713 15675 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:14.064083 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:14.048445 15595 rpcz_store.cc:269] 0709 13:18:12.271519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.422932 (+151413us) service_pool.cc:224] Handling call
0709 13:18:14.021808 (+1598876us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400087fd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:14.029785 (+  7977us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218652032}
I20260709 13:18:14.065496 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.065577 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:14.066192 15674 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:18:14.066859 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.067154 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.067679 15595 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:14.067876 15673 raft_consensus.cc:2376] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6. Re-sending same reply.
I20260709 13:18:14.068835 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.069540 18623 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.064707 15676 raft_consensus.cc:2376] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6. Re-sending same reply.
I20260709 13:18:14.069548 15600 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:14.071329 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.072209 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2114) took 2343 ms. Trace:
W20260709 13:18:14.075146 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.072961 18512 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.075764 18618 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:14.076153 18512 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.076355 18626 consensus_queue.cc:1059] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:14.075238 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:14.077212 15748 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:14.077636 15748 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.077776 18626 raft_consensus.cc:3055] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:14.078339 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:14.056306 18596 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.078485 18626 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:14.076303 18618 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:14.092782 18382 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:14.079149 18575 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:14.080390 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 772) took 2091 ms. Trace:
I20260709 13:18:14.114540 18406 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:14.113901 18626 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.117796 18406 raft_consensus.cc:697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.118250 18626 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:14.118943 18406 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.116314 18425 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:14.092916 15497 catalog_manager.cc:5697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.122586 15497 catalog_manager.cc:5697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 2 to 4, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 4 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.123453 16309 rpcz_store.cc:276] 0709 13:18:11.988977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.005026 (+ 16049us) service_pool.cc:224] Handling call
0709 13:18:14.018105 (+2013079us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800061b98. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:14.049316 (+ 31211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.073124 (+ 23808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.073164 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.079957 (+  6793us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:14.080025 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.080087 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.080220 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24258432}
I20260709 13:18:14.125483 18575 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:14.126072 18575 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.125821 15497 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.080761 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:14.107512 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 365690us
I20260709 13:18:14.079651 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2125) took 2100 ms. Trace:
I20260709 13:18:14.075333 15672 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:14.103286 15751 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:14.091120 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 456) took 1560 ms. Trace:
W20260709 13:18:14.099547 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 61064.6us
I20260709 13:18:14.078641 18512 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:14.116757 18618 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.117303 15742 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:14.078519 15748 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.128134 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:14.129199 15749 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 634) took 2207 ms (client timeout 2186 ms). Trace:
I20260709 13:18:14.129776 15743 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:14.130501 18349 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.130692 18419 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.073863 15601 raft_consensus.cc:2376] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6. Re-sending same reply.
W20260709 13:18:14.143087 15749 rpcz_store.cc:269] 0709 13:18:11.921261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.963140 (+ 41879us) service_pool.cc:224] Handling call
0709 13:18:14.128808 (+2165668us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54002599d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:14.129024 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289799424}
I20260709 13:18:14.111513 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.113955 18382 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:14.088063 15640 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:14.116242 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:14.125494 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1537) took 2315 ms. Trace:
I20260709 13:18:14.135617 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 628) took 3686 ms. Trace:
I20260709 13:18:14.152565 15596 rpcz_store.cc:276] 0709 13:18:11.809926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.456507 (+1646581us) service_pool.cc:224] Handling call
0709 13:18:14.021658 (+565151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.045125 (+ 23467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.045154 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.050186 (+  5032us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:14.068795 (+ 18609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.068860 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.125271 (+ 56411us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400146ed0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:14.125416 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298557184}
I20260709 13:18:14.139766 15745 rpcz_store.cc:276] 0709 13:18:11.979644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.007791 (+2028147us) service_pool.cc:224] Handling call
0709 13:18:14.072809 (+ 65018us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.079310 (+  6501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.079337 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.079400 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:14.079428 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.079483 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.079596 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.143931 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 92868.8us
I20260709 13:18:14.140763 15602 rpcz_store.cc:276] 0709 13:18:12.530951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.894326 (+1363375us) service_pool.cc:224] Handling call
0709 13:18:13.894758 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.978577 (+ 83819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.978623 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.018260 (+ 39637us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:14.018326 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.090855 (+ 72529us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b5400247f54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:14.090901 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.091028 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183458048}
W20260709 13:18:14.079834 15593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 450) took 1758 ms (client timeout 1542 ms). Trace:
I20260709 13:18:14.073438 15747 rpcz_store.cc:276] 0709 13:18:11.707199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.724355 (+2017156us) service_pool.cc:224] Handling call
0709 13:18:13.733044 (+  8689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.733443 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:13.928520 (+195077us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.050639 (+122119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.050682 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:14.050720 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.050776 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.050882 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30153,"prepare.queue_time_us":233932,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":46981,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":265786,"threads_started":2,"wal-append.queue_time_us":99910}
W20260709 13:18:14.161512 15593 rpcz_store.cc:269] 0709 13:18:12.271980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.272589 (+   609us) service_pool.cc:224] Handling call
0709 13:18:14.021499 (+1748910us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b5400146ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:14.030360 (+  8861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90689920}
I20260709 13:18:14.152740 15746 rpcz_store.cc:276] 0709 13:18:10.449147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.661813 (+2212666us) service_pool.cc:224] Handling call
0709 13:18:12.662165 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.255687 (+593522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.135368 (+879681us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54003df254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:14.135552 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198983040}
I20260709 13:18:14.184868 18382 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.186267 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 436) took 2372 ms. Trace:
I20260709 13:18:14.186702 15594 rpcz_store.cc:276] 0709 13:18:11.813655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.169322 (+2355667us) service_pool.cc:224] Handling call
0709 13:18:14.185649 (+ 16327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.185903 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.185933 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.185970 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:14.186014 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.186077 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.186202 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:14.188548 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 100685us
I20260709 13:18:14.189760 15748 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.189981 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:14.191784 18623 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:14.181890 15497 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:14.192287 18623 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:14.196974 18623 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.198350 15595 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:14.192708 18596 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:14.201217 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.201736 18454 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:14.202437 18617 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:14.203641 18617 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:14.204028 18617 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:14.204553 18419 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:14.205498 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 89430.3us
I20260709 13:18:14.206454 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.205080 18617 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.184291 18349 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.206727 18621 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:14.179593 18558 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:14.207301 18349 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.207785 18558 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.208853 18558 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.209633 18349 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:14.205363 18425 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:14.209934 18558 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.210836 18425 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:14.211220 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:14.211795 18617 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.204970 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.214044 15600 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:14.214221 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.215112 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.206563 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.216487 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.193324 18620 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:14.216917 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.216944 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.215278 15593 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:14.215726 15600 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:14.212448 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:14.208374 18621 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.220211 15596 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:14.219552 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.218739 15497 catalog_manager.cc:5697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:14.222723 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.223438 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2117) took 2515 ms. Trace:
I20260709 13:18:14.225741 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 437) took 2411 ms. Trace:
I20260709 13:18:14.223250 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.227568 16263 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:14.227888 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:14.228545 15743 rpcz_store.cc:276] 0709 13:18:11.707683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.802001 (+2094318us) service_pool.cc:224] Handling call
0709 13:18:14.129589 (+327588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.143848 (+ 14259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.223204 (+ 79356us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54002599d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:14.223368 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752331136}
I20260709 13:18:14.231211 15750 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:14.222527 18424 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:14.211191 18425 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:14.227953 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.218597 18544 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:14.239886 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.240851 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.219870 18620 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.239769 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.245999 15599 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:14.246307 15601 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.240186 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:14.244113 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.228826 15597 rpcz_store.cc:276] 0709 13:18:11.814053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.742864 (+1928811us) service_pool.cc:224] Handling call
0709 13:18:13.743334 (+   470us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:13.743935 (+   601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.743963 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:13.757119 (+ 13156us) log.cc:844] Serialized 52 byte log entry
0709 13:18:14.027490 (+270371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:14.150097 (+122607us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.150310 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.150396 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.195600 (+ 45204us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b180042fdc0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:14.221115 (+ 25515us) raft_consensus.cc:1685] finished
0709 13:18:14.225523 (+  4408us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.225682 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123766,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":4077,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":258,"spinlock_wait_cycles":31087360,"thread_start_us":236588,"threads_started":1,"wal-append.queue_time_us":422361}
I20260709 13:18:14.244391 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.250535 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.251605 15670 raft_consensus.cc:2410] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:14.248414 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.252836 15743 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:14.256039 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.239524 18499 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:14.254729 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.251425 18587 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:14.278170 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.231447 18419 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:14.281497 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.280074 15602 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260709 13:18:14.282148 15670 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:14.247747 18620 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.278903 15742 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:14.285914 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.283648 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:14.283085 15600 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:18:14.267629 18499 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.295238 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:14.280687 18498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.012s	sys 0.024s
I20260709 13:18:14.296996 15599 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: [4.7-6.8]
W20260709 13:18:14.298058 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 95337.7us
I20260709 13:18:14.294967 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:14.271256 18587 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.303313 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:14.309248 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.285319 18359 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.315541 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.312960 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.313776 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.313894 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.316886 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:14.314481 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.315171 15671 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:14.312418 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:14.299558 18498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.013s	sys 0.024s
I20260709 13:18:14.316207 15668 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:14.321302 15677 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:14.317914 15670 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.323858 15672 raft_consensus.cc:2410] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:18:14.299412 18499 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.325558 15747 raft_consensus.cc:2410] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:14.299412 18554 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:14.332151 15676 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:14.331413 15596 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:18:14.309547 18587 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:14.300354 18424 raft_consensus.cc:697] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.336833 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:14.334383 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 79975.6us
I20260709 13:18:14.336913 15673 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:14.337841 15742 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:14.339419 15746 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:14.339958 15640 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:14.341420 15750 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:14.340873 18425 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.342414 18425 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.349251 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:14.353549 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.355957 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.356819 15668 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:14.357759 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.358480 15674 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
W20260709 13:18:14.364205 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.366390 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.335732 18544 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.365484 18382 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:14.375067 18382 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.375974 15672 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.382673 18382 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.391065 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:14.393955 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.395099 15673 raft_consensus.cc:2410] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:18:14.401427 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.404955 15567 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:14.408926 15748 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:18:14.413678 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 67449.5us
I20260709 13:18:14.456841 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 629) took 3790 ms. Trace:
I20260709 13:18:14.457374 15748 rpcz_store.cc:276] 0709 13:18:10.620010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.407199 (+2787189us) service_pool.cc:224] Handling call
0709 13:18:13.427502 (+ 20303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.077113 (+649611us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54003979a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe667dc0 00007faefe6f21c0 00007faefe6f3231 00007faefe6efd8f 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c
0709 13:18:14.409841 (+332728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.410333 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030257920}
W20260709 13:18:14.458546 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.461634 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.463951 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.352572 18359 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.474470 15601 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:14.475569 15593 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:14.383744 18575 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.486984 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.482900 18626 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.490062 18410 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:18:14.411211 18424 consensus_queue.cc:237] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.490541 18626 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.492316 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.501256 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1555) took 1019 ms. Trace:
I20260709 13:18:14.501734 15593 rpcz_store.cc:276] 0709 13:18:13.482189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.235853 (+753664us) service_pool.cc:224] Handling call
0709 13:18:14.475410 (+239557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.478571 (+  3161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.501031 (+ 22460us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001473d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:14.501189 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519944064}
I20260709 13:18:14.476402 18346 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:14.502810 16263 leader_election.cc:336] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.843s (SENT)
I20260709 13:18:14.503301 16263 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:14.504230 15751 raft_consensus.cc:1240] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:14.482640 18512 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:14.523536 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 173458us
I20260709 13:18:14.525068 15670 raft_consensus.cc:2410] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:14.525039 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:14.511080 15672 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:18:14.511915 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 158054us
W20260709 13:18:14.516748 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.533706 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.535851 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:14.517552 18643 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:18:14.517656 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.517966 18349 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:14.518390 18498 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.518699 18359 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:14.519284 18641 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:18:14.519555 18644 consensus_queue.cc:1059] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:18:14.520249 18649 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.537670 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.551681 15670 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:14.538676 15677 raft_consensus.cc:2410] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:14.541988 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.545161 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.523700 18512 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:14.556313 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:14.556715 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.565732 18575 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.566900 15672 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:14.550024 18544 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.548696 18349 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.571000 18623 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:14.543135 18650 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:14.572005 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:14.582083 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.571679 18623 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.556376 18512 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:14.585913 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 93465.7us
I20260709 13:18:14.555886 18562 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:14.590647 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.571857 18349 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:14.556270 18498 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.593142 18382 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.555779 18626 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.598069 15668 raft_consensus.cc:1217] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-5.7]   Dedup: 3.6->[5.7-5.7]
I20260709 13:18:14.602368 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.609076 15668 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:18:14.609158 15670 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:14.613034 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 452) took 2156 ms. Trace:
I20260709 13:18:14.609993 16306 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:14.604878 18424 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:14.615572 18424 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.615983 18647 consensus_queue.cc:1059] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:14.616568 18382 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:14.617223 18647 raft_consensus.cc:3055] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:14.617648 18647 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:14.618623 18647 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.619735 18558 raft_consensus.cc:3055] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:14.620165 18558 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.620784 18639 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:18:14.602206 18562 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:14.623575 18646 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:18:14.624342 18562 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.625676 18562 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.574280 18649 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.628958 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:14.629287 15601 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:14.630136 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.630771 15674 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:14.630899 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.600811 18575 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:18:14.625051 15673 raft_consensus.cc:2368] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8.
W20260709 13:18:14.632412 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.632676 15593 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:14.633845 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.634325 15673 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:18:14.616628 18424 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:14.636372 18652 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:18:14.636737 18636 log.cc:927] Time spent T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:18:14.638747 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.642463 15567 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:14.643689 18477 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:14.644223 18477 raft_consensus.cc:697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:14.644891 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.645597 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.644974 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.646435 16310 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:14.647488 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.646139 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.650337 16307 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:14.651065 18558 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.651664 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.645157 18477 consensus_queue.cc:237] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:14.653833 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.645810 15670 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.631628 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.653213 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:14.659502 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.984s (SENT)
I20260709 13:18:14.614364 15598 rpcz_store.cc:276] 0709 13:18:12.456433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.876512 (+1420079us) service_pool.cc:224] Handling call
0709 13:18:13.979205 (+102693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.126892 (+147687us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:14.404294 (+277402us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.612545 (+208251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.612688 (+   143us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:14.612749 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.612834 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.612975 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24487,"prepare.queue_time_us":72281,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":28959,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":99,"thread_start_us":424978,"threads_started":2}
W20260709 13:18:14.660755 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 107016us
I20260709 13:18:14.654714 16305 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:18:14.618803 15676 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:14.677340 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.679464 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.684713 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:14.684976 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 76196.6us
I20260709 13:18:14.686518 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.662262 18647 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.687134 15670 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:14.687832 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.690879 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.596539 18618 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.693437 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.694307 15676 raft_consensus.cc:2410] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:18:14.691526 16307 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:14.696031 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.695981 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.696879 15598 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
W20260709 13:18:14.695272 15642 connection.cc:256] RPC call timeout handler was delayed by -1.2948816319999423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
I20260709 13:18:14.697918 15599 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:14.692996 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.700847 15671 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:14.700910 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.701748 15593 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:14.702421 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:14.707602 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:14.708209 15596 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:14.710023 15594 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:18:14.711272 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 49567.4us
I20260709 13:18:14.711884 15714 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.707746 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:14.713389 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.714020 15674 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:14.716051 18657 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.694828 18650 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:18:14.718495 18587 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.720584 18587 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:14.720726 18559 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.692253 18359 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:14.721964 15749 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:14.722167 18359 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:14.721227 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.722630 18359 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:14.723644 16263 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:14.723592 18359 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.724628 18454 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:14.724701 18360 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:14.725245 18454 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:14.726248 18454 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.728164 18650 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:14.728556 18650 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:14.695677 18406 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.721421 18485 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:14.731912 15597 raft_consensus.cc:2393] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:14.741657 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.735337 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.746233 15675 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:14.755111 16265 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:14.707093 18558 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:14.758315 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:14.756494 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45265.9us
I20260709 13:18:14.696496 18349 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:18:14.760994 15565 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:14.762549 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:14.729008 18650 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:14.787458 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.722204 18618 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:14.792582 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.754757 18485 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.761803 18623 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:14.760890 18575 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:14.802453 18359 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.721304 18587 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:18:14.721256 18559 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.819595 18559 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:14.759681 18406 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.822561 18406 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.796312 18485 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:14.824802 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 62320.6us
I20260709 13:18:14.825060 16304 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:14.825618 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:14.825822 18617 consensus_meta.cc:287] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.007s
I20260709 13:18:14.826779 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:14.830843 15596 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:14.788543 18608 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:14.804832 18626 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:14.807816 18654 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:14.793506 18613 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.793670 18657 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:14.826493 16309 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:14.801756 18556 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:14.842267 18556 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:14.843406 18556 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.809044 18539 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:14.845667 18539 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.848174 18539 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.849141 18657 raft_consensus.cc:697] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:14.795408 18649 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:14.862716 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 107680us
W20260709 13:18:14.861610 18620 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.553s	user 0.003s	sys 0.007s
I20260709 13:18:14.837405 18575 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:14.839401 18406 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:14.813445 18498 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.833283 18608 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:14.885661 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.891088 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 138118us
I20260709 13:18:14.880209 18349 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.903503 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 146893us
I20260709 13:18:14.840996 18626 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.895162 18406 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:14.907160 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 198502us
I20260709 13:18:14.882305 18620 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.912235 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:14.900192 18618 consensus_queue.cc:1059] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:18:14.920009 15673 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:14.908582 18406 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:14.920356 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.926637 15670 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.929245 18657 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.933705 15670 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:14.933789 18662 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:14.935039 15669 raft_consensus.cc:1240] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:14.935335 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:14.936178 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:14.936380 15674 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:14.936838 15669 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:14.936228 15670 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
W20260709 13:18:14.921147 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.946503 18620 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:14.947172 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.949312 18661 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:18:14.921733 18559 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:14.914974 18649 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:18:14.913333 18346 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:18:14.952279 18655 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.411s	user 0.004s	sys 0.000s
I20260709 13:18:14.952666 18346 raft_consensus.cc:3055] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:14.953094 18346 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:14.953956 18346 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.955233 18346 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.914851 18562 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:18:14.955730 18608 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.959916 18485 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.958364 18608 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:14.962222 18485 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:14.961912 18650 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:14.925616 18596 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:14.903199 18349 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:14.907624 18575 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:18:14.967854 15642 connection.cc:256] RPC call timeout handler was delayed by -1.1742816319999747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:18:14.971367 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.910699 18644 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:18:14.965606 18499 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.002s
W20260709 13:18:14.980485 15642 connection.cc:256] RPC call timeout handler was delayed by -1.139181631999918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
W20260709 13:18:14.980314 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 192596us
I20260709 13:18:14.910590 18613 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:18:14.995450 18560 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:14.996295 18644 consensus_queue.cc:1243] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:14.999112 18512 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:15.001770 18670 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:15.004768 18499 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.005695 18410 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:15.006126 18410 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:15.006219 18454 raft_consensus.cc:3055] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:15.006657 18454 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.007021 18410 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.007476 18454 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.010108 18650 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.011000 18642 raft_consensus.cc:3055] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:15.011436 18642 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:15.011942 15677 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:15.036566 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.037441 15743 raft_consensus.cc:2393] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:15.007787 18562 raft_consensus.cc:3055] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:15.046981 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 89122.6us
I20260709 13:18:15.048319 18512 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:15.052114 15716 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:15.055519 18657 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.056072 18657 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.056494 18657 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.056864 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:15.061755 18349 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.062482 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.063169 15749 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:14.989238 18424 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:15.064112 18424 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.066226 18424 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:15.056710 15746 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: [4.7-6.8]
I20260709 13:18:15.007031 18499 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:15.044562 18562 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.074771 18650 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:15.075358 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.075771 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:15.075676 18562 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.076421 15750 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:14.981451 18485 consensus_queue.cc:1059] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:18:15.074077 18556 consensus_queue.cc:1059] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:15.039324 18406 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.067904 18539 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.077394 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.082790 15669 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
W20260709 13:18:15.083410 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.084434 15748 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:15.085233 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.046233 18618 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.077042 18562 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.111771 15750 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:15.075378 18650 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.096194 18626 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.097234 18635 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:15.097826 15565 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.078815 18596 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.098657 18551 raft_consensus.cc:3055] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:15.098585 18618 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.100165 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.100844 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:15.074045 18454 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.081456 18575 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:15.012360 18642 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.107661 18410 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.085011 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.117324 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.117256 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.127496 16310 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:15.144191 15743 raft_consensus.cc:2393] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:15.126060 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:15.130178 15565 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.145449 16307 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:15.133212 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:15.147675 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 47565.5us
I20260709 13:18:15.148888 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.149720 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.150799 15749 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:15.152485 16304 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:15.147653 18647 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.155023 18647 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.116060 18657 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.156038 18650 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.157338 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:15.157848 18657 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:15.158535 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.158452 18569 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:18:15.159480 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:15.159979 15714 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.162086 18644 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.163048 18644 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.161677 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:15.164717 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.165588 15565 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.165984 15714 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.167375 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.121922 18635 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:15.169641 18642 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.171738 18644 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:15.173132 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 55976.9us
I20260709 13:18:15.174290 18346 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.174839 18349 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.175194 18671 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.214484 18671 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.214884 18671 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.214915 18657 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:15.175863 15744 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:15.217621 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.218240 15744 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:15.218616 18596 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.219192 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.221092 18657 consensus_queue.cc:1059] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:15.221414 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.222358 18657 raft_consensus.cc:3055] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:15.222709 18657 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:15.222959 18424 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:15.223383 18587 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:15.223847 18587 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.223584 18657 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.225042 18657 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.224766 18587 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.225883 18587 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.159631 18569 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:15.180351 15751 raft_consensus.cc:2368] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:15.121289 18485 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:15.180964 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 103629us
I20260709 13:18:15.233777 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.127346 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:15.232470 18569 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.129390 18551 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:15.242587 18551 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.243955 18551 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.187592 18404 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:18:15.187884 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.187999 18419 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:15.192766 18644 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.246500 18406 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:15.246891 18644 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:15.193230 16299 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:18:15.247520 16299 pending_rounds.cc:85] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 7
I20260709 13:18:15.193594 18360 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:15.248154 18360 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:15.143575 18477 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.248806 18477 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.186863 15565 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.249145 18360 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.249836 18675 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:15.249200 18477 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.247818 16299 pending_rounds.cc:107] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:18:15.252543 16299 raft_consensus.cc:2889] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:15.196221 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.198690 18539 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:15.199843 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.141894 18575 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:15.205065 18635 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:15.254396 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54676us
I20260709 13:18:15.254964 18635 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.255276 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:15.256307 18626 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.257153 18626 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.257622 18626 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:15.208508 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.209154 18613 raft_consensus.cc:3055] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:15.249881 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 63080.8us
I20260709 13:18:15.259402 18613 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.260066 15565 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.260872 18539 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.260414 18613 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.261250 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.261780 18613 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.262326 18485 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.211953 18618 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:15.195856 18650 consensus_queue.cc:1059] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:18:15.266543 18650 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:15.176390 18512 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.266942 18650 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.286149 18650 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.287566 18650 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.236462 18346 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:15.288826 18346 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:15.289283 18346 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:15.289541 15748 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:15.289768 18560 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:15.235076 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.258100 18626 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.238116 15744 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:15.290963 18560 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:15.291404 18560 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.292117 18485 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:15.292490 15746 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:15.237983 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.183689 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.293991 18419 consensus_queue.cc:1243] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:15.208278 18647 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.269192 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:15.247795 18569 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.289062 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:15.258915 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:15.263270 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:15.308192 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 73180.8us
I20260709 13:18:15.303048 18406 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:15.307231 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 119419us
I20260709 13:18:15.318813 15567 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.320218 16265 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:15.270391 18410 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:15.335532 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72348us
I20260709 13:18:15.326639 16299 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.337218 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:15.338143 18675 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:15.338658 15567 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.338792 18675 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:15.339886 18675 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.340405 18359 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.326900 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:15.343420 18349 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.343652 18419 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.343971 18349 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:15.344182 18419 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:15.348794 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.351969 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.356103 15640 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:15.343580 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 84755.9us
I20260709 13:18:15.316942 18587 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:15.332231 15500 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 6 to 7, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.335263 18559 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.376451 15669 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:15.344506 18349 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.375211 15500 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 5, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 5 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.349120 18554 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:15.340940 18359 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:15.379756 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:15.383837 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:15.389441 15675 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.378448 15640 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:15.390403 15596 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:18:15.389320 15599 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:15.390903 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:15.385409 15500 catalog_manager.cc:5697] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 5, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:15.367067 18569 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:15.318671 18512 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:18:15.365806 18419 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:15.387717 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 49156.7us
I20260709 13:18:15.393116 15500 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:15.371516 18499 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:15.398530 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:15.401582 15601 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.374140 18404 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:15.404198 15593 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.404630 15602 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:15.404268 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:15.405975 15595 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:15.406105 15600 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
W20260709 13:18:15.406838 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.399955 15500 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:15.381963 18360 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.409157 16308 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:15.381662 18559 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:15.353430 18410 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.416370 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.410024 15500 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 6, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 6 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:15.417217 15714 leader_election.cc:400] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8.
I20260709 13:18:15.390756 18359 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.405226 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:15.418103 15500 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:15.408411 18587 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.423122 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:15.424877 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:15.404937 18623 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:15.433848 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.405241 18499 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:15.436345 15602 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:15.440876 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:15.442507 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:15.435951 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 291) took 10986 ms. Trace:
I20260709 13:18:15.395299 18617 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:15.418900 18559 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.456401 15600 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:15.461433 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 45144us
I20260709 13:18:15.462697 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.463052 15714 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:15.373018 18560 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.469591 15675 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:15.470089 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:15.471689 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:15.472795 18657 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:15.470978 15565 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:15.437829 18608 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:15.474581 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54991.6us
I20260709 13:18:15.478600 15642 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:15.479698 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.446601 18499 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.418679 18620 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:18:15.473347 18657 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:18:15.475492 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 85437.2us
I20260709 13:18:15.418658 18360 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.445498 15497 rpcz_store.cc:276] 0709 13:18:04.452388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.453403 (+  1015us) service_pool.cc:224] Handling call
0709 13:18:15.435878 (+10982475us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:14.601140 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:14.601893 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:14.607973 (+  6080us) write_op.cc:435] Acquired schema lock
0709 13:18:14.610551 (+  2578us) tablet.cc:662] Decoding operations
0709 13:18:14.646980 (+ 36429us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:14.647056 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:14.647082 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:14.647851 (+   769us) tablet.cc:701] Row locks acquired
0709 13:18:14.647907 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:18:14.648060 (+   153us) write_op.cc:270] Start()
0709 13:18:14.648199 (+   139us) write_op.cc:276] Timestamp: P: 1783603094648002 usec, L: 0
0709 13:18:14.648221 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:14.648946 (+   725us) log.cc:844] Serialized 2075 byte log entry
0709 13:18:14.933165 (+284219us) op_driver.cc:464] REPLICATION: finished
0709 13:18:15.154853 (+221688us) write_op.cc:301] APPLY: starting
0709 13:18:15.154987 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:15.155231 (+   244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:15.155429 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:15.156411 (+   982us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:15.156814 (+   403us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:18:15.156880 (+    66us) write_op.cc:312] APPLY: finished
0709 13:18:15.157326 (+   446us) log.cc:844] Serialized 47 byte log entry
0709 13:18:15.157564 (+   238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.157676 (+   112us) write_op.cc:454] Released schema lock
0709 13:18:15.157754 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:15.182189 (+ 24435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:15.182233 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":592725,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":221308,"apply.run_cpu_time_us":3479,"apply.run_wall_time_us":27336,"num_ops":5,"prepare.queue_time_us":237953,"prepare.run_cpu_time_us":27841,"prepare.run_wall_time_us":143420,"raft.queue_time_us":71422,"raft.run_cpu_time_us":60068,"raft.run_wall_time_us":160493,"replication_time_us":284730,"thread_start_us":438960,"threads_started":4,"wal-append.queue_time_us":163643}]]}
I20260709 13:18:15.459646 18404 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:15.490924 15601 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:15.448905 18424 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:15.411825 18575 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.476632 18485 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.481323 18539 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:15.483209 18558 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:18:15.518252 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 47344.2us
I20260709 13:18:15.487442 18618 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:15.529281 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.530898 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 90104.7us
I20260709 13:18:15.532967 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:15.481475 18686 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:18:15.533655 15595 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:15.484875 18671 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.524873 18618 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.538982 18558 raft_consensus.cc:697] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:15.563930 18620 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:15.564615 18620 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.565126 18620 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:15.565318 18684 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:15.566634 18575 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.503453 18644 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:15.541661 18539 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:15.530467 18454 consensus_queue.cc:1059] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:15.603297 18454 consensus_queue.cc:1243] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:15.603885 18454 raft_consensus.cc:3055] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:15.604238 18454 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:15.561127 18618 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:15.574287 18558 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.574869 18657 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.573920 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:15.636806 15601 raft_consensus.cc:606] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.579650 18694 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:15.638233 18694 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:15.639156 18694 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.643004 16309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
W20260709 13:18:15.647372 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.649665 18671 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.523373 18587 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.632550 18697 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:15.633352 18693 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:15.696414 15594 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:15.696380 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:15.700728 15677 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.568802 18623 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:15.776818 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 124346us
W20260709 13:18:15.780224 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.583767 18560 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:15.789250 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45014.2us
W20260709 13:18:15.790515 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 327854us
I20260709 13:18:15.792153 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.793591 18688 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:15.794618 18551 consensus_meta.cc:287] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.550s	user 0.015s	sys 0.009s
W20260709 13:18:15.795594 18635 consensus_meta.cc:287] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.011s
I20260709 13:18:15.587018 18668 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:15.605089 18454 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:15.807632 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 332236us
I20260709 13:18:15.783142 18512 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:15.821772 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.807581 18410 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:15.826784 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:15.832026 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.832489 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.817319 18671 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:15.834618 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 356128us
I20260709 13:18:15.821499 18635 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.845229 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:15.850657 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:15.819128 18642 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:18:15.852993 15642 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:15.810644 18668 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.828150 18608 raft_consensus.cc:697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:15.863540 18626 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.015s
I20260709 13:18:15.822466 18512 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:15.863852 18346 consensus_meta.cc:287] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.015s
I20260709 13:18:15.852532 18635 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.855247 18617 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.869397 18696 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:15.870183 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:15.871297 15744 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:15.871872 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:15.873493 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:15.883683 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.884696 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 69075.7us
I20260709 13:18:15.888801 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:15.889379 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:15.900353 15743 raft_consensus.cc:2376] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6. Re-sending same reply.
I20260709 13:18:15.900748 16308 raft_consensus.cc:2410] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:15.900687 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:15.893716 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 45891.2us
I20260709 13:18:15.893607 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:15.902763 16295 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.904471 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:15.905150 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:15.907295 18617 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.897742 18696 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.908691 18512 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:15.909051 18696 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:15.912433 18698 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:15.915751 18608 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:15.917735 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:15.920086 15677 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
W20260709 13:18:15.921119 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:15.922730 15593 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.507s	user 0.012s	sys 0.012s
I20260709 13:18:15.923249 15593 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:15.873894 18686 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:15.930593 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:15.931304 15599 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:15.933235 15749 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:18:15.971174 18349 consensus_meta.cc:287] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.572s	user 0.015s	sys 0.010s
I20260709 13:18:15.971683 18349 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.972813 18617 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.914067 18635 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:15.897871 18346 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:15.979455 18569 consensus_meta.cc:287] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.582s	user 0.023s	sys 0.005s
W20260709 13:18:15.983451 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 80660.3us
I20260709 13:18:15.925551 18406 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:15.982075 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:15.843689 18623 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:15.912678 18360 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:15.988297 15642 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:15.894846 18626 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:15.988700 18359 consensus_meta.cc:287] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.553s	user 0.004s	sys 0.015s
I20260709 13:18:16.004335 15599 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:16.009509 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.012332 15669 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:16.009806 15677 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:16.013981 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.016309 15669 raft_consensus.cc:1217] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Deduplicated request from leader. Original: 5.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:18:16.016789 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.017117 15669 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:15.981901 18647 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:16.019244 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:16.022359 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.026885 15671 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:15.997641 18650 consensus_meta.cc:287] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.710s	user 0.014s	sys 0.016s
I20260709 13:18:16.021734 15565 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.028617 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.029995 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.030645 15599 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:16.013305 16299 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.009s
I20260709 13:18:16.039454 16309 raft_consensus.cc:606] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.039562 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.040066 16309 raft_consensus.cc:614] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:16.019636 18477 consensus_meta.cc:287] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.763s	user 0.007s	sys 0.021s
I20260709 13:18:16.035683 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:15.993644 18404 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.050048 15750 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:16.042584 15669 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.051728 15750 pending_rounds.cc:85] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 5
I20260709 13:18:16.052151 15750 pending_rounds.cc:107] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:16.034940 15675 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:16.047034 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:16.028031 18419 consensus_meta.cc:287] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.617s	user 0.001s	sys 0.018s
W20260709 13:18:16.049839 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 54169.1us
I20260709 13:18:16.014034 18406 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:18:16.006654 18499 consensus_meta.cc:287] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.513s	user 0.015s	sys 0.003s
I20260709 13:18:16.052446 15750 raft_consensus.cc:2889] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:16.055706 15594 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:16.058066 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.057317 15677 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:16.060827 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:16.062140 15594 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.062736 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:16.014430 18642 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:18:16.067605 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.076625 15675 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:16.044417 18694 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:15.993721 18696 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.165705 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:16.167007 15677 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:16.024406 18359 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.039706 16299 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:16.098124 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.055536 18539 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:16.210799 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 148098us
I20260709 13:18:16.218750 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.053268 18419 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.053643 18647 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:16.247550 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.210939 18613 consensus_meta.cc:287] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.940s	user 0.015s	sys 0.017s
I20260709 13:18:16.051942 18477 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.249692 15597 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:16.252759 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:16.255754 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.093039 18558 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.091918 18551 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 13:18:16.274329 18558 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:16.274839 18558 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.274433 18406 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.275228 18558 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:16.263785 15595 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.013s
I20260709 13:18:16.065495 18499 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.219758 18635 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:16.255386 18559 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.006s
I20260709 13:18:16.293336 18668 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:16.293889 18559 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.217571 18694 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:16.296765 18719 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:16.297293 18694 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.298671 18695 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.288s
I20260709 13:18:16.301683 15599 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.279307 15746 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:16.278868 15595 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:16.282423 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 218408us
I20260709 13:18:16.296365 18559 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:16.286540 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.217247 18618 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:16.296465 18665 log.cc:927] Time spent T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 13:18:16.312449 15671 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:16.289312 18349 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:16.328102 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 75522.4us
I20260709 13:18:16.338816 15748 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:16.339411 16295 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:16.318116 18709 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.316541 18695 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:16.337035 18703 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:18:16.365036 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.332235 18719 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:18:16.350371 18702 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.360437 18349 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.362107 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.397986 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.398584 15669 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.368207 18696 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:16.369035 18710 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:18:16.370131 18477 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.320515 18699 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:16.371398 18499 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:16.374030 18706 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.511s	user 0.002s	sys 0.006s
W20260709 13:18:16.375590 18717 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:18:16.378502 18485 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:16.379235 18694 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:16.380443 18554 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:18:16.427201 15672 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:16.381915 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.386827 18454 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.387699 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.430270 15668 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:16.389209 15675 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:16.341382 18626 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.350379 18359 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:16.414410 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 108136us
W20260709 13:18:16.426090 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:16.437830 15640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.012s	sys 0.022s
W20260709 13:18:16.445197 15640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.012s	sys 0.023s
I20260709 13:18:16.439888 15669 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:16.437542 18647 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:16.445607 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 913888us
I20260709 13:18:16.458824 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.428855 18694 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.366338 18720 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:18:16.414252 18696 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:16.405416 18349 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.471084 18349 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.471791 18696 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.474045 18696 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.464567 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.430370 18485 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.479130 18485 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.366588 18709 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.500367 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.503386 15594 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:18:16.505564 18723 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:18:16.493593 18419 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:16.507090 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.463526 18694 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.501937 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.509419 15600 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.509181 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.400815 18702 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.512636 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.515157 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.517061 15594 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
W20260709 13:18:16.504734 18662 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.005s	sys 0.015s
I20260709 13:18:16.463887 18626 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:18:16.506752 18699 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.510926 18499 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:16.514954 18635 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:16.530444 18675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.024s	sys 0.028s
I20260709 13:18:16.527082 18722 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.546823 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 213869us
W20260709 13:18:16.527647 18662 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.005s	sys 0.015s
W20260709 13:18:16.547211 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 104237us
I20260709 13:18:16.547665 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.548235 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:16.549103 15674 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:16.551249 15642 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:16.552388 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.554636 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.554880 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:16.543748 18675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.024s	sys 0.029s
I20260709 13:18:16.556367 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.540905 18499 raft_consensus.cc:697] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:16.558607 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.528198 18707 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:18:16.554492 18608 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.560563 18406 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:16.560829 18719 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:16.573371 18719 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:16.571359 18721 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.571849 15602 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:16.553505 18644 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.576584 16304 raft_consensus.cc:2410] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:16.541728 18635 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.554602 18419 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.559166 18699 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:16.557775 18623 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:16.580173 18512 consensus_queue.cc:1059] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:18:16.557675 18720 consensus_queue.cc:1059] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:16.594329 15598 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:16.578742 18477 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.583549 18724 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:16.603996 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 659) took 1254 ms. Trace:
I20260709 13:18:16.605008 15746 rpcz_store.cc:276] 0709 13:18:15.349615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.349977 (+   362us) service_pool.cc:224] Handling call
0709 13:18:15.350425 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.304239 (+953814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.603741 (+299502us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54002cf6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:16.603935 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2135783808}
I20260709 13:18:16.583865 18618 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.589679 18623 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.578449 18695 consensus_queue.cc:1059] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
W20260709 13:18:16.608536 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52273.1us
I20260709 13:18:16.584151 18699 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:16.575070 18721 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.611207 15642 leader_election.cc:400] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:16.551851 18722 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.609464 18709 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:16.611106 18623 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.624883 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:16.620195 18575 consensus_meta.cc:287] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.053s	user 0.022s	sys 0.007s
I20260709 13:18:16.615633 18644 raft_consensus.cc:3055] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:16.624811 15671 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.611501 18699 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:16.628279 18644 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:16.629721 18695 raft_consensus.cc:3055] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:16.630090 18695 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:16.630308 18644 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.630877 18695 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.631508 18644 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.574362 18719 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.633603 18635 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.634019 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.605070 18477 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.626755 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.627867 15673 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:16.622915 18724 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:16.628763 15745 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:18:16.634531 15676 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.637552 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.639623 15676 raft_consensus.cc:1240] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:16.634887 15670 raft_consensus.cc:2410] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:16.636590 15598 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:16.641417 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.626811 18618 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.643785 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.644464 15676 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
W20260709 13:18:16.645156 18726 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:16.647425 18722 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.648769 18477 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.649739 18721 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.614867 18499 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.652900 18454 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.653477 18454 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.653728 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.654410 15600 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:16.654894 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.655522 18454 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.656004 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.657361 15602 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:18:16.659215 18346 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.659871 18346 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:16.655486 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.662807 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.658784 15565 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.664302 15675 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:16.667284 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.675143 15673 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.678798 15673 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: [4.7-6.8]
W20260709 13:18:16.638402 18697 consensus_meta.cc:287] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.859s	user 0.000s	sys 0.013s
I20260709 13:18:16.682494 15671 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:16.685228 15671 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:18:16.695242 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.696174 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.696988 15673 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:18:16.676868 18620 consensus_meta.cc:287] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 1.109s	user 0.013s	sys 0.015s
I20260709 13:18:16.688639 18346 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:16.673218 18419 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.720777 15675 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:16.693100 18697 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:16.736299 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.707858 18346 raft_consensus.cc:697] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:16.692335 18618 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.737398 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.725072 18454 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.724481 18739 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.739646 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.708757 18620 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.743767 15598 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:16.736502 18642 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:18:16.754851 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:16.756467 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:16.757232 16302 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
W20260709 13:18:16.757506 18714 log.cc:927] Time spent T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.499s	user 0.003s	sys 0.000s
I20260709 13:18:16.740350 18720 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:18:16.758903 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.759366 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:16.759981 16308 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:16.765219 15593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1575) took 1386 ms (client timeout 1519 ms). Trace:
I20260709 13:18:16.765359 15596 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:16.765789 15593 rpcz_store.cc:269] 0709 13:18:15.378393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.379480 (+  1087us) service_pool.cc:224] Handling call
0709 13:18:16.765009 (+1385529us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54001cb6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:16.765154 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29174656}
I20260709 13:18:16.766754 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 474) took 1328 ms. Trace:
I20260709 13:18:16.767194 15596 rpcz_store.cc:276] 0709 13:18:15.438614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.438766 (+   152us) service_pool.cc:224] Handling call
0709 13:18:16.765157 (+1326391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.765915 (+   758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.766551 (+   636us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54001cb6d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:16.766692 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2997726080}
W20260709 13:18:16.769795 18733 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:18:16.771868 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.776181 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:16.777585 18406 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:16.778071 18406 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:16.778422 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.783475 16308 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:16.786273 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.797333 15750 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:16.798115 15674 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.798797 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.744521 18346 consensus_queue.cc:237] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.799875 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.801023 15742 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:16.802001 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:16.803022 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.803838 15744 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 3.
I20260709 13:18:16.804708 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:16.804801 15750 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:16.805298 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:16.805799 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:16.806414 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.807142 15744 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:16.757315 15670 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:18:16.789929 18618 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.747192 18739 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.791661 18694 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:16.792891 18741 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:18:16.793071 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:16.793502 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:16.793989 18558 consensus_meta.cc:287] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.001s
I20260709 13:18:16.746111 18454 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.795953 16299 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:16.796378 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.788327 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.804912 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.819590 15749 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:16.819578 15743 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:18:16.822785 18694 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.823900 18419 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.819936 15600 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:16.814530 15670 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.816419 15598 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:16.817539 15674 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:16.826697 15674 pending_rounds.cc:85] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 7
I20260709 13:18:16.826967 15674 pending_rounds.cc:107] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:16.827265 15674 raft_consensus.cc:2889] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:16.829712 18739 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.834232 18699 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.835511 15676 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:16.815174 18644 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:18:16.840205 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.778940 18406 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.847538 18406 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.850728 18454 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:16.841980 15600 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:16.842767 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.844851 16295 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:16.846129 18744 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:16.841908 18644 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:16.836498 18699 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.858946 15742 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:16.819713 18558 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.863153 15747 raft_consensus.cc:2368] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:16.836483 18623 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.883383 18558 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:16.886569 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.889592 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.891862 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:16.892743 15676 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:16.892764 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.893894 15673 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:16.897156 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.898386 15598 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:16.899501 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.901160 18635 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:16.893474 18454 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.906018 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.908308 18707 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:16.910804 18626 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.911329 18626 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.913542 18626 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.907080 18499 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:16.905205 18697 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.897375 18693 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.916654 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.918918 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.898825 18671 consensus_queue.cc:1059] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:18:16.920483 18739 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:16.921490 18671 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:16.921893 18671 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:16.922928 18623 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.922799 18671 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.924022 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1537) took 1824 ms. Trace:
I20260709 13:18:16.924090 18671 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:16.923331 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1576) took 1544 ms. Trace:
I20260709 13:18:16.924820 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.924886 15597 rpcz_store.cc:276] 0709 13:18:15.378655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.386391 (+  7736us) service_pool.cc:224] Handling call
0709 13:18:15.398186 (+ 11795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.265986 (+867800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.923102 (+657116us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b54001013d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:16.923273 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957703936}
I20260709 13:18:16.925540 15598 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:16.924448 15745 rpcz_store.cc:276] 0709 13:18:15.099887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.222331 (+122444us) service_pool.cc:224] Handling call
0709 13:18:15.222621 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.638792 (+1416171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.923798 (+285006us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b5400276ad4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:16.923954 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3233052544}
I20260709 13:18:16.917194 18454 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.931013 18620 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.932236 18454 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.934116 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 481) took 1061 ms. Trace:
I20260709 13:18:16.939090 15601 rpcz_store.cc:276] 0709 13:18:15.872324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.872475 (+   151us) service_pool.cc:224] Handling call
0709 13:18:15.872822 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.887109 (+1014287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.887149 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.887198 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:16.887229 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.933870 (+ 46641us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001cb1d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:16.933920 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.934056 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2331927424}
I20260709 13:18:16.934576 18539 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:16.934629 15596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
W20260709 13:18:16.928489 16263 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.744s (SENT)
I20260709 13:18:16.916855 18635 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.941074 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.941560 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.941385 18539 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.942287 15595 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:16.942553 18662 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:16.942857 18635 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.943513 18539 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.944949 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:16.945670 15595 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:16.943538 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.946772 15597 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:16.940828 15596 raft_consensus.cc:606] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.948403 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.948925 18419 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.949149 15599 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:16.949416 18419 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:16.949847 18732 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.950343 18732 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.950780 15677 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:16.951609 18419 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:16.951737 18404 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.949189 18424 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.952069 15599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:16.952677 15599 raft_consensus.cc:606] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:16.952533 18424 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:16.953034 15599 raft_consensus.cc:614] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:16.954299 18732 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.954569 18424 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:16.954867 18732 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:16.956249 15669 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:16.958400 18587 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.958945 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.958900 18587 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.959539 18732 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:16.960461 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:16.961900 18647 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:16.962689 15677 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:16.962404 18647 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.963663 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.963889 18558 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:16.964293 15595 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:16.964711 18404 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:16.966048 18587 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.964483 18647 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:16.967406 18404 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:16.965005 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.968771 16263 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:16.969871 15676 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:16.970049 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:16.971203 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 63157us
I20260709 13:18:16.971138 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.973039 15598 raft_consensus.cc:2410] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:18:16.973896 18739 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:16.974325 18739 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:16.974691 18739 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:16.976497 18701 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.114s	user 0.003s	sys 0.003s
I20260709 13:18:16.984278 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.986529 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.986801 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:16.987190 15750 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:16.987728 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:16.988109 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.988551 15749 raft_consensus.cc:2410] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:16.987807 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:16.989517 15744 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:16.990001 15642 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:16.990939 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:16.992333 15750 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:16.993062 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:16.993820 15743 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:16.977811 18647 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:16.977995 18406 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:16.972506 18587 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:16.995460 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:17.065308 18406 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:17.099731 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:17.101526 15598 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
W20260709 13:18:17.102991 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 94455us
I20260709 13:18:17.100000 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.108613 15749 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
W20260709 13:18:17.110179 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.099701 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.111536 15744 raft_consensus.cc:2393] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:16.978988 18662 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.115356 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:17.075724 18410 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.039s	sys 0.077s
I20260709 13:18:16.996066 18647 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.117527 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.120159 18346 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.122140 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.122468 18346 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.109679 18349 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:18:17.123298 18686 raft_consensus.cc:3055] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:17.123775 18686 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:17.120365 18558 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.124704 18406 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.125082 18558 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.127091 18558 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.102499 18404 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.128788 18404 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.130676 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.119273 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:17.132536 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:17.119485 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:17.119966 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 135801us
I20260709 13:18:17.137023 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.131592 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:17.137257 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.137673 15676 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:17.137254 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.137982 16310 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:17.100736 18697 raft_consensus.cc:2764] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:17.139931 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:17.102252 18635 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.142491 15714 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:17.139389 15745 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:17.140839 15749 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.140803 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.144410 16310 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:17.148105 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:17.148804 15744 raft_consensus.cc:2393] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 4: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:17.148857 16308 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:17.147470 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:17.134799 18410 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.039s	sys 0.077s
I20260709 13:18:17.156384 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:17.156824 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.157208 15745 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.157712 16306 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:17.159368 16309 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:18:17.159865 16309 pending_rounds.cc:85] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 6
I20260709 13:18:17.160166 16309 pending_rounds.cc:107] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:18:17.160462 16309 raft_consensus.cc:2889] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.160867 16309 pending_rounds.cc:107] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:18:17.161190 16309 raft_consensus.cc:2889] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.164108 15567 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.164485 16307 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:18:17.124495 18346 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.135775 18647 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.101780 18620 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:18:17.145174 18722 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:17.177446 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:17.186463 15598 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:17.178495 18671 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:17.179194 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.180042 15749 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:17.180948 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:17.194376 15597 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:18:17.181802 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.195259 16302 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 4.
I20260709 13:18:17.136078 18477 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:17.184118 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.199178 18647 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.187824 15745 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:17.192054 16308 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:17.192986 18671 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:17.182315 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62895.2us
I20260709 13:18:17.202322 16295 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:17.205454 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:17.156242 18644 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:17.156390 18587 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:17.165026 18693 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:17.208526 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 74120.7us
I20260709 13:18:17.228097 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:17.200119 18702 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.165692 18721 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:18:17.204622 18722 raft_consensus.cc:697] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:17.204627 18346 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:17.254706 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.257237 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.257427 15716 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:17.257706 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 120538us
I20260709 13:18:17.257915 15749 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:17.209077 18644 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.255962 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.260018 15673 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 3.
I20260709 13:18:17.257360 15669 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:17.255283 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.262374 15676 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:17.247611 18635 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:18:17.263810 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 108540us
I20260709 13:18:17.273298 15565 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:17.276443 15594 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:17.279264 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.280009 15749 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:17.282809 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:17.284071 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 78718.5us
I20260709 13:18:17.279181 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:17.285063 15676 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:17.285012 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.288477 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.288865 15597 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:18:17.289791 15676 raft_consensus.cc:2410] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:17.290383 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:17.292181 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.293937 15749 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:17.295840 15642 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.297878 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.239529 18587 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.264886 18644 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.303718 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.266434 18635 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:17.264506 18753 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.269620 18575 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:17.269605 18702 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.311347 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2150) took 1453 ms. Trace:
I20260709 13:18:17.313289 15748 rpcz_store.cc:276] 0709 13:18:15.858428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.858922 (+   494us) service_pool.cc:224] Handling call
0709 13:18:17.311143 (+1452221us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54003057d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:17.311290 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010941312}
W20260709 13:18:17.317417 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 45299us
W20260709 13:18:17.322098 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.302508 18620 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:17.323529 18620 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.323899 18620 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.326798 18404 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.327224 18671 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.327896 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.328544 15745 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:17.329079 18686 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.332206 18754 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:17.305550 18626 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:17.333222 18626 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:17.333491 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.333774 18626 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:17.334762 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.335363 16302 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:17.313589 18575 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.337105 18575 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.338316 18406 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:17.341089 15676 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:17.299417 18693 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.341940 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.299813 18697 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:17.305279 18454 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.345184 18454 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:17.348790 18750 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.280s	user 0.002s	sys 0.004s
I20260709 13:18:17.349720 15744 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:17.350888 18702 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.359850 18657 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:17.304545 18499 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:18:17.362756 18751 log.cc:927] Time spent T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:18:17.311724 18635 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.372512 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2029) took 1316 ms. Trace:
I20260709 13:18:17.372999 15672 rpcz_store.cc:276] 0709 13:18:16.056150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.056408 (+   258us) service_pool.cc:224] Handling call
0709 13:18:16.091746 (+ 35338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.427715 (+335969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.372135 (+944420us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54001cd9d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:17.372424 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770540800}
I20260709 13:18:17.365458 18349 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:17.375991 18349 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:17.376471 18349 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.276410 18704 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:18:17.312337 18759 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.396092 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:17.396488 18759 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.397151 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:17.398530 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.399196 18759 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.399533 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:17.394428 18419 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:17.400877 18419 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.401330 18558 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:17.401837 18558 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:17.403086 18419 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.402755 18558 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.403661 18419 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:17.404017 18419 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.404350 18419 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.405392 18618 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:17.395015 18512 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:17.395262 18499 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:17.373746 18727 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.827s	user 0.003s	sys 0.000s
I20260709 13:18:17.375898 18410 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:17.404790 18404 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:17.404999 18722 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.397161 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 688) took 1536 ms. Trace:
I20260709 13:18:17.456629 16304 rpcz_store.cc:276] 0709 13:18:15.861197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.861363 (+   166us) service_pool.cc:224] Handling call
0709 13:18:17.396944 (+1535581us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b540023a5d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:17.397083 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556846464}
I20260709 13:18:17.394578 18702 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.394634 18454 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.377615 18647 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.387110 15640 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:17.427402 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 159339us
W20260709 13:18:17.464298 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 77321.6us
I20260709 13:18:17.465302 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.466820 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.434092 18709 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:17.469511 16263 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:17.426311 18618 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:17.436502 18410 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:17.455668 18623 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:17.488914 18623 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:17.489880 18623 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.491102 18623 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.471396 18697 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:17.474633 18454 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:18:17.471287 18693 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:17.494125 18693 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:17.495028 18693 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.485100 18647 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:18:17.472707 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:17.487931 18410 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.480122 18499 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:17.497435 18410 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:17.502594 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 103118us
I20260709 13:18:17.503436 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:17.476084 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 202933us
I20260709 13:18:17.510514 15669 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:17.522307 15640 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:17.472046 18709 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:17.546046 15669 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:17.434043 18512 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.500774 18618 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:17.566789 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.551523 15565 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:17.563190 18360 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:17.481935 18587 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.538427 18697 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:17.410830 18739 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.572223 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:17.584236 15597 raft_consensus.cc:2410] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:17.546662 18404 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:17.580394 18719 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:17.580688 18647 raft_consensus.cc:697] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:17.581992 18764 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:17.585713 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 104931us
I20260709 13:18:17.571645 15668 raft_consensus.cc:1217] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Deduplicated request from leader. Original: 2.2->[5.3-7.4]   Dedup: 5.3->[7.4-7.4]
I20260709 13:18:17.563941 18732 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.582666 18360 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.596797 15668 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:18:17.541358 18499 consensus_queue.cc:1059] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:18:17.602660 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:17.600864 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 49411us
I20260709 13:18:17.590234 18587 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.575434 18671 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:18:17.597494 18719 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:17.583453 18346 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:17.610158 18761 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:17.602093 18360 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.575434 18575 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.597059 18404 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.637216 18774 consensus_queue.cc:1059] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:18:17.656068 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 351040us
I20260709 13:18:17.595340 18647 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.622335 18772 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:17.611070 18620 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.650771 18761 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:17.685897 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 366574us
I20260709 13:18:17.687465 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:18:17.691125 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 88521.9us
I20260709 13:18:17.625237 18587 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.692593 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:17.693867 15567 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.678134 18732 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.729164 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.729707 18732 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.730489 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1830) took 1078 ms. Trace:
I20260709 13:18:17.731262 18587 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:17.700038 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 82147.3us
I20260709 13:18:17.662357 18721 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:18:17.732244 18575 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.689370 18512 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:17.706910 18771 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:17.692195 18778 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:18:17.775060 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48722 (request call id 90) took 1096 ms. Trace:
I20260709 13:18:17.683933 18761 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.775517 15746 rpcz_store.cc:276] 0709 13:18:16.636722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.636863 (+   141us) service_pool.cc:224] Handling call
0709 13:18:17.703953 (+1067090us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54002599d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f6735 00007faefe6ee9fa 00007faf036b64c9 00007faefcc32c54 00007faefcc32be2 00007faefcc32b11 00007faefcc32a8c 00007faefcc31d42 00007faefca2b48c 00007faefca2a8c6
0709 13:18:17.733229 (+ 29276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164005248}
I20260709 13:18:17.776379 16308 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:17.725045 18768 raft_consensus.cc:993] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:18:17.727259 18404 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:17.727736 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:17.777859 16310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:17.778553 16310 raft_consensus.cc:606] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.778909 16310 raft_consensus.cc:614] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:17.728102 18739 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.681594 18779 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:17.728914 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:17.713152 18775 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:17.730859 15671 rpcz_store.cc:276] 0709 13:18:16.652091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.686096 (+ 34005us) service_pool.cc:224] Handling call
0709 13:18:16.686429 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.691681 (+  5252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.691727 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.303314 (+611587us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b2c00010828. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefcfe9a11 00007faefcff9372 00007faefe72ba01 00007faefe6f043a 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2
0709 13:18:17.309937 (+  6623us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.590844 (+280907us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:17.590884 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.590950 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.730225 (+139275us) raft_consensus.cc:1685] finished
0709 13:18:17.730243 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.730431 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2133,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":15093,"spinlock_wait_cycles":2416384,"thread_start_us":180212,"threads_started":1,"wal-append.queue_time_us":291508}
I20260709 13:18:17.683615 18772 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:17.741915 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 147507us
I20260709 13:18:17.696787 18704 raft_consensus.cc:2764] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:18:17.786098 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.789276 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.788978 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.798285 16307 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:17.788523 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:17.799065 16306 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:17.733078 18753 raft_consensus.cc:3055] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:17.694365 18697 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:17.798045 16299 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.736347 18764 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:17.822176 18764 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.822620 18764 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:17.824841 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.827771 18776 raft_consensus.cc:1081] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:18:17.782027 18778 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:17.780459 18779 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.832430 16299 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:17.830204 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:17.797797 18499 raft_consensus.cc:3055] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:17.843492 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 105034us
I20260709 13:18:17.729171 18419 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.799134 18784 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:17.805575 18753 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:17.804823 18732 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.801200 18739 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:18:17.860060 18406 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:17.862236 15673 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:17.866313 18644 consensus_meta.cc:287] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.001s
I20260709 13:18:17.866936 18644 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.836995 18778 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:17.867796 18620 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.870111 18349 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.857533 18783 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.816571 18721 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:18:17.867754 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.872213 18772 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.874059 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:17.905025 15671 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:17.905920 18662 raft_consensus.cc:3055] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:17.876513 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.906373 18662 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:17.907307 18662 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.908324 18662 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:17.877719 15486 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:17.878298 18753 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.879149 18618 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.881500 18695 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:17.817085 18346 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.844866 18499 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:17.883641 18709 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.888761 18776 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:17.870702 18784 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:18:17.893723 18635 consensus_meta.cc:287] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 13:18:17.843281 18779 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.895381 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1592) took 1131 ms. Trace:
I20260709 13:18:17.884837 18697 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:17.898873 18626 consensus_meta.cc:287] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.000s
W20260709 13:18:17.946435 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.899082 18644 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.875032 18419 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:17.942657 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.949455 15746 raft_consensus.cc:2410] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:17.902530 18360 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:17.918548 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:17.918562 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 115924us
I20260709 13:18:17.933759 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.937796 18784 consensus_queue.cc:1243] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:17.938613 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:17.911397 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.953768 15742 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:18:17.965298 15677 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:17.969084 15742 pending_rounds.cc:85] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 5
I20260709 13:18:17.969436 15742 pending_rounds.cc:107] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:18:17.969759 15742 raft_consensus.cc:2889] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.955871 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:17.917101 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 254892us
I20260709 13:18:17.961052 18410 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.972793 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.965598 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:17.973968 16265 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:17.939131 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 206502us
I20260709 13:18:17.975713 15743 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:17.976085 15743 pending_rounds.cc:85] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 3
I20260709 13:18:17.976322 15743 pending_rounds.cc:107] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:17.944121 15602 rpcz_store.cc:276] 0709 13:18:16.763964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.772820 (+  8856us) service_pool.cc:224] Handling call
0709 13:18:16.773131 (+   311us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:16.773987 (+   856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.774017 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:16.776310 (+  2293us) log.cc:844] Serialized 78 byte log entry
0709 13:18:16.839704 (+ 63394us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:16.857539 (+ 17835us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.857762 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.857834 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.845614 (+987780us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b180033cd00. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:17.895057 (+ 49443us) raft_consensus.cc:1685] finished
0709 13:18:17.895154 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.895314 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168,"prepare.queue_time_us":17599,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2107,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":1873,"spinlock_wait_cycles":5292672,"thread_start_us":62855,"threads_started":1,"wal-append.queue_time_us":86559}
I20260709 13:18:17.981735 16299 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:18:17.983055 15716 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:17.976557 15743 raft_consensus.cc:2889] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:17.990718 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:17.949528 18709 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:17.998828 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.999584 15642 leader_election.cc:400] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:17.999933 15642 leader_election.cc:403] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.000082 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:18.001922 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:17.939740 18575 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:18:17.909276 18783 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.004769 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:18.004446 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:18.001134 16307 raft_consensus.cc:2376] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7. Re-sending same reply.
I20260709 13:18:18.008170 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.943079 18635 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:17.986248 18719 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:17.989711 18758 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:18.030592 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2151) took 2171 ms. Trace:
I20260709 13:18:18.018262 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:17.989078 18410 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.042026 15744 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:18.043092 18410 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.045333 18618 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.017123 18349 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.050869 18360 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:17.994835 15677 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:17.990429 18419 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:17.963728 18626 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.000128 18775 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:17.938687 18776 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.003875 18539 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:18.019920 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:18.013974 18623 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:18.031023 15751 rpcz_store.cc:276] 0709 13:18:15.859295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.859580 (+   285us) service_pool.cc:224] Handling call
0709 13:18:15.872549 (+ 12969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.872782 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:17.317339 (+1444557us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b18003dd620. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefe2984bc 00007faefb5e648b 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb600455 00007faf020e83c7 00007faefe6fa9a7 00007faefe70a0bf
0709 13:18:17.365768 (+ 48429us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.991547 (+625779us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.030251 (+ 38704us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.030303 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:18.030351 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.030416 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.030534 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25903,"prepare.queue_time_us":233181,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":46730,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":30726,"spinlock_wait_cycles":7127936,"thread_start_us":727026,"threads_started":4,"wal-append.queue_time_us":221382}
I20260709 13:18:18.007794 18798 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:18.076229 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:18.076723 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 74517.7us
W20260709 13:18:18.071970 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.081851 15674 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:18:18.030496 18758 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.030061 18719 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:18.096915 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 95039us
I20260709 13:18:18.059284 18539 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:18.006973 18766 consensus_queue.cc:1059] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 13:18:18.090492 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 91044.4us
W20260709 13:18:18.110890 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 126621us
I20260709 13:18:18.033033 18424 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:17.990759 18499 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.083194 18623 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:18.133082 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:18.088497 18798 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:18.003041 18794 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:18:18.105480 18758 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:18.109814 18719 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:18.147341 15668 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:18.136222 15716 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:18.116642 18784 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.118712 18539 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.156319 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:18.161224 16302 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:18.161827 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:18.117323 15674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:18:18.176329 15674 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:18.176936 15674 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.165608 15747 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:18.165877 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:18.224107 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 87952.7us
I20260709 13:18:18.225020 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:18.225088 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 63350.8us
I20260709 13:18:18.226486 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:18.230003 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:18.105118 18764 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.232335 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:18.246425 15751 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.148684 18644 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:18:18.147877 18424 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.233492 18499 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.298583 15668 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:18.150681 18404 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:18:18.301990 16305 raft_consensus.cc:2368] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
I20260709 13:18:18.154268 18618 consensus_queue.cc:1059] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 13:18:18.156654 18772 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:18:18.305761 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.271210 18775 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:18.247054 18410 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:18.306288 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.306910 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.337379 15598 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:18.338397 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:18.308547 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.339666 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.340230 15601 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:18.308947 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.309289 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.343550 15601 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:18.303722 16295 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:18.271814 18512 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.271456 18406 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:18.314991 15597 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:18.276283 18722 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:18.281304 18587 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:18.273981 18759 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:18.362869 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:18.371338 15600 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:18.364493 15593 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
W20260709 13:18:18.367619 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.223425 18784 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.298782 18721 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:18.387917 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.388862 15594 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:18.314922 18781 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:18.371286 18816 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:18.397562 18816 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:18.400182 18801 log.cc:927] Time spent T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:18:18.400956 18770 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.720s	user 0.035s	sys 0.037s
W20260709 13:18:18.402015 18808 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:18:18.402688 18804 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:18:18.403702 18815 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:18.393119 18721 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.417385 15602 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:18.370494 18775 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:18.302044 18797 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.401s
I20260709 13:18:18.369822 18512 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.447862 18512 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:18.449000 18721 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.458087 18784 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.376456 18798 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:18.475929 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.489020 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:18.489907 15594 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:18.492799 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:18.505262 15600 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:18.506875 18792 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.462183 18776 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.347883 18623 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.509481 15714 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:18.531157 15750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.028s
W20260709 13:18:18.534957 15750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.011s	sys 0.028s
I20260709 13:18:18.384465 18722 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.541313 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:18.555495 15601 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:18.553944 18404 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:18:18.445034 15674 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.513046 18512 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:18.422284 18626 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.436769 18818 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.534902 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:18.560940 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:18.581357 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 46544.1us
I20260709 13:18:18.581580 15600 raft_consensus.cc:2393] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:18.546211 18709 consensus_meta.cc:287] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.005s
I20260709 13:18:18.561020 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:18.562354 15668 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:18.582230 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:18.582727 18404 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:18.583365 18722 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.580873 18818 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.547297 18644 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:18.556789 18779 consensus_meta.cc:287] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.002s
I20260709 13:18:18.539659 18776 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:18.593842 15600 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:18.594067 18404 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.606710 18818 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.607478 18817 raft_consensus.cc:3055] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:18.611513 18816 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.633627 18776 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.635987 18776 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.637253 18539 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:18.624497 18761 consensus_meta.cc:287] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.834s	user 0.010s	sys 0.001s
I20260709 13:18:18.616087 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:18.584983 18775 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.602000 18644 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:18.662917 18644 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:18.663506 15746 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:18.664149 18635 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.645706 15598 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.615926 15674 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:18.652794 18695 consensus_meta.cc:287] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.001s
W20260709 13:18:18.630678 18662 consensus_meta.cc:287] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.711s	user 0.003s	sys 0.009s
I20260709 13:18:18.659409 15751 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:18.618788 18512 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:18.631347 18817 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:18.648756 18539 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.619005 18764 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.534976 18792 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.631138 18404 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.636271 18753 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:18.683054 15745 raft_consensus.cc:2410] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:18.686523 15598 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:18.665390 18360 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.009s	sys 0.047s
I20260709 13:18:18.625463 18779 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.694139 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:18.690665 18512 raft_consensus.cc:697] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:18.702039 18512 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.706146 18779 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.695649 18618 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.709772 16309 raft_consensus.cc:2368] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:18:18.709425 18618 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.712904 18792 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:18.715225 15594 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:18.718801 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:18.697999 15674 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
W20260709 13:18:18.693216 18778 consensus_meta.cc:287] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.794s	user 0.008s	sys 0.004s
W20260709 13:18:18.725109 15671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.080s	sys 0.128s
W20260709 13:18:18.725560 15671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.080s	sys 0.129s
I20260709 13:18:18.686051 18821 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:18.727876 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:18.729314 18767 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.019s	sys 0.000s
W20260709 13:18:18.729823 18767 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.019s	sys 0.000s
W20260709 13:18:18.725922 15675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.008s	sys 0.010s
W20260709 13:18:18.734615 15675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.010s
I20260709 13:18:18.680251 18719 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.709482 18424 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:18.726192 15749 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.007s	sys 0.011s
I20260709 13:18:18.738936 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:18.704176 18644 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:18.669576 18761 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:18.725723 16304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.013s	sys 0.053s
W20260709 13:18:18.751363 15749 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.007s	sys 0.011s
I20260709 13:18:18.752039 15674 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:18.727433 18792 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:18.738943 18810 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.391s	user 0.000s	sys 0.002s
W20260709 13:18:18.754202 15676 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.005s	sys 0.013s
I20260709 13:18:18.757956 15748 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:18.768167 18783 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.776532 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:18.779531 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:18.787436 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:18.785485 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:18.816847 15567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.004s	sys 0.020s
W20260709 13:18:18.823719 16263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.021s
I20260709 13:18:18.828717 15750 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:18.829541 15600 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:18.830299 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.727339 18778 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.717427 18817 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.890008 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:18.820858 18764 consensus_queue.cc:1059] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:18:19.198367 18764 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:19.198846 18764 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:19.199723 18764 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.201234 18764 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:18.894410 18424 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.752719 18821 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:18.939839 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:19.202598 16306 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:18.939952 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:19.202502 18424 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.203816 16309 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.203940 18821 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:18.922369 18709 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.917455 18695 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.961277 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:18.980294 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:18.983930 15714 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:18.998747 15670 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.016s	sys 0.071s
W20260709 13:18:19.132728 16304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.016s	sys 0.057s
I20260709 13:18:19.218416 15677 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:18.988528 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2170) took 1055 ms. Trace:
I20260709 13:18:19.219045 15744 rpcz_store.cc:276] 0709 13:18:17.933450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.933552 (+   102us) service_pool.cc:224] Handling call
0709 13:18:18.988245 (+1054693us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b54001d1fd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:18.988437 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171140992}
I20260709 13:18:18.991962 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:19.220373 15673 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.107671 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:19.096030 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:19.222497 16299 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:19.016489 15642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.000s	sys 0.016s
W20260709 13:18:19.135339 18824 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:18:19.135871 18657 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.082062 15669 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:18.966526 18795 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.241091 18795 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.243222 18795 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:19.131944 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.217295 18783 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.246390 18783 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.144997 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:19.247725 15674 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:18:19.146665 15676 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.005s	sys 0.013s
I20260709 13:18:19.052527 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:18.972801 18759 consensus_meta.cc:287] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.590s	user 0.014s	sys 0.002s
I20260709 13:18:19.137168 18644 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:19.145668 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:19.258103 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 112522us
W20260709 13:18:19.127377 18825 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:18:19.186497 16263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.005s	sys 0.027s
W20260709 13:18:19.261096 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 1.0346e+06us
I20260709 13:18:19.262130 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:19.186902 15567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.008s	sys 0.023s
W20260709 13:18:19.041162 18707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.013s
I20260709 13:18:19.187631 15746 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.190164 15601 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:18.984462 18798 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.192395 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:19.140329 18758 consensus_meta.cc:287] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.969s	user 0.006s	sys 0.006s
W20260709 13:18:19.054589 18820 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:18:19.201149 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:18.926934 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:18.992820 18809 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.218577 15670 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.017s	sys 0.095s
W20260709 13:18:19.223572 15642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.000s	sys 0.020s
W20260709 13:18:19.085456 15597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.016s	sys 0.051s
I20260709 13:18:19.162024 18719 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:19.226030 18695 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.228740 15677 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:19.239316 18424 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:19.032308 18826 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.221s
I20260709 13:18:19.217260 18709 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.248534 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:19.255580 16309 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:19.256094 16302 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:19.233399 15672 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.230895 15673 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:19.192344 18822 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.264017 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 1.15136e+06us
I20260709 13:18:19.193761 18761 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:19.172533 18784 consensus_queue.cc:1059] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
W20260709 13:18:19.225195 18768 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.396s	user 0.018s	sys 0.037s
W20260709 13:18:19.345350 15745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 672) took 1364 ms (client timeout 1640 ms). Trace:
W20260709 13:18:19.359366 15745 rpcz_store.cc:269] 0709 13:18:17.981278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.988451 (+  7173us) service_pool.cc:224] Handling call
0709 13:18:19.345036 (+1356585us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540026b6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:19.345258 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534206336}
I20260709 13:18:19.279100 15565 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:19.317008 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:19.273165 18346 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:19.360988 18346 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:19.361385 16308 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:19.361577 18809 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.362537 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:19.363593 18822 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.364713 18758 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.365679 15567 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:19.366947 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:19.367723 15597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.017s	sys 0.063s
I20260709 13:18:19.368213 18798 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.355319 18811 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:19.369809 16306 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:19.369561 18811 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:19.358980 18768 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.555s	user 0.021s	sys 0.037s
I20260709 13:18:19.372092 18798 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:19.285203 18779 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.368081 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:19.258483 18657 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:19.378695 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.375478 15674 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.375756 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:19.366881 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 674) took 1385 ms. Trace:
I20260709 13:18:19.383761 15748 rpcz_store.cc:276] 0709 13:18:17.981817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.982420 (+   603us) service_pool.cc:224] Handling call
0709 13:18:19.366691 (+1384271us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54002698d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:19.366817 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707989760}
I20260709 13:18:19.387252 15672 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:18:19.377274 18707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.012s	sys 0.018s
W20260709 13:18:19.398536 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.355119 18833 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 13:18:19.330556 18824 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:18:19.355888 18843 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:18:19.248466 18783 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:19.389611 18839 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:18:19.319061 18644 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.374570 18732 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:19.366945 18758 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:19.372128 18768 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:19.265252 18759 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:19.361406 18346 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.377401 18826 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:19.310416 18819 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.430050 15716 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:19.312335 18821 consensus_queue.cc:1059] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.130s
I20260709 13:18:19.297595 18454 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
W20260709 13:18:19.431416 18836 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.432s	user 0.001s	sys 0.000s
I20260709 13:18:19.403892 18719 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.441418 15674 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:19.394421 18811 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:19.443161 18829 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:18:19.430917 18848 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:19.443967 18657 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:19.444684 18695 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:19.444700 18732 raft_consensus.cc:697] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:19.439388 18644 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.464509 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1814) took 1155 ms. Trace:
I20260709 13:18:19.459718 18424 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:19.468560 18719 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.470248 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 490) took 1164 ms. Trace:
I20260709 13:18:19.496765 15602 rpcz_store.cc:276] 0709 13:18:18.305386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.305507 (+   121us) service_pool.cc:224] Handling call
0709 13:18:19.470071 (+1164564us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54001cacd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:19.470186 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200048512}
I20260709 13:18:19.460794 18477 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:19.497628 18847 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:19.498028 18719 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:19.499221 18732 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.502164 18644 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:19.460157 18819 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.475704 18848 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:19.507649 18848 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:19.463039 18759 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:19.476332 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 2060) took 1364 ms. Trace:
I20260709 13:18:19.428287 18809 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:19.494642 15596 rpcz_store.cc:276] 0709 13:18:18.309200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.310270 (+  1070us) service_pool.cc:224] Handling call
0709 13:18:18.310547 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.581512 (+270965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.581541 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.581580 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:18.581609 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.464236 (+882627us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540012b454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:19.464285 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.464434 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622695296}
I20260709 13:18:19.525348 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2055) took 1446 ms. Trace:
I20260709 13:18:19.546241 15675 rpcz_store.cc:276] 0709 13:18:18.079232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.080355 (+  1123us) service_pool.cc:224] Handling call
0709 13:18:18.080661 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.110196 (+ 29535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.110231 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.110698 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.735087 (+624389us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:18.735143 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.735246 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.525045 (+789799us) raft_consensus.cc:1685] finished
0709 13:18:19.525073 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.525266 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29164,"raft.queue_time_us":30415,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":581436,"threads_started":1,"wal-append.queue_time_us":894053}
I20260709 13:18:19.540702 15746 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:19.542315 15672 rpcz_store.cc:276] 0709 13:18:18.106864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.132170 (+ 25306us) service_pool.cc:224] Handling call
0709 13:18:19.470976 (+1338806us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400363b54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:19.471103 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433967488}
W20260709 13:18:19.516584 18753 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.819s	user 0.003s	sys 0.006s
W20260709 13:18:19.528981 18846 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:18:19.523883 18404 consensus_meta.cc:287] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.826s	user 0.008s	sys 0.003s
W20260709 13:18:19.517978 18849 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:18:19.557669 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 573807us
I20260709 13:18:19.516788 18454 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:19.508496 18819 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:19.512667 18821 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:19.533440 18822 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:19.527945 18618 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:19.550241 18778 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:19.559170 18809 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.604178 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.553494 18759 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.568564 18709 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:19.593595 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:19.734077 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 140550us
I20260709 13:18:19.567692 18798 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.590143 18851 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.641110 18792 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:19.766227 18792 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.775305 18848 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.729889 18695 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:19.777275 18695 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.779963 18695 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:19.780821 18709 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:19.781585 18709 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.786427 18759 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:19.789767 18851 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:19.797701 18837 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:19.583838 18404 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.745277 18419 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.591578 18454 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:19.821686 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 542669us
I20260709 13:18:19.709147 18821 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:19.622957 18424 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.190s
I20260709 13:18:19.784451 18709 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:19.836509 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.810248 18644 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:19.832229 16307 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.012s	sys 0.041s
I20260709 13:18:19.815532 18851 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:19.837670 16307 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.013s	sys 0.041s
I20260709 13:18:19.837586 18644 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.817046 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1601) took 1275 ms. Trace:
I20260709 13:18:19.838315 18644 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.838613 15597 rpcz_store.cc:276] 0709 13:18:18.541260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.541476 (+   216us) service_pool.cc:224] Handling call
0709 13:18:18.547453 (+  5977us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:18.557538 (+ 10085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.557587 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:18.558318 (+   731us) log.cc:844] Serialized 52 byte log entry
0709 13:18:19.369093 (+810775us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:19.371078 (+  1985us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.816589 (+445511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.816712 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.816769 (+    57us) raft_consensus.cc:1685] finished
0709 13:18:19.816789 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.816971 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":76223,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":14399,"spinlock_wait_cycles":246272,"thread_start_us":1255491,"threads_started":2,"wal-append.queue_time_us":999849}
I20260709 13:18:19.737263 18809 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.846747 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.847533 15596 raft_consensus.cc:2410] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:19.848636 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.849491 15602 raft_consensus.cc:2393] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:19.850723 15676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.018s	sys 0.023s
W20260709 13:18:19.851082 15676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.018s	sys 0.023s
I20260709 13:18:19.852138 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:19.852742 15597 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.859200 16265 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:19.860050 18780 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:19.860504 18868 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:19.860817 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.861109 18780 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:19.861680 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.861513 18780 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:19.863620 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.862318 15601 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:19.865001 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.869511 15599 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:19.865358 18821 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.866626 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.833791 18852 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.867668 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.801903 18798 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.871615 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:19.887925 16263 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:19.872704 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.874035 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.875911 15716 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:19.879669 16295 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:19.879685 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:19.870684 15596 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:19.892989 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 517272us
I20260709 13:18:19.881117 16308 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:19.882153 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.881151 15600 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:19.896345 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:19.896585 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:19.897207 16302 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:19.897266 16295 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:19.901058 18863 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:19.867067 18764 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.000s
W20260709 13:18:19.903059 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 52366.4us
I20260709 13:18:19.905496 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:19.832857 18419 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.906066 15567 leader_election.cc:400] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:18:19.906807 15567 leader_election.cc:403] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:19.825060 18346 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.916621 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:19.916903 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:19.917158 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.917483 15750 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.901767 18863 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.919463 18826 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.919893 18826 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:19.920396 18709 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:19.907799 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.868098 18851 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:19.925105 15750 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:19.903129 16263 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.525s (SENT) [suppressed 22 similar messages]
I20260709 13:18:19.900970 18758 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:19.914747 16310 raft_consensus.cc:2410] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:19.861140 18868 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:19.918380 18424 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:19.907832 15567 leader_election.cc:400] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
I20260709 13:18:19.920853 18709 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:19.938634 15744 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:19.934095 18862 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5.
I20260709 13:18:19.933235 15597 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:19.934113 18855 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.935098 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.935928 15567 leader_election.cc:403] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:19.892135 18777 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:19.895841 18759 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:19.937919 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:19.953150 15602 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:19.948674 18855 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.953498 18856 consensus_queue.cc:1059] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:18:19.954313 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.954581 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.954921 15747 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:19.955915 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.956529 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.956759 18860 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.957440 15742 raft_consensus.cc:2410] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:19.957267 18860 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.951400 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:19.960428 18865 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.938226 18618 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:18:19.941354 18709 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:19.965907 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:19.952479 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.973647 15743 raft_consensus.cc:2368] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
I20260709 13:18:19.922106 18719 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:19.977648 15743 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:19.980427 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:19.981670 18853 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:18:19.983434 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2171) took 2045 ms. Trace:
I20260709 13:18:19.983798 15749 rpcz_store.cc:276] 0709 13:18:17.937558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.937698 (+   140us) service_pool.cc:224] Handling call
0709 13:18:17.937968 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:17.947927 (+  9959us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:18:19.134434 (+1186507us) log.cc:844] Serialized 14 byte log entry
0709 13:18:19.379709 (+245275us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.414220 (+ 34511us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.414374 (+   154us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:19.414404 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.414471 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:19.983226 (+568755us) raft_consensus.cc:1685] finished
0709 13:18:19.983244 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:19.983366 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15334,"prepare.queue_time_us":77987,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":4665,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":32990,"thread_start_us":1373591,"threads_started":2,"wal-append.queue_time_us":680002}
I20260709 13:18:19.936585 18851 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.894426 18852 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:19.989265 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.952813 18759 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.990581 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.963063 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:19.958851 15750 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:19.993283 18647 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:19.994341 18699 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:19.940368 18863 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:19.961215 18860 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:19.996209 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:20.011068 15749 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:19.999879 15602 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:20.000792 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 1.43175e+06us
I20260709 13:18:19.971328 18784 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.004019 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:20.008976 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:20.014295 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:20.041917 15747 raft_consensus.cc:2368] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7.
I20260709 13:18:20.019336 18852 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:20.000615 18759 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:20.023566 15642 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:20.024852 18707 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.025389 18778 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:20.026636 18781 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:20.026903 18699 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.025441 18697 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:20.028069 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2054) took 1949 ms. Trace:
I20260709 13:18:20.028692 18775 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.028945 18635 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:20.009944 18647 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.031162 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1856) took 2123 ms. Trace:
I20260709 13:18:20.066282 15670 rpcz_store.cc:276] 0709 13:18:18.078907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.079572 (+   665us) service_pool.cc:224] Handling call
0709 13:18:18.079860 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.080064 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:19.359434 (+1279370us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.027737 (+668303us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.027788 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:20.027831 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.027894 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.028012 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243880,"prepare.queue_time_us":143151,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":210682,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"thread_start_us":1737729,"threads_started":2,"wal-append.queue_time_us":495648}
I20260709 13:18:20.042448 18404 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:20.037171 18858 log.cc:927] Time spent T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:18:20.037341 18739 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:20.037636 18827 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:20.038319 18623 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:20.058739 18781 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:19.940919 18780 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:19.995164 18848 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:20.045822 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.043651 15750 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:20.046918 16302 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:20.049698 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:20.052968 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:20.053438 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 121807us
I20260709 13:18:20.058035 15749 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:19.971903 18777 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:20.068766 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:20.046346 18424 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:20.001534 18868 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.042263 18349 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.073179 15671 rpcz_store.cc:276] 0709 13:18:17.908001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.908257 (+   256us) service_pool.cc:224] Handling call
0709 13:18:17.908714 (+   457us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:17.920565 (+ 11851us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:18.110865 (+190300us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.021110 (+1910245us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:20.021778 (+   668us) log.cc:844] Serialized 78 byte log entry
0709 13:18:20.021955 (+   177us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.022000 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.022071 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.030914 (+  8843us) raft_consensus.cc:1685] finished
0709 13:18:20.030936 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.031103 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1319949,"prepare.queue_time_us":187679,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":1299666,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":10955,"thread_start_us":789175,"threads_started":2,"wal-append.queue_time_us":787631}
W20260709 13:18:20.079598 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 176501us
I20260709 13:18:20.079933 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:20.033430 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:20.009651 18626 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:20.047662 18620 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.052294 18693 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:20.089464 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2068) took 1349 ms. Trace:
W20260709 13:18:20.039000 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.042609 18784 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.064522 18778 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:20.080775 18697 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.394455 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2059) took 2288 ms. Trace:
I20260709 13:18:20.089656 18797 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:20.382571 18346 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:20.395002 15676 rpcz_store.cc:276] 0709 13:18:18.106563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.118178 (+ 11615us) service_pool.cc:224] Handling call
0709 13:18:18.140337 (+ 22159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.255135 (+1114798us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.255171 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.255696 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.851389 (+595693us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:19.851426 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.851488 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.363562 (+512074us) raft_consensus.cc:1685] finished
0709 13:18:20.363580 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.394394 (+ 30814us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18043,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6574,"thread_start_us":1649155,"threads_started":2,"wal-append.queue_time_us":611888}
I20260709 13:18:20.396225 18797 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.202145 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:20.397692 15599 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:20.397912 15595 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:20.398867 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:20.399415 18778 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:20.211858 15593 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:20.401276 15595 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:20.402522 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1864) took 1532 ms. Trace:
I20260709 13:18:20.402917 18876 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:20.402650 18781 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.403565 18876 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:20.403149 18620 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:20.076001 18795 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:20.404280 18795 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:18:20.405665 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 356079us
I20260709 13:18:20.084491 18809 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:20.072077 18454 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:20.402136 15673 rpcz_store.cc:276] 0709 13:18:18.740310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.364990 (+624680us) service_pool.cc:224] Handling call
0709 13:18:19.365293 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.365477 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:19.365765 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.088906 (+723141us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.089100 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:20.089148 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:20.089192 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.089263 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.089400 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210761,"prepare.queue_time_us":375930,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":213414,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":104745,"thread_start_us":511760,"threads_started":2,"wal-append.queue_time_us":490487}
I20260709 13:18:20.498174 15567 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:20.402961 15677 rpcz_store.cc:276] 0709 13:18:18.870155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.393175 (+523020us) service_pool.cc:224] Handling call
0709 13:18:19.393639 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.024811 (+631172us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:20.086327 (+ 61516us) log.cc:844] Serialized 14 byte log entry
0709 13:18:20.305517 (+219190us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.377682 (+ 72165us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.377905 (+   223us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.377957 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.378096 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.402337 (+ 24241us) raft_consensus.cc:1685] finished
0709 13:18:20.402354 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:20.402472 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":630705,"prepare.queue_time_us":376237,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":632540,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":18218,"thread_start_us":279513,"threads_started":2,"wal-append.queue_time_us":313600}
I20260709 13:18:20.410223 15716 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:20.500260 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 90100.3us
W20260709 13:18:20.404918 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 371560us
I20260709 13:18:20.394652 15596 raft_consensus.cc:2410] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:20.502451 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:20.082983 18635 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.407472 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:20.403802 18781 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:20.396888 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.427204 15599 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:20.519191 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.520097 16302 pending_rounds.cc:85] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 5
I20260709 13:18:20.520547 16302 pending_rounds.cc:107] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:18:20.195924 18739 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.071025 18707 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.518497 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:20.521469 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 114062us
I20260709 13:18:20.530560 16305 raft_consensus.cc:2368] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
I20260709 13:18:20.531680 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:20.532464 16305 raft_consensus.cc:2368] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7.
I20260709 13:18:20.532982 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:20.533780 15671 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.537092 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.538642 18841 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:20.539486 18841 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.543187 18841 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:20.543952 18841 raft_consensus.cc:2764] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:18:20.545284 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.546315 15672 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:20.548022 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.552102 15748 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:20.552465 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.554587 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.555909 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.557049 15675 raft_consensus.cc:2410] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:20.558851 15675 raft_consensus.cc:1240] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 3. Current term is 4. Ops: []
I20260709 13:18:20.560134 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.560672 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:20.378367 18839 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:18:20.520849 16302 raft_consensus.cc:2889] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:20.518765 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.566277 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.226854 18419 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:20.404384 18817 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.527751 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.570472 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.573639 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.575065 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.577576 15672 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:20.408211 18811 raft_consensus.cc:3055] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:20.227351 18782 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.593449 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.605525 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.606473 15671 raft_consensus.cc:2410] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:20.497653 18869 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:20.509848 18848 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:20.511157 18693 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:20.622645 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.080514 18775 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.623926 15671 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:20.625340 15668 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:20.625600 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:20.627195 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.628626 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.523442 18778 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:20.522089 18809 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:20.641901 15670 raft_consensus.cc:2410] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:20.393924 18349 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:20.642438 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 141053us
I20260709 13:18:20.653066 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.654016 15672 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:20.665930 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.514703 18623 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:20.607023 18732 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.591526 18811 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:20.674165 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 171808us
I20260709 13:18:20.683513 15671 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:20.684917 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.608526 18851 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:20.661383 18778 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:20.514914 18827 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:20.677604 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.640020 18772 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:20.695955 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.634711 18693 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:20.703357 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:20.650887 18699 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:20.657301 18809 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:20.645248 18869 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.736075 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.736503 15673 raft_consensus.cc:2410] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:20.739456 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:20.743798 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.645464 18848 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.707118 18693 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:20.774075 15743 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:20.777161 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 687) took 1349 ms. Trace:
I20260709 13:18:20.777588 15748 rpcz_store.cc:276] 0709 13:18:19.427929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.428055 (+   126us) service_pool.cc:224] Handling call
0709 13:18:19.428358 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.552589 (+1124231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.776923 (+224334us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003048d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:20.777101 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583917312}
I20260709 13:18:20.726646 18809 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.783875 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.645687 18795 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.704032 18732 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:20.844681 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 444899us
I20260709 13:18:20.844839 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.404541 18876 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.859548 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.861114 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:20.689868 18424 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.772173 18699 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:18:20.875950 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 325) took 5652 ms. Trace:
I20260709 13:18:20.877197 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.855526 18795 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:20.876350 15500 rpcz_store.cc:276] 0709 13:18:15.218572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.219907 (+  1335us) service_pool.cc:224] Handling call
0709 13:18:20.871236 (+5651329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:15.550881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:15.582135 (+ 31254us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:15.582176 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:18:15.582196 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:15.583140 (+   944us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:15.583200 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:15.583233 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:18:15.583873 (+   640us) tablet.cc:701] Row locks acquired
0709 13:18:15.583895 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:15.584081 (+   186us) write_op.cc:270] Start()
0709 13:18:15.584211 (+   130us) write_op.cc:276] Timestamp: P: 1783603095584022 usec, L: 0
0709 13:18:15.584238 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:15.840809 (+256571us) log.cc:844] Serialized 2834 byte log entry
0709 13:18:16.533713 (+692904us) op_driver.cc:464] REPLICATION: finished
0709 13:18:16.629288 (+ 95575us) write_op.cc:301] APPLY: starting
0709 13:18:16.637571 (+  8283us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:16.648051 (+ 10480us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:16.648177 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:16.699106 (+ 50929us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:16.699409 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:18:16.699481 (+    72us) write_op.cc:312] APPLY: finished
0709 13:18:16.699850 (+   369us) log.cc:844] Serialized 59 byte log entry
0709 13:18:16.700103 (+   253us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:16.700260 (+   157us) write_op.cc:454] Released schema lock
0709 13:18:16.700318 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:16.733646 (+ 33328us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ebe28 00007faf02126581 00007faf02125d58 00007faf0212a9f1 00007faf0212a9a9 00007faf0212a939 00007faf0212a901 00007faf02129b2d 000000000038f354 000000000038f199
0709 13:18:16.733881 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:16.733908 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6956,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":84986,"apply.run_cpu_time_us":3678,"apply.run_wall_time_us":75843,"num_ops":7,"prepare.queue_time_us":67284,"prepare.run_cpu_time_us":22258,"prepare.run_wall_time_us":1206211,"replication_time_us":949305,"spinlock_wait_cycles":366124928,"thread_start_us":93276,"threads_started":2}]]}
W20260709 13:18:20.880648 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 224571us
I20260709 13:18:20.690320 18782 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:20.902478 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:20.903564 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.868794 18647 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:20.903748 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 405643us
I20260709 13:18:20.875474 18512 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.869429 18694 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:20.902177 18878 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
I20260709 13:18:20.922320 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.928728 18512 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:20.930028 18349 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:20.945961 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.946805 15673 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:20.930400 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 730) took 1713 ms. Trace:
I20260709 13:18:20.930665 18704 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:20.931380 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 692) took 1014 ms. Trace:
I20260709 13:18:20.933446 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1851) took 3363 ms. Trace:
I20260709 13:18:20.948786 16306 rpcz_store.cc:276] 0709 13:18:19.221728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.229598 (+  7870us) service_pool.cc:224] Handling call
0709 13:18:19.239183 (+  9585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.370170 (+130987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.930160 (+1559990us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400683b54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:20.930342 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299616000}
I20260709 13:18:20.949458 15669 rpcz_store.cc:276] 0709 13:18:17.569965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.587838 (+ 17873us) service_pool.cc:224] Handling call
0709 13:18:17.589104 (+  1266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.231278 (+1642174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.933222 (+1701944us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400081bd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:20.933388 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3432708352}
I20260709 13:18:20.950106 15675 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:20.950702 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:20.951802 15669 raft_consensus.cc:2410] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:18:20.935079 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.882687 18699 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:20.948935 15744 rpcz_store.cc:276] 0709 13:18:19.916831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.916947 (+   116us) service_pool.cc:224] Handling call
0709 13:18:20.931209 (+1014262us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b54002cf6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:20.931316 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48106880}
I20260709 13:18:20.953864 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:20.961222 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:20.968097 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.918851 18454 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:20.924054 18620 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:20.947247 18644 consensus_meta.cc:287] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.108s	user 0.011s	sys 0.002s
I20260709 13:18:20.981868 18349 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:20.980713 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.880609 18811 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:20.913516 18635 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:20.943825 18777 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:20.936404 18707 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:20.984153 16305 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:18:20.975026 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:21.033548 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:20.981400 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:21.038466 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:20.945878 18694 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:18:21.024626 18784 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.056180 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:21.099992 16309 raft_consensus.cc:2410] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:18:21.065649 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 218781us
I20260709 13:18:21.102912 15565 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:21.106948 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 132011us
I20260709 13:18:21.107736 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:21.109452 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:21.111140 15672 raft_consensus.cc:2410] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:18:20.985318 18821 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:18:21.100690 16308 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
W20260709 13:18:21.118507 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.043970 18857 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 1.123s	user 0.008s	sys 0.016s
I20260709 13:18:21.029577 18895 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.041615 18772 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:21.098013 18623 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:21.101060 18787 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.099838 18778 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:21.145242 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.152022 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 303633us
I20260709 13:18:21.117370 18897 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.166455 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.139909 18865 consensus_meta.cc:287] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.179s	user 0.009s	sys 0.003s
I20260709 13:18:21.160997 18772 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:21.163975 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 742) took 1260 ms. Trace:
I20260709 13:18:21.038132 18644 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.180466 18424 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:21.165833 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 246671us
I20260709 13:18:21.176788 16295 rpcz_store.cc:276] 0709 13:18:19.903546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.903736 (+   190us) service_pool.cc:224] Handling call
0709 13:18:19.904112 (+   376us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:19.922633 (+ 18521us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:19.922665 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:19.923216 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 13:18:20.075675 (+152459us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:20.075726 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.932997 (+857271us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b54004c54d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:20.933047 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.151619 (+218572us) raft_consensus.cc:1685] finished
0709 13:18:21.151642 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.163876 (+ 12234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3460,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7625,"spinlock_wait_cycles":41695104,"thread_start_us":126518,"threads_started":1,"wal-append.queue_time_us":306171}
I20260709 13:18:21.182401 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:21.143234 18848 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.042140 18349 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.151876 18899 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.180694 18644 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:21.182531 18882 log.cc:927] Time spent T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 13:18:21.175334 18782 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:21.153620 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 44232.6us
W20260709 13:18:21.184319 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 269421us
I20260709 13:18:21.155048 18869 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.167068 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.181411 18454 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:21.153101 18894 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:21.200625 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:21.176426 18772 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.186578 18424 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.182271 18865 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
I20260709 13:18:21.192852 18899 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.191699 18732 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:21.209709 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 100127us
I20260709 13:18:21.211894 15714 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:21.203187 18893 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:21.208760 18772 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:21.208256 18424 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.230638 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.225818 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:21.232321 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:21.233161 18575 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:21.199028 18410 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:18:21.231606 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 799) took 3060 ms. Trace:
I20260709 13:18:21.234901 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:21.229621 15597 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:21.235674 15596 raft_consensus.cc:2368] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:21.236553 15595 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:18:21.236928 15595 pending_rounds.cc:85] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 4
I20260709 13:18:21.237141 15595 pending_rounds.cc:107] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:18:21.150468 18895 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.166496 18787 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.237434 15595 raft_consensus.cc:2889] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:21.217273 18644 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:21.234925 16304 rpcz_store.cc:276] 0709 13:18:18.160971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.161514 (+   543us) service_pool.cc:224] Handling call
0709 13:18:18.161825 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:19.218761 (+1056936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:19.218792 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:19.238337 (+ 19545us) log.cc:844] Serialized 52 byte log entry
0709 13:18:19.555166 (+316829us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:19.555214 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.555302 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:20.851476 (+1296174us) spinlock_profiling.cc:243] Waited 9.58 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:21.217731 (+366255us) raft_consensus.cc:1685] finished
0709 13:18:21.217752 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.221062 (+  3310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":455,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":65070,"spinlock_wait_cycles":22036736,"thread_start_us":1372834,"threads_started":2,"wal-append.queue_time_us":593770}
I20260709 13:18:21.240291 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.237170 15593 raft_consensus.cc:1275] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:21.243678 18863 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:18:21.243954 18892 log.cc:927] Time spent T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:18:21.244168 18863 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.244581 18863 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.244786 18454 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.217852 18899 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.216958 18894 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:21.219695 18887 log.cc:927] Time spent T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:18:21.249251 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.182691 18897 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:21.239161 18817 consensus_meta.cc:287] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.644s	user 0.013s	sys 0.000s
I20260709 13:18:21.258471 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:21.238704 18889 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.259217 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:21.274045 15601 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:21.276518 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:21.260181 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 57160.1us
I20260709 13:18:21.263881 18908 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:18:21.256971 18575 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:21.247776 18644 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.265081 18512 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:21.265856 16306 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:21.290164 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:21.266521 18349 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.267378 18693 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.272238 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.294658 15672 raft_consensus.cc:2393] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:21.281471 15567 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:21.292881 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.297966 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.298564 15593 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:21.289393 18575 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.303871 18895 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:21.221845 18904 consensus_queue.cc:1059] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:18:21.304665 18904 consensus_queue.cc:1243] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:21.305111 18904 raft_consensus.cc:3055] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:21.305425 18904 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:21.305800 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.306574 15672 raft_consensus.cc:2393] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 5: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:21.277951 18889 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.315685 15671 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:21.317643 15567 leader_election.cc:400] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
I20260709 13:18:21.318231 15567 leader_election.cc:403] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.293620 18644 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.342235 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.343915 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:21.346091 15567 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:21.343317 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:21.338984 18781 consensus_meta.cc:287] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.786s	user 0.007s	sys 0.004s
I20260709 13:18:21.307637 18906 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.348728 15672 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:21.311308 18889 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.352061 15567 leader_election.cc:400] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7.
I20260709 13:18:21.352973 15567 leader_election.cc:403] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.353098 15677 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:21.353972 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:21.354672 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.345149 18694 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
W20260709 13:18:21.376773 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.350653 18869 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:21.306210 18904 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.361619 18761 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.342658 18914 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:21.350865 18817 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 13:18:21.415709 18898 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
W20260709 13:18:21.415867 18854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.348s	user 0.008s	sys 0.022s
I20260709 13:18:21.416967 15593 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 4.
I20260709 13:18:21.315616 18899 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.404099 18694 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:21.362485 18906 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.415741 18787 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.417984 18904 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:21.435621 18854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.009s	sys 0.023s
I20260709 13:18:21.445407 18424 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:21.535123 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.466501 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:21.466424 18759 consensus_meta.cc:287] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 1.401s	user 0.012s	sys 0.000s
I20260709 13:18:21.440162 18903 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:21.469056 18826 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.548s	user 0.007s	sys 0.008s
I20260709 13:18:21.353855 18894 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.550786 15672 raft_consensus.cc:2410] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:18:21.469555 18911 log.cc:927] Time spent T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:18:21.565985 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.567847 15672 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:21.574669 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.574869 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 220990us
I20260709 13:18:21.575146 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:21.575958 15672 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:21.577126 15743 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 13:18:21.561869 18898 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:18:21.577464 15567 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:21.564427 18906 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:21.583277 18709 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.592s	user 0.010s	sys 0.003s
I20260709 13:18:21.572364 18895 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:21.562167 18759 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.592082 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:21.591097 15640 leader_election.cc:400] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:21.595283 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.596515 18899 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:21.613724 15640 leader_election.cc:403] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.614698 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:21.616446 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 552) took 1062 ms. Trace:
I20260709 13:18:21.618278 15748 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:21.620182 15567 leader_election.cc:400] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9.
I20260709 13:18:21.621073 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:21.568311 18826 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.627027 15745 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:21.616991 15674 rpcz_store.cc:276] 0709 13:18:20.553930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.558612 (+  4682us) service_pool.cc:224] Handling call
0709 13:18:20.559035 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.587200 (+ 28165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.587243 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.614949 (+ 27706us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.953909 (+338960us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:21.024005 (+ 70096us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.483018 (+459013us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b18003baa00. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:21.595056 (+112038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.595136 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.595175 (+    39us) raft_consensus.cc:1685] finished
0709 13:18:21.616224 (+ 21049us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.616383 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114747,"prepare.queue_time_us":70445,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4058,"raft.queue_time_us":645016,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":24475,"spinlock_wait_cycles":10476928,"thread_start_us":372377,"threads_started":2,"wal-append.queue_time_us":506780}
I20260709 13:18:21.634711 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.635522 15674 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
W20260709 13:18:21.646605 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 57094.4us
I20260709 13:18:21.648856 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.654033 18826 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:21.654942 18826 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:21.656366 18809 consensus_meta.cc:287] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.805s	user 0.010s	sys 0.000s
I20260709 13:18:21.660563 15748 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:21.661137 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:21.592736 18869 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:21.665758 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.666745 15567 leader_election.cc:400] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7.
I20260709 13:18:21.667160 15567 leader_election.cc:403] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.593200 18693 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.668495 16295 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 7: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:21.656832 18809 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.671643 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:21.670966 18778 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:18:21.598227 18709 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.662549 18781 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:21.685344 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:21.678064 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.614511 18895 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:21.683579 18920 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:18:21.696262 15746 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:21.702066 15672 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:21.670912 18897 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:21.707039 15674 raft_consensus.cc:2376] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5. Re-sending same reply.
I20260709 13:18:21.708469 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:21.710282 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.711356 15751 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:21.714006 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.714910 15595 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:21.717763 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:21.679811 18707 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:18:21.719274 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:21.722376 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52798.1us
I20260709 13:18:21.724615 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:21.724884 15672 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:18:21.720517 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:21.729386 18694 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7.
I20260709 13:18:21.722121 18903 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:21.733955 18781 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:21.733098 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.754854 18739 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.744864 18424 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.765858 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1873) took 1189 ms. Trace:
I20260709 13:18:21.771235 18775 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.772756 18694 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.773327 18694 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.773622 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:21.775604 18694 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.776227 18694 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:21.768229 15672 rpcz_store.cc:276] 0709 13:18:20.576305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.732714 (+1156409us) service_pool.cc:224] Handling call
0709 13:18:21.765784 (+ 33070us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.755877 18781 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.794094 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:21.786284 18917 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:18:21.803508 18709 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:21.804126 18895 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:21.797371 18869 raft_consensus.cc:697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:21.804395 18759 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:21.805025 15672 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:21.808561 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:21.810847 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.780792 18931 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:21.799196 18781 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.808851 18903 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.822508 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.776571 18694 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.828092 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.830300 18759 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.831323 18932 consensus_queue.cc:1059] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:18:21.829794 15669 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:21.832357 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:21.815456 18936 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:21.760703 18889 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.833618 15674 raft_consensus.cc:2410] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:18:21.836740 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:21.827589 18903 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.837298 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.846695 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:21.837410 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:21.847700 16302 raft_consensus.cc:2410] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:21.837723 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.821063 18811 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:21.838282 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:21.839046 18697 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.839310 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:21.840655 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:21.841789 16307 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:18:21.856374 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.843057 18759 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:21.844223 15677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 542) took 1313 ms (client timeout 1655 ms). Trace:
W20260709 13:18:21.827641 18863 consensus_meta.cc:287] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.003s
I20260709 13:18:21.825838 18798 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:21.848724 15600 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:21.837443 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:21.833498 18647 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.844439 18936 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:21.851025 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:21.816035 18855 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.852421 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1872) took 1276 ms. Trace:
I20260709 13:18:21.828876 18809 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:21.843369 16310 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 729) took 2700 ms (client timeout 1919 ms). Trace:
I20260709 13:18:21.856868 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 557) took 1296 ms. Trace:
I20260709 13:18:21.858691 18819 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:21.875622 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:21.845044 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 88590us
I20260709 13:18:21.899893 15668 rpcz_store.cc:276] 0709 13:18:20.560180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.621412 (+ 61232us) service_pool.cc:224] Handling call
0709 13:18:20.621856 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.625909 (+  4053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.856641 (+1230732us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b5400363654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:21.856812 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7463168}
W20260709 13:18:21.859366 15677 rpcz_store.cc:269] 0709 13:18:20.530847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.547676 (+ 16829us) service_pool.cc:224] Handling call
0709 13:18:21.844062 (+1296386us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54003aedd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:21.844166 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848542976}
I20260709 13:18:21.833946 18694 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:21.883666 18936 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:21.885696 18903 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:21.886667 18759 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:21.890486 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.891479 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.891496 15672 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:21.917289 15565 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:21.917479 15668 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:21.918429 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2071) took 1348 ms. Trace:
I20260709 13:18:21.918862 15668 rpcz_store.cc:276] 0709 13:18:20.570232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.916747 (+1346515us) service_pool.cc:224] Handling call
0709 13:18:21.917176 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.918097 (+   921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.918359 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.920656 15668 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:21.919708 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2074) took 1348 ms. Trace:
I20260709 13:18:21.892956 15674 rpcz_store.cc:276] 0709 13:18:20.575959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.846425 (+1270466us) service_pool.cc:224] Handling call
0709 13:18:21.852358 (+  5933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.857452 18931 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:21.844197 18779 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 13:18:21.899732 16310 rpcz_store.cc:269] 0709 13:18:19.146961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.200718 (+ 53757us) service_pool.cc:224] Handling call
0709 13:18:21.843141 (+2642423us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54004376d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:21.843273 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230045568}
I20260709 13:18:21.907829 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:21.915025 15677 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:21.927618 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2073) took 1356 ms. Trace:
I20260709 13:18:21.928009 15677 rpcz_store.cc:276] 0709 13:18:20.570828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.914536 (+1343708us) service_pool.cc:224] Handling call
0709 13:18:21.914864 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.927363 (+ 12499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.927564 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.929934 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1876) took 1351 ms. Trace:
I20260709 13:18:21.930433 15677 rpcz_store.cc:276] 0709 13:18:20.578385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.928944 (+1350559us) service_pool.cc:224] Handling call
0709 13:18:21.929306 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.929516 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.929552 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.929612 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:21.929658 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.929724 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.929862 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.931216 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1871) took 1358 ms. Trace:
I20260709 13:18:21.892479 16263 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:21.915822 15600 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:21.921337 15672 rpcz_store.cc:276] 0709 13:18:20.571094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.918142 (+1347048us) service_pool.cc:224] Handling call
0709 13:18:21.918403 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.918579 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.918604 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.918643 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:21.918676 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.918725 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.919653 (+   928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.925567 15593 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:21.931793 15674 rpcz_store.cc:276] 0709 13:18:20.572480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.925092 (+1352612us) service_pool.cc:224] Handling call
0709 13:18:21.930618 (+  5526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.930787 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.930824 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.930880 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:21.930925 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.930998 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.931145 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.898674 18647 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:21.966238 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 73808.4us
I20260709 13:18:21.935601 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1883) took 1331 ms. Trace:
I20260709 13:18:21.937476 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2077) took 1365 ms. Trace:
I20260709 13:18:21.940733 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.972769 15600 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:21.972433 15668 rpcz_store.cc:276] 0709 13:18:20.571932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.920052 (+1348120us) service_pool.cc:224] Handling call
0709 13:18:21.920415 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.925295 (+  4880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.937419 (+ 12124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.933987 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1877) took 1332 ms. Trace:
I20260709 13:18:21.947131 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.975415 15677 rpcz_store.cc:276] 0709 13:18:20.601878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.932971 (+1331093us) service_pool.cc:224] Handling call
0709 13:18:21.933363 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.933586 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.933623 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.933677 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:21.933717 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.933786 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.933920 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.976307 15593 raft_consensus.cc:2410] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:18:21.977092 15677 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:21.979918 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.980192 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.882149 18863 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:21.980664 15600 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:21.990880 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1889) took 1069 ms. Trace:
I20260709 13:18:21.991379 15677 rpcz_store.cc:276] 0709 13:18:20.921008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.976573 (+1055565us) service_pool.cc:224] Handling call
0709 13:18:21.976903 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.990590 (+ 13687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.990818 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:21.928660 18931 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:21.994664 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.979921 18759 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.995718 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:21.995992 16308 raft_consensus.cc:2393] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 7: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:21.996222 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.996917 18863 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:21.940239 18903 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:21.937523 18779 consensus_queue.cc:1243] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:21.999797 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:22.003232 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 234024us
I20260709 13:18:22.017030 18903 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:22.018008 18903 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:21.940451 18932 consensus_queue.cc:1059] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:18:21.976893 18934 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:18:21.900849 18869 consensus_queue.cc:237] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:22.021997 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.991143 18819 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:22.105504 18697 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:22.005330 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:22.175997 18874 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.949s	user 0.016s	sys 0.005s
I20260709 13:18:22.189587 18697 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:22.162417 18761 consensus_meta.cc:287] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.756s	user 0.008s	sys 0.004s
I20260709 13:18:22.187227 18647 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:22.190023 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 184817us
I20260709 13:18:22.190673 18761 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7.
I20260709 13:18:22.191584 16263 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.191812 18697 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.191905 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1829) took 2347 ms. Trace:
I20260709 13:18:22.130926 18693 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:22.192833 18693 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.186609 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.194739 18424 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.195957 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:22.196805 18779 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.196847 18424 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:22.198943 18424 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.199301 18424 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.200843 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:22.202107 18875 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:22.202629 18875 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:22.203507 18875 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:22.146534 18644 consensus_meta.cc:287] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.002s
I20260709 13:18:22.185590 18936 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.189057 18819 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.212380 18819 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.211971 18644 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.214283 18644 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:22.216313 18693 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.190747 18647 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.192497 15594 rpcz_store.cc:276] 0709 13:18:19.844932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.845534 (+   602us) service_pool.cc:224] Handling call
0709 13:18:19.845918 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:19.846172 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:19.846195 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:19.862688 (+ 16493us) log.cc:844] Serialized 26 byte log entry
0709 13:18:19.997736 (+135048us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:19.997778 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.997842 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:22.175253 (+2177411us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:22.191502 (+ 16249us) raft_consensus.cc:1685] finished
0709 13:18:22.191532 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.191832 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42538752,"thread_start_us":83400,"threads_started":1,"wal-append.queue_time_us":186426}
I20260709 13:18:22.123528 18781 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.217043 18934 consensus_queue.cc:1243] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:18:22.069898 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.082746 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 177986us
W20260709 13:18:22.020973 18772 consensus_meta.cc:287] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.775s	user 0.014s	sys 0.000s
I20260709 13:18:22.124356 18694 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.003528 18931 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:21.972378 15672 rpcz_store.cc:276] 0709 13:18:20.603837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.934807 (+1330970us) service_pool.cc:224] Handling call
0709 13:18:21.935115 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.935269 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.935291 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.935325 (+    34us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:21.935351 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.935397 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.935520 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.254765 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.255426 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.021080 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:22.011370 18798 consensus_queue.cc:1059] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 13:18:22.011561 18759 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.248406 15640 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:22.249418 18936 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.251889 15595 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:22.253155 18694 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:22.253801 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.263019 15669 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:22.264767 15567 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.255822 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.265394 16308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 747) took 1006 ms. Trace:
I20260709 13:18:22.265972 16308 rpcz_store.cc:276] 0709 13:18:21.258851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.258965 (+   114us) service_pool.cc:224] Handling call
0709 13:18:22.265121 (+1006156us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400702bd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.265309 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661657856}
I20260709 13:18:22.260965 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:22.248510 18644 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.253639 18894 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:22.220386 18819 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:22.292845 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.299499 15745 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:22.264407 18932 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.262423 18889 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:22.303161 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.267503 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:22.271332 18739 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:22.308938 15593 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:22.282783 18719 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.311508 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:22.312849 15593 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:22.254667 18772 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.309579 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1895) took 1056 ms. Trace:
I20260709 13:18:22.283881 18694 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.316849 15672 rpcz_store.cc:276] 0709 13:18:21.252708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.307620 (+1054912us) service_pool.cc:224] Handling call
0709 13:18:22.307997 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.308237 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.308276 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.308332 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:22.308377 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.308449 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.308580 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.314384 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:22.318311 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:22.318593 15593 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:22.319101 15750 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.323215 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:22.330962 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:22.332226 15593 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 5: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:22.310602 18739 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:22.295634 18644 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.327929 18693 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:22.352376 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 142420us
I20260709 13:18:22.350714 15750 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:22.355055 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:22.355801 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:22.355911 16308 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:22.340648 18768 raft_consensus.cc:3055] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:18:22.360800 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 63650.3us
I20260709 13:18:22.326005 18817 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:18:22.346764 18739 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.360702 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.365442 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:22.370719 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:22.371625 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:22.372506 16310 raft_consensus.cc:2410] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:22.374361 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.374467 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:22.375434 15744 raft_consensus.cc:2368] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:22.377033 18798 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:22.377475 18798 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.378041 18798 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.380944 18797 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.364828 18768 raft_consensus.cc:740] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:22.382216 18768 consensus_queue.cc:260] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.360142 18781 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.383235 18768 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:22.376376 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:22.383939 15747 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:22.371719 18779 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.385471 18919 raft_consensus.cc:3055] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:18:22.385951 18919 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:22.386821 18919 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.388032 18919 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:18:22.387871 18798 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.389981 18914 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:22.390404 18914 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:22.390442 16263 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.392448 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.392952 18798 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:22.396565 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 745) took 1139 ms. Trace:
I20260709 13:18:22.351771 18693 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:22.397048 16295 rpcz_store.cc:276] 0709 13:18:21.257820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.258227 (+   407us) service_pool.cc:224] Handling call
0709 13:18:22.396362 (+1138135us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54004a60d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.396501 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937038720}
I20260709 13:18:22.405635 15748 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:22.400075 15747 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:22.351986 18424 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.402477 15744 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:22.404235 18779 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:22.392462 16263 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.588s (SENT)
W20260709 13:18:22.429708 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.429844 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.430827 15600 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:18:22.433156 15602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 499) took 2450 ms (client timeout 2062 ms). Trace:
W20260709 13:18:22.433579 15602 rpcz_store.cc:269] 0709 13:18:19.979713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.980141 (+   428us) service_pool.cc:224] Handling call
0709 13:18:22.429755 (+2449614us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b5400164254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.429909 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19976960}
I20260709 13:18:22.435026 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.435720 15602 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.437374 18780 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.411315 18931 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.410610 15747 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:22.405984 18936 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.412281 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:22.445959 15749 raft_consensus.cc:2368] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:22.390463 18644 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.374751 18647 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:22.417290 18424 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:22.405252 18693 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.421726 18759 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:22.423733 18819 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:22.426934 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.410106 15672 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:22.428754 18821 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:22.447546 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.447902 15744 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:22.448149 18647 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:22.450183 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 57759us
W20260709 13:18:22.454448 16263 leader_election.cc:336] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.601s (SENT)
I20260709 13:18:22.454980 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.459712 15594 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:22.464999 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.458791 18936 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:22.449074 18772 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:22.457034 18647 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.451912 18798 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.462893 18704 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:22.463536 18821 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.468336 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.517655 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1892) took 1284 ms. Trace:
W20260709 13:18:22.467341 16263 leader_election.cc:336] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.605s (SENT)
I20260709 13:18:22.547957 16263 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.549815 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.537633 15602 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:22.556574 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.562093 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.468047 18936 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.551537 18644 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:22.540835 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:22.563800 15742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2186) took 2601 ms (client timeout 1576 ms). Trace:
I20260709 13:18:22.551345 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.564260 15747 raft_consensus.cc:2393] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:22.564921 18644 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:22.565177 15671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 560) took 1797 ms (client timeout 1787 ms). Trace:
W20260709 13:18:22.565773 15671 rpcz_store.cc:269] 0709 13:18:20.767846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.872220 (+104374us) service_pool.cc:224] Handling call
0709 13:18:22.564942 (+1692722us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400336654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.565096 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938701568}
I20260709 13:18:22.566208 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.567164 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.567541 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.568117 15602 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.514979 18821 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:22.524175 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:22.570781 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.571092 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.572136 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.574242 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:22.575286 15601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1838) took 2701 ms (client timeout 1903 ms). Trace:
I20260709 13:18:22.575460 18851 raft_consensus.cc:2764] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:18:22.576076 15675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 556) took 2016 ms (client timeout 1908 ms). Trace:
I20260709 13:18:22.576331 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.569528 18809 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:22.496093 18944 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:18:22.524588 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.616997 15673 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:22.586794 15602 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:22.618214 15675 rpcz_store.cc:269] 0709 13:18:20.559754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.559902 (+   148us) service_pool.cc:224] Handling call
0709 13:18:22.575907 (+2016005us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54001a7054. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.576012 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895152384}
I20260709 13:18:22.552042 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.623533 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.624238 15675 raft_consensus.cc:2368] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10.
I20260709 13:18:22.623658 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.619516 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.568337 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.625350 15594 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.625460 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.626091 15602 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:22.547161 15677 rpcz_store.cc:276] 0709 13:18:21.233337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.992763 (+759426us) service_pool.cc:224] Handling call
0709 13:18:22.515532 (+522769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.515749 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.515775 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.515813 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:22.515843 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.515907 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.517401 (+  1494us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400002dd0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.517572 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201521024}
W20260709 13:18:22.514662 15670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 546) took 1982 ms (client timeout 1588 ms). Trace:
W20260709 13:18:22.564260 15742 rpcz_store.cc:269] 0709 13:18:19.962677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.975168 (+ 12491us) service_pool.cc:224] Handling call
0709 13:18:22.563604 (+2588436us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400269dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.563736 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631350656}
I20260709 13:18:22.629253 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.630594 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:22.518193 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 701) took 1171 ms. Trace:
I20260709 13:18:22.632887 15743 rpcz_store.cc:276] 0709 13:18:21.346743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.347802 (+  1059us) service_pool.cc:224] Handling call
0709 13:18:21.361360 (+ 13558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.579987 (+218627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.517916 (+937929us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400217854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:22.518130 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495643904}
W20260709 13:18:22.618925 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 151618us
I20260709 13:18:22.635725 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.636734 15593 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.627460 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:22.500857 18943 log.cc:927] Time spent T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.167s	user 0.002s	sys 0.000s
W20260709 13:18:22.628424 15670 rpcz_store.cc:269] 0709 13:18:20.532220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.536749 (+  4529us) service_pool.cc:224] Handling call
0709 13:18:22.514353 (+1977604us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400002dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.514575 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238056832}
I20260709 13:18:22.638579 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.617349 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.630897 15675 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:22.624363 15601 rpcz_store.cc:269] 0709 13:18:19.873618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.873759 (+   141us) service_pool.cc:224] Handling call
0709 13:18:22.575047 (+2701288us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400100ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.575192 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3185071872}
I20260709 13:18:22.640511 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.627557 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:22.641935 15673 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:22.632210 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:22.643327 15671 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:22.502800 18811 consensus_meta.cc:287] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:18:22.644266 18777 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:22.644409 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.643149 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.646332 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.470227 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.497579 18704 consensus_queue.cc:1243] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:22.653733 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:22.655228 15599 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
W20260709 13:18:22.634761 16263 leader_election.cc:336] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.646s (SENT)
I20260709 13:18:22.662047 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.660006 15602 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:22.473402 18931 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.468518 18909 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.666031 15714 leader_election.cc:400] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10.
I20260709 13:18:22.676476 15714 leader_election.cc:403] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:18:22.676079 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 545) took 2144 ms. Trace:
I20260709 13:18:22.671746 15675 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
W20260709 13:18:22.678503 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.628988 18798 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.683748 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1842) took 1267 ms. Trace:
I20260709 13:18:22.682164 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.701546 15595 rpcz_store.cc:276] 0709 13:18:21.415922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.717306 (+301384us) service_pool.cc:224] Handling call
0709 13:18:22.683579 (+966273us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54002d73d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.683687 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1091022592}
I20260709 13:18:22.702502 15671 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
W20260709 13:18:22.688392 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 53671.2us
W20260709 13:18:22.705005 16263 leader_election.cc:336] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.655s (SENT)
I20260709 13:18:22.712383 15670 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:22.644806 18424 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.705674 16263 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.726514 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:22.727386 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45308.2us
I20260709 13:18:22.727687 15748 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:22.649891 18777 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.731551 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:22.732414 15601 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:22.732761 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1848) took 1165 ms. Trace:
I20260709 13:18:22.733084 15595 rpcz_store.cc:276] 0709 13:18:21.567464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.731970 (+1164506us) service_pool.cc:224] Handling call
0709 13:18:22.732249 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.732416 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.732443 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.732487 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:22.732516 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.732569 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.732707 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.735256 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1841) took 1319 ms. Trace:
W20260709 13:18:22.736275 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.741501 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.671867 18936 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:22.657364 18644 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:22.657773 18772 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:22.735782 15600 rpcz_store.cc:276] 0709 13:18:21.415534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.014105 (+598571us) service_pool.cc:224] Handling call
0709 13:18:22.430431 (+416326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.431332 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.734948 (+303616us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b5400164250. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.735128 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956638080}
I20260709 13:18:22.674894 18851 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:22.708562 18404 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:22.745479 15593 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:22.743459 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.668918 18935 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.742329 18860 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:22.749246 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.752063 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:22.768481 15747 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.755072 15594 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:22.755271 15600 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:22.754243 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 558) took 2095 ms. Trace:
I20260709 13:18:22.770563 15595 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: [5.3-8.4]
I20260709 13:18:22.732126 18811 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.709962 18618 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:22.747260 18772 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:22.714260 18919 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.703737 18827 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.700525 18915 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:22.791882 18915 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.792712 18935 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.765554 15601 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:22.747103 18856 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.743854 18798 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.781378 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1629) took 1003 ms. Trace:
I20260709 13:18:22.730782 18777 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:22.790717 18772 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:22.737049 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.809736 16308 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:22.810621 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:22.808295 15600 rpcz_store.cc:276] 0709 13:18:21.778155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.754772 (+976617us) service_pool.cc:224] Handling call
0709 13:18:22.755060 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.781040 (+ 25980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.781301 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.812686 15600 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:22.813083 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 74402.7us
I20260709 13:18:22.816128 15747 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:22.801965 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1630) took 1023 ms. Trace:
I20260709 13:18:22.803817 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 509) took 1038 ms. Trace:
I20260709 13:18:22.818974 15601 rpcz_store.cc:276] 0709 13:18:21.765490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.744516 (+979026us) service_pool.cc:224] Handling call
0709 13:18:22.765373 (+ 20857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.803532 (+ 38159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.803753 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.755645 18854 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:22.805272 15642 connection.cc:256] RPC call timeout handler was delayed by -1.3088402019998284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
W20260709 13:18:22.840111 15642 connection.cc:256] RPC call timeout handler was delayed by -1.174740201999839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:18:22.840549 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0127402020000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260709 13:18:22.770913 15674 rpcz_store.cc:276] 0709 13:18:20.670499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.935378 (+1264879us) service_pool.cc:224] Handling call
0709 13:18:21.941143 (+  5765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.941663 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.941701 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:21.976371 (+ 34670us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.248906 (+272535us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:22.336580 (+ 87674us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.336910 (+   330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.337025 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:22.495333 (+158308us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:22.745781 (+250448us) raft_consensus.cc:1685] finished
0709 13:18:22.754012 (+  8231us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.754167 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":136544,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":4160,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":28847,"spinlock_wait_cycles":36483840,"thread_start_us":339099,"threads_started":2,"wal-append.queue_time_us":309321}
I20260709 13:18:22.766219 18686 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.764139 18851 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.820227 15593 rpcz_store.cc:276] 0709 13:18:21.778408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.800747 (+1022339us) service_pool.cc:224] Handling call
0709 13:18:22.801222 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.801512 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:22.801550 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.801621 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:22.801656 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.801721 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.801877 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.824499 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 512) took 1017 ms. Trace:
I20260709 13:18:22.900818 15600 rpcz_store.cc:276] 0709 13:18:21.806651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.812071 (+1005420us) service_pool.cc:224] Handling call
0709 13:18:22.812442 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.824154 (+ 11712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.824419 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.804733 18827 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:22.782534 18644 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:18:22.881258 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.807264 18349 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.902933 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 514) took 1093 ms. Trace:
I20260709 13:18:22.785105 18863 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:22.913273 15600 rpcz_store.cc:276] 0709 13:18:21.809075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.901886 (+1092811us) service_pool.cc:224] Handling call
0709 13:18:22.902289 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.902510 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.902547 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.902600 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:22.902645 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.902717 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.902860 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:22.837585 18759 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:22.914786 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.914676 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:22.803646 18811 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:22.909425 18944 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:18:22.918792 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 518) took 1108 ms. Trace:
I20260709 13:18:22.919363 15600 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:18:22.804981 18860 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.921382 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:22.925462 16308 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:22.813903 18856 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.923892 15593 rpcz_store.cc:276] 0709 13:18:21.810145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.903658 (+1093513us) service_pool.cc:224] Handling call
0709 13:18:22.905441 (+  1783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.918526 (+ 13085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.918560 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.918591 (+    31us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:22.918617 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.918661 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.918751 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12706,"raft.queue_time_us":15083}
I20260709 13:18:22.903636 18851 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:22.929467 15597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 498) took 2976 ms (client timeout 1983 ms). Trace:
I20260709 13:18:22.930200 15601 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:18:22.938781 15597 rpcz_store.cc:269] 0709 13:18:19.952867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.965660 (+ 12793us) service_pool.cc:224] Handling call
0709 13:18:22.929276 (+2963616us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540020ba54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:22.929391 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853084032}
W20260709 13:18:22.929738 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.947082 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.948417 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:22.949584 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:22.950311 15750 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:22.954061 16263 leader_election.cc:336] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.197s (SENT)
I20260709 13:18:22.955657 16263 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.916193 18704 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:22.926117 18739 consensus_meta.cc:287] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.001s
I20260709 13:18:22.910036 18931 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:22.956826 15593 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: [4.7-7.9]
I20260709 13:18:22.962074 15742 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:18:22.962563 18780 consensus_meta.cc:287] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.002s
I20260709 13:18:22.963155 18913 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:22.963723 18960 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:18:22.963649 18913 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.917646 18349 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:22.958047 16263 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.226s (SENT)
I20260709 13:18:22.965122 16263 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.965492 18938 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:22.965924 18938 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:22.955134 18753 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.966485 18349 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:22.966718 18938 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.966877 18753 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.967061 18644 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.967760 18938 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:22.923882 18863 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:22.914155 18827 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.969458 18863 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.970402 18827 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:22.677232 15676 rpcz_store.cc:276] 0709 13:18:20.531917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.532022 (+   105us) service_pool.cc:224] Handling call
0709 13:18:20.604768 (+ 72746us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:20.605036 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:20.661943 (+ 56907us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.449079 (+1787136us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b18004241e0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe29023a 00007faefe6faa2a
0709 13:18:22.675644 (+226565us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.675694 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:22.675735 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.675793 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.676012 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54233,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":86,"spinlock_wait_cycles":29101312,"thread_start_us":226269,"threads_started":1}
I20260709 13:18:22.975404 18809 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.977082 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.977221 18647 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.978730 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:22.979599 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:22.980337 18890 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:22.981062 18890 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:22.981201 18854 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:22.981838 18419 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:22.982395 18419 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:22.982671 18854 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:22.981986 18890 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.983181 18854 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:22.983371 18419 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.985183 18739 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.986299 18779 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.986876 18779 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:22.987361 18739 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:22.960844 18819 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.980312 18914 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.989362 18819 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:22.931731 18768 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:22.993144 18768 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.995148 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2086) took 1223 ms. Trace:
I20260709 13:18:22.957652 16265 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:23.011921 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54358.2us
I20260709 13:18:22.995548 15672 rpcz_store.cc:276] 0709 13:18:21.771989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.453647 (+681658us) service_pool.cc:224] Handling call
0709 13:18:22.453951 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.458909 (+  4958us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:22.467654 (+  8745us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.690473 (+222819us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.691075 (+   602us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.691243 (+   168us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:22.691288 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.691381 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:22.994948 (+303567us) raft_consensus.cc:1685] finished
0709 13:18:22.994966 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.995096 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3638,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":14793,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":17705,"spinlock_wait_cycles":29382912,"thread_start_us":213110,"threads_started":1,"wal-append.queue_time_us":441758}
I20260709 13:18:23.040131 16308 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:22.924580 18759 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:22.953037 18761 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
W20260709 13:18:23.045024 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 73492.3us
I20260709 13:18:23.048491 15567 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:23.053249 18772 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.055825 18772 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:23.019026 18780 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.020013 18827 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:22.984063 18854 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:22.959666 18909 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:18:22.961563 18704 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.071375 18768 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.071238 18780 consensus_queue.cc:1059] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:23.023216 18915 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.066051 18931 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.062673 18797 consensus_queue.cc:1059] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 13:18:23.105919 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 89834.6us
I20260709 13:18:23.106771 18909 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:23.043141 18841 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:18:23.107774 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:23.108513 18909 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:23.105185 18969 log.cc:927] Time spent T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:18:23.189857 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.223896 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:23.280556 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 365926us
I20260709 13:18:23.280884 15594 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:23.125183 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 68485.8us
I20260709 13:18:23.102994 18768 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:18:23.290453 15599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1608) took 2058 ms (client timeout 1604 ms). Trace:
W20260709 13:18:23.292812 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.318442 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.353439 15599 rpcz_store.cc:269] 0709 13:18:21.231782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.232042 (+   260us) service_pool.cc:224] Handling call
0709 13:18:23.290154 (+2058112us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003192d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:23.290348 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3246315392}
W20260709 13:18:23.428632 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 320929us
I20260709 13:18:23.429975 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:23.432380 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:23.455945 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:23.144500 18970 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:23.115456 18919 raft_consensus.cc:3055] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:23.485597 16309 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:23.216496 18704 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:23.214586 18798 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:23.475054 15594 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:23.216496 18856 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.195269 18759 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:23.278033 18860 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.108952 18931 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.429010 18841 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.467840 18761 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:23.477952 18768 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:23.531605 18768 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:23.538371 18693 consensus_meta.cc:287] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 1.089s	user 0.003s	sys 0.008s
I20260709 13:18:23.539079 18693 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.484182 18919 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:23.541801 18919 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.543151 18919 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.496794 18977 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:23.545449 18977 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:23.546590 18977 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:23.550421 18404 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.785s	user 0.009s	sys 0.008s
I20260709 13:18:23.551087 18404 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10.
I20260709 13:18:23.517885 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:23.499199 18761 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.498808 18841 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.555042 18761 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:23.555181 18841 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.500907 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:23.501688 18979 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:18:23.557322 18798 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:23.556306 16295 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:23.557732 18798 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:23.558585 18798 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:23.522289 18686 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.000s
I20260709 13:18:23.505074 18931 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:23.522795 18851 consensus_meta.cc:287] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.001s
I20260709 13:18:23.570843 18776 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.571275 18851 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.571645 18776 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.574301 18851 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.528940 18856 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:23.576294 18856 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:23.581050 18856 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:23.582753 18777 consensus_meta.cc:287] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260709 13:18:23.583287 18777 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.585420 18777 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.579901 18909 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.591204 18909 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:23.595036 18647 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:23.587231 18693 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:23.604792 18961 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.800s	user 0.000s	sys 0.010s
W20260709 13:18:23.615868 18938 consensus_meta.cc:287] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.006s
W20260709 13:18:23.615176 18779 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.625s	user 0.016s	sys 0.000s
I20260709 13:18:23.623378 18779 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.626319 18779 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:23.638279 18965 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.728s	user 0.000s	sys 0.008s
W20260709 13:18:23.641379 18948 log.cc:927] Time spent T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.283s	user 0.000s	sys 0.020s
I20260709 13:18:23.657579 18811 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:23.659232 18946 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.310s	user 0.002s	sys 0.012s
I20260709 13:18:23.666170 18935 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:23.636446 18914 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:23.648236 18913 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:23.733603 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.734566 15600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.022s	sys 0.060s
W20260709 13:18:23.735157 15600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.022s	sys 0.060s
I20260709 13:18:23.497225 15642 leader_election.cc:400] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:23.737592 15642 leader_election.cc:403] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:18:23.737775 15598 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:23.739576 15599 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:23.505722 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:23.746445 16299 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:23.746028 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1562) took 1370 ms. Trace:
I20260709 13:18:23.733587 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:23.792126 18933 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:23.793824 18933 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:23.798134 18924 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.740234 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 243120us
I20260709 13:18:23.799377 18924 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.830154 18693 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.498333 18981 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:23.834486 18981 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:23.835146 18349 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:23.837039 15594 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:23.838925 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:23.843382 16308 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:23.845145 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:23.847457 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:23.851955 18753 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:23.857147 16295 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:23.830010 18821 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.863107 18349 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:23.749245 15745 rpcz_store.cc:276] 0709 13:18:22.375494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.375664 (+   170us) service_pool.cc:224] Handling call
0709 13:18:22.377034 (+  1370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.402507 (+ 25473us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:22.402540 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.406548 (+  4008us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.666510 (+259962us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:22.666551 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.666618 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.637509 (+970891us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:23.744963 (+107454us) raft_consensus.cc:1685] finished
0709 13:18:23.745026 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.745655 (+   629us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40514,"raft.queue_time_us":27375,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8930,"spinlock_wait_cycles":5982848,"thread_start_us":215909,"threads_started":1,"wal-append.queue_time_us":364625}
I20260709 13:18:23.831594 18693 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.882241 18349 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:23.883453 18821 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:23.893229 15597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.013s	sys 0.032s
W20260709 13:18:23.893990 15597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.013s	sys 0.032s
I20260709 13:18:23.895973 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1854) took 1369 ms. Trace:
I20260709 13:18:23.887377 18821 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:23.903689 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.884027 18349 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.914616 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:23.876272 18981 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:23.897315 15597 rpcz_store.cc:276] 0709 13:18:22.526412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.946094 (+419682us) service_pool.cc:224] Handling call
0709 13:18:22.946415 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.946610 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:23.057319 (+110709us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.894983 (+837664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.895152 (+   169us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:23.895284 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.895460 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.895799 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":110706,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":16461,"thread_start_us":891601,"threads_started":2}
W20260709 13:18:23.942615 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 104026us
I20260709 13:18:23.954741 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 513) took 2147 ms. Trace:
W20260709 13:18:23.948495 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 537479us
I20260709 13:18:23.968209 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1885) took 3254 ms. Trace:
I20260709 13:18:23.968766 15668 rpcz_store.cc:276] 0709 13:18:20.713469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.975119 (+1261650us) service_pool.cc:224] Handling call
0709 13:18:22.577391 (+602272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.577772 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:22.577801 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.620436 (+ 42635us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.819406 (+198970us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:22.819446 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.819521 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.145310 (+325789us) raft_consensus.cc:1685] finished
0709 13:18:23.145331 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.967575 (+822244us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54001a7050. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:23.967915 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":516,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":3334,"spinlock_wait_cycles":1384032128,"thread_start_us":136446,"threads_started":1,"wal-append.queue_time_us":309086}
I20260709 13:18:23.968372 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:23.955713 15601 rpcz_store.cc:276] 0709 13:18:21.807074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.819819 (+1012745us) service_pool.cc:224] Handling call
0709 13:18:22.929890 (+110071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.945781 (+ 15891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.954247 (+1008466us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b540020ba50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:23.954532 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75300736}
W20260709 13:18:23.982811 15751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2181) took 4029 ms (client timeout 2180 ms). Trace:
W20260709 13:18:23.983417 15751 rpcz_store.cc:269] 0709 13:18:19.953183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.954309 (+  1126us) service_pool.cc:224] Handling call
0709 13:18:23.982317 (+4028008us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540002c454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:23.982538 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4038586112}
I20260709 13:18:23.989004 18781 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:23.991501 18781 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:23.993315 18933 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:23.994413 18739 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:23.994977 18739 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:23.999490 18739 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.001924 18739 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.009850 18875 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:24.010674 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:24.011705 15601 raft_consensus.cc:2376] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9. Re-sending same reply.
I20260709 13:18:24.008278 15594 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:24.024824 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1641) took 1009 ms. Trace:
I20260709 13:18:24.001690 18776 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:24.003716 18899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.000s	sys 0.017s
I20260709 13:18:24.025257 15594 rpcz_store.cc:276] 0709 13:18:23.013378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.492663 (+479285us) service_pool.cc:224] Handling call
0709 13:18:24.017037 (+524374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.031200 18349 consensus_queue.cc:1059] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:24.003248 18781 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:24.025792 16263 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:24.037050 15597 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
W20260709 13:18:24.035624 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 47081.9us
I20260709 13:18:24.042281 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:24.043181 15601 raft_consensus.cc:2393] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 5: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:24.043630 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 527) took 1029 ms. Trace:
I20260709 13:18:24.043973 15601 rpcz_store.cc:276] 0709 13:18:23.014239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.033995 (+1019756us) service_pool.cc:224] Handling call
0709 13:18:24.043550 (+  9555us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.045049 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:24.046133 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1858) took 1517 ms. Trace:
I20260709 13:18:24.046578 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1623) took 2280 ms. Trace:
I20260709 13:18:24.040681 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1867) took 1050 ms. Trace:
I20260709 13:18:24.054941 15597 rpcz_store.cc:276] 0709 13:18:23.011571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.967769 (+956198us) service_pool.cc:224] Handling call
0709 13:18:24.038738 (+ 70969us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:24.040129 18899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.000s	sys 0.018s
I20260709 13:18:24.053524 15595 rpcz_store.cc:276] 0709 13:18:21.766334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.745772 (+979438us) service_pool.cc:224] Handling call
0709 13:18:22.770156 (+ 24384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:22.771143 (+   987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.046183 (+1275040us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b540012b950. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:24.046404 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55287552}
I20260709 13:18:24.010694 18875 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.059161 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 524) took 1045 ms. Trace:
I20260709 13:18:24.061736 15594 rpcz_store.cc:276] 0709 13:18:23.013613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.044622 (+1031009us) service_pool.cc:224] Handling call
0709 13:18:24.059103 (+ 14481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.065030 18454 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:24.065937 18454 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:24.067514 18454 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.053077 15593 rpcz_store.cc:276] 0709 13:18:22.529000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.962818 (+433818us) service_pool.cc:224] Handling call
0709 13:18:22.963131 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.073805 (+110674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.073855 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.073919 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:23.073976 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.045605 (+971629us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400248954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:24.045696 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.045948 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1730,"raft.queue_time_us":43907,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":37001,"spinlock_wait_cycles":233541888}
I20260709 13:18:24.079141 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:24.082360 15593 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:24.083182 15597 raft_consensus.cc:1240] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:18:24.084499 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.087458 15642 leader_election.cc:400] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 4. Current term is 5.
I20260709 13:18:24.087982 18776 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.090399 18768 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.091192 18419 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.091424 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 2079) took 2507 ms. Trace:
I20260709 13:18:24.091290 18768 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.092232 18776 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.082828 15593 pending_rounds.cc:85] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 5
I20260709 13:18:24.093906 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1859) took 1554 ms. Trace:
I20260709 13:18:24.094178 15597 rpcz_store.cc:276] 0709 13:18:22.529356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.060699 (+1531343us) service_pool.cc:224] Handling call
0709 13:18:24.083019 (+ 22320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.083525 (+   506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.083660 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:24.092885 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1834) took 4229 ms (client timeout 2056 ms). Trace:
I20260709 13:18:24.093534 15593 pending_rounds.cc:107] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:24.092064 18419 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.101506 15596 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:24.092039 15669 rpcz_store.cc:276] 0709 13:18:21.584034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.837034 (+253000us) service_pool.cc:224] Handling call
0709 13:18:24.090877 (+2253843us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003a4b54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:24.091183 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956001152}
I20260709 13:18:24.110719 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:24.108543 15497 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.114205 15594 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:24.115670 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1640) took 1102 ms. Trace:
W20260709 13:18:24.097605 15598 rpcz_store.cc:269] 0709 13:18:19.863201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:19.863329 (+   128us) service_pool.cc:224] Handling call
0709 13:18:24.092519 (+4229190us) spinlock_profiling.cc:243] Waited 3.87 s on lock 0x7b5400247a54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:24.092792 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8897068416}
I20260709 13:18:24.116072 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1865) took 1127 ms. Trace:
I20260709 13:18:24.111229 15593 raft_consensus.cc:2889] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:24.116241 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.115311 15497 catalog_manager.cc:5697] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 3 to 4, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.116057 15599 rpcz_store.cc:276] 0709 13:18:23.013136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.429697 (+416561us) service_pool.cc:224] Handling call
0709 13:18:24.115385 (+685688us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400100ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:24.115580 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708850944}
I20260709 13:18:24.117863 15594 rpcz_store.cc:276] 0709 13:18:22.988189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.063799 (+1075610us) service_pool.cc:224] Handling call
0709 13:18:24.095748 (+ 31949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.115168 (+ 19420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.115882 (+   714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.122638 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:24.123450 15599 raft_consensus.cc:2376] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7. Re-sending same reply.
I20260709 13:18:24.123692 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 708) took 1379 ms. Trace:
I20260709 13:18:24.124176 15748 rpcz_store.cc:276] 0709 13:18:22.743881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.757100 (+ 13219us) service_pool.cc:224] Handling call
0709 13:18:22.757508 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.794956 (+ 37448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.795003 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:22.795067 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:22.795131 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.123152 (+1328021us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b54001d24d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:24.123225 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.123471 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85488896}
I20260709 13:18:24.125193 15595 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:24.129406 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:24.109217 18776 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.130999 15601 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:24.134397 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:24.135392 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1864) took 1144 ms. Trace:
I20260709 13:18:24.136116 15595 rpcz_store.cc:276] 0709 13:18:22.987908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.063135 (+1075227us) service_pool.cc:224] Handling call
0709 13:18:24.109955 (+ 46820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.130165 (+ 20210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.132522 (+  2357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.132396 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:24.135957 15642 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:24.116294 18841 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:24.145152 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 528) took 1130 ms. Trace:
W20260709 13:18:24.150013 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.149317 15597 rpcz_store.cc:276] 0709 13:18:23.014458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.128179 (+1113721us) service_pool.cc:224] Handling call
0709 13:18:24.137410 (+  9231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.141219 (+  3809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.141254 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.144864 (+  3610us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:24.144907 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.144968 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.145094 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.141495 18419 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:24.145730 18693 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.147608 18841 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:24.159905 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.153844 19001 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.164067 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:24.167389 15602 raft_consensus.cc:2410] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:24.168852 15745 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:24.173638 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1639) took 1161 ms. Trace:
I20260709 13:18:24.167085 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1866) took 1178 ms. Trace:
I20260709 13:18:24.173985 15599 rpcz_store.cc:276] 0709 13:18:23.012838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.124456 (+1111618us) service_pool.cc:224] Handling call
0709 13:18:24.141115 (+ 16659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.169983 (+ 28868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.170010 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.173444 (+  3434us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:24.173472 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.173520 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.173596 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.175670 15593 rpcz_store.cc:276] 0709 13:18:22.988417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.077908 (+1089491us) service_pool.cc:224] Handling call
0709 13:18:24.081919 (+  4011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.165899 (+ 83980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.166961 (+  1062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:24.178058 15746 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 13:18:24.176638 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 202109us
I20260709 13:18:24.169420 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:24.186228 18775 raft_consensus.cc:3055] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:24.189599 18775 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:24.189749 15751 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:24.177268 18924 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.186480 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.196031 15748 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:18:24.175318 15497 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 6 to 7, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:24.188521 18768 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.201627 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:24.194727 18775 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.204327 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.203120 18914 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.197371 18875 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:24.210760 15746 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:24.212249 18903 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.209252 18998 log.cc:927] Time spent T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.089s	user 0.001s	sys 0.001s
I20260709 13:18:24.213708 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:24.215649 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.212899 18903 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:24.221335 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 110176us
I20260709 13:18:24.224246 15751 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
W20260709 13:18:24.224429 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.225383 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:24.215075 18914 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.210707 15497 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 3 to 6, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 6 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.236389 15746 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:18:24.237893 19002 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:18:24.218182 18841 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.244577 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.245755 15640 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:24.246914 18739 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:24.251848 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:24.254459 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.255611 18899 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:24.256049 18899 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:24.256450 18899 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.256721 18809 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.257094 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1613) took 3021 ms. Trace:
I20260709 13:18:24.247460 18739 raft_consensus.cc:697] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:24.257567 15596 rpcz_store.cc:276] 0709 13:18:21.235663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.236467 (+   804us) service_pool.cc:224] Handling call
0709 13:18:24.095189 (+2858722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.102022 (+  6833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.256849 (+154827us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b5400247a50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:24.257011 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6563035520}
I20260709 13:18:24.258504 18739 consensus_queue.cc:237] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.259284 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1633) took 2243 ms. Trace:
I20260709 13:18:24.260260 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:24.261039 16310 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.259685 15600 rpcz_store.cc:276] 0709 13:18:22.016341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.925622 (+909281us) service_pool.cc:224] Handling call
0709 13:18:22.925867 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.105486 (+179619us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:23.108411 (+  2925us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.789220 (+680809us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.792136 (+  2916us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.792246 (+   110us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:23.792353 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.103850 (+311497us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18004661e0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:24.120474 (+ 16624us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b18004661e0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb603522 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:24.258517 (+138043us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b18004661e0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5d12a6 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419
0709 13:18:24.258996 (+   479us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b5400148a54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:24.259050 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.259221 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":50967,"prepare.run_cpu_time_us":230,"prepare.run_wall_time_us":13446,"raft.queue_time_us":57593,"raft.run_cpu_time_us":620,"raft.run_wall_time_us":33123,"spinlock_wait_cycles":515395584,"thread_start_us":626869,"threads_started":1,"wal-append.queue_time_us":508539}
I20260709 13:18:24.265019 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:24.266808 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 707) took 1540 ms. Trace:
I20260709 13:18:24.267208 15742 rpcz_store.cc:276] 0709 13:18:22.726734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.728210 (+  1476us) service_pool.cc:224] Handling call
0709 13:18:22.753779 (+ 25569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.962485 (+208706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.266367 (+1303882us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003de854. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:24.266650 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478220160}
I20260709 13:18:24.269912 15640 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:24.272761 18768 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:24.275100 18693 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.275702 18768 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.278321 18768 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.279223 19001 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.274398 18558 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:24.280553 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.279773 19001 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.286404 19001 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:24.292397 15748 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:24.295739 18798 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.305099 18935 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:24.290354 18419 consensus_queue.cc:1059] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:18:24.305766 18935 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.296047 18693 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:18:24.336836 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.253664 15497 catalog_manager.cc:5697] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:24.307974 18775 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:24.349301 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 58397.4us
I20260709 13:18:24.347321 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.287588 18558 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.356415 18889 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:24.357388 18558 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.357184 18889 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.357950 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.358610 15669 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:18:24.359582 18889 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.359838 15672 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.361775 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.362985 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.363333 18870 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:24.364125 18870 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:24.364728 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.346676 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.364354 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.386548 18851 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.386844 15668 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:24.366199 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.395503 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.387293 18851 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.407233 15642 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:24.345827 18875 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:18:24.412457 15748 raft_consensus.cc:2393] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:24.414795 15746 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
W20260709 13:18:24.415737 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.416901 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:24.418306 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 110044us
I20260709 13:18:24.419322 15497 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 5 to 6, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 6 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.421172 15497 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 8, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 8 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.424054 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.425554 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:24.426738 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 53528.4us
I20260709 13:18:24.399516 18914 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.429891 18903 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.430064 18889 raft_consensus.cc:3055] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:18:24.430460 18889 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:24.431269 18935 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.431442 15677 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:18:24.436833 18933 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:24.437438 18933 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:24.438418 18933 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.441910 18346 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:24.442618 18346 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.444756 18924 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:24.445320 18924 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.445775 18851 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.446606 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.447546 18924 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.449110 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.410996 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.449536 18841 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.449867 15743 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:24.450554 15746 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:24.450877 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.449530 15675 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:24.452168 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.452860 15747 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:24.455869 15497 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 4 to 5, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:18:24.457737 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.459965 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.461665 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.463294 15675 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:24.465320 15668 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:24.436465 15598 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:24.468568 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.470964 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 56425.7us
I20260709 13:18:24.472227 16310 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:24.473172 15669 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
W20260709 13:18:24.474032 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 64219.2us
W20260709 13:18:24.468799 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 94914.1us
W20260709 13:18:24.478837 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 59807.5us
I20260709 13:18:24.482681 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:24.487498 18979 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:24.488230 18979 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.492673 18979 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:24.493386 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:24.495221 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.495517 18851 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:24.476972 18693 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.498557 19004 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:24.499191 19004 raft_consensus.cc:697] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:24.499369 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:24.500663 18346 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.501111 18775 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:24.501165 19013 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.503489 19013 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.503916 19013 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.504410 18346 consensus_queue.cc:1059] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:24.506289 18346 consensus_queue.cc:1243] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:24.505359 18865 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.507153 15567 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.500342 19004 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.509481 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:24.512581 18914 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:24.513049 18914 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:24.513440 18914 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.516881 15671 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:24.467850 18899 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.522716 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.523546 15677 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:24.524392 15744 raft_consensus.cc:2393] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:24.525309 15670 raft_consensus.cc:1240] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:24.527653 18977 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.528326 18977 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.530337 18870 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.535272 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.531486 18977 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.533155 18935 raft_consensus.cc:3055] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:24.536873 18935 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:24.543510 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:24.549420 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.549300 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.530568 18899 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.557183 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.537830 15716 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:24.557093 15677 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:24.553026 18346 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:24.552850 18821 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.560029 15669 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.560402 18821 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.560957 15672 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:24.561972 18935 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.560089 18346 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:24.563295 18935 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.563827 18821 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.563334 18346 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:24.567565 15669 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:24.568969 18821 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:24.569773 18821 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.572288 18821 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:24.577699 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.581442 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.582211 16295 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:24.431550 18889 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.584079 18889 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:18:24.584929 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 89822.2us
W20260709 13:18:24.586355 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 93917.4us
I20260709 13:18:24.588465 15716 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.589118 18851 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.590543 15675 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:24.591092 15675 pending_rounds.cc:85] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 7
I20260709 13:18:24.591394 15675 pending_rounds.cc:107] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:24.589762 19010 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:24.591707 15675 raft_consensus.cc:2889] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.592227 19010 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:24.592654 19010 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:24.593604 19010 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.595167 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.596540 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.596861 15671 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:24.597651 18977 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:24.602404 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.602609 18914 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.605084 18914 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.605995 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.614156 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.612692 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:24.615164 16310 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:24.616315 18914 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:24.609138 15497 catalog_manager.cc:5697] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 3 to 4, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.618897 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.620126 18977 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:18:24.618624 19001 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.642179 19001 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.643291 15674 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:24.644065 15677 raft_consensus.cc:1275] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:24.630447 18851 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:24.644577 15677 pending_rounds.cc:85] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 3
I20260709 13:18:24.644937 15677 pending_rounds.cc:107] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:24.616847 18419 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:18:24.645222 15677 raft_consensus.cc:2889] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.646656 19010 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.635659 18899 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:24.651557 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.653012 15675 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:18:24.655042 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 66657.6us
W20260709 13:18:24.639212 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.656963 15716 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:24.658361 18875 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:24.659507 18851 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:24.662441 18899 consensus_queue.cc:1059] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:24.663337 19013 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.667806 19013 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:24.671819 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.676194 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.679277 15497 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 4 to 7, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 7 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:24.684544 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.684644 15716 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:24.692961 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 185909us
I20260709 13:18:24.694670 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:24.686851 15497 catalog_manager.cc:5697] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:24.703796 15669 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:24.706295 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 93740.8us
I20260709 13:18:24.700695 18875 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.708631 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.711087 16295 raft_consensus.cc:2393] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:24.714334 18419 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:24.717957 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.718528 18419 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.719240 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.720306 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.711995 18899 consensus_queue.cc:1243] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:24.719353 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.721001 15747 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:24.722119 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.711746 18875 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.723446 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.724115 15743 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:24.703385 18977 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.724903 18977 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.725183 18875 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:24.726213 18558 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:24.727169 18977 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.727854 16263 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:24.728403 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 43883us
I20260709 13:18:24.729071 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:24.729214 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 169969us
I20260709 13:18:24.731791 15746 raft_consensus.cc:2393] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:24.732837 18899 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:24.733247 19012 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:24.735734 18865 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:24.737890 18865 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:24.739306 15742 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:24.739591 18865 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:24.740113 18865 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:24.730096 18419 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:24.744477 15497 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:24.745913 18346 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.748143 18346 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.748914 19004 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:24.749347 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.755707 16299 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:24.750895 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:24.757179 19004 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:24.753582 18977 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.758256 19004 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.752235 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.760010 19004 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:24.752794 15716 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:24.752334 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.765714 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.766516 15742 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:24.767614 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:24.769207 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.769486 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.771095 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.771273 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:24.771965 15747 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:24.772773 18933 consensus_queue.cc:1059] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:24.728741 18875 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.773638 18933 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:24.773861 18875 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.775458 18933 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:18:24.781277 18914 raft_consensus.cc:3055] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:24.781773 18914 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:24.782642 18914 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:24.783919 18914 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.786516 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:24.769301 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.776988 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.788208 16308 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:24.777230 18851 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:24.789660 18851 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:24.790824 18851 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.777902 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:24.772394 15567 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:24.780812 15744 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:24.780803 18821 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.784004 15742 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:24.776176 18875 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:24.798416 18821 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.803669 19001 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.803339 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.804893 18889 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:24.805282 18935 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:24.806588 15743 raft_consensus.cc:2410] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:24.849200 19001 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:24.807582 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.847370 18821 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:24.850699 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.851413 19001 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:24.851954 19001 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:24.852885 15642 connection.cc:256] RPC call timeout handler was delayed by -2.0128502510001454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 13:18:24.853363 15642 connection.cc:256] RPC call timeout handler was delayed by -1.8607502510001268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 13:18:24.853500 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 107628us
I20260709 13:18:24.741835 18865 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.815878 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.817138 15744 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:18:24.867205 15744 pending_rounds.cc:85] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 8
I20260709 13:18:24.867496 15744 pending_rounds.cc:107] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:24.867743 15744 raft_consensus.cc:2889] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.818439 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.819581 18798 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:18:24.819986 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.822425 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.822081 16310 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:18:24.824096 18870 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:24.825583 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.825834 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.848475 18889 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.834444 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.887547 16304 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:24.839275 16306 pending_rounds.cc:85] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 6
I20260709 13:18:24.888099 16306 pending_rounds.cc:107] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:18:24.840837 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:24.816356 18977 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:24.853708 15642 connection.cc:256] RPC call timeout handler was delayed by -1.7734502509999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
I20260709 13:18:24.888459 16306 raft_consensus.cc:2889] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.810127 15567 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:24.829548 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:24.869887 16310 pending_rounds.cc:85] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 8
I20260709 13:18:24.889654 16310 pending_rounds.cc:107] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:18:24.889931 16310 raft_consensus.cc:2889] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:24.888964 15642 connection.cc:256] RPC call timeout handler was delayed by -1.7059502510001039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 13:18:24.854302 18981 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.890441 15642 connection.cc:256] RPC call timeout handler was delayed by -1.6771502510000573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
I20260709 13:18:24.852418 19001 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:24.892315 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 64788.6us
I20260709 13:18:24.900750 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:24.900967 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 90926.3us
I20260709 13:18:24.870340 18979 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.885753 18870 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.895311 15742 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 3.
I20260709 13:18:24.888445 18889 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:24.917999 18979 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.920648 15567 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:24.921242 18865 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:24.907572 18981 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:24.972891 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:24.973521 15669 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:24.973738 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:24.972914 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 66387.1us
I20260709 13:18:24.972186 18981 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:24.983500 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 157778us
I20260709 13:18:24.921663 18870 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:24.904850 16263 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.054s (SENT) [suppressed 22 similar messages]
I20260709 13:18:24.921794 18419 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:24.995533 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 74961.3us
I20260709 13:18:24.908150 18346 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.008842 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.015964 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.016942 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.018215 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.018872 15743 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:25.019709 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.020291 15748 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:25.021176 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.022382 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.023172 15746 raft_consensus.cc:2393] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:25.011936 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:25.025152 15669 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:25.025938 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 121108us
I20260709 13:18:25.026355 15747 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:24.995533 18768 raft_consensus.cc:2764] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:18:25.029073 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:24.980319 18798 consensus_queue.cc:1059] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:25.032285 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.037356 15674 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.010327 18346 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.030828 15742 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:25.046552 15565 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:25.049219 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:25.049752 15671 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:25.033378 19004 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.070326 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:25.076938 15751 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.072041 15669 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:25.077486 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 51676us
I20260709 13:18:25.080328 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.081363 15672 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:25.084120 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.079075 15714 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:25.089147 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.089915 15675 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:25.090852 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.091681 15750 raft_consensus.cc:2410] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:25.091493 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.048053 18346 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:25.095207 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 47271.3us
I20260709 13:18:25.027704 18454 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:25.105662 16265 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:25.104346 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.108479 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.108821 15565 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:25.094359 18821 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:25.076354 18933 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.113289 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.088318 18924 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:25.114619 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:25.076756 19004 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:25.115075 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.115612 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.116374 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.096431 19012 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:25.133929 15668 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:25.102851 18977 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:25.136317 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 48528.9us
I20260709 13:18:25.140988 15670 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:25.141873 15742 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:25.088109 18419 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:18:25.114243 19030 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.146452 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:25.121901 18768 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.118575 18924 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.150629 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.132302 19004 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.209172 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:25.131397 19012 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:25.113814 18863 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.170s
I20260709 13:18:25.143451 18935 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.123260 18933 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.238087 18798 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:18:25.210363 19035 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:25.216200 18924 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.229382 19012 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:25.249217 19035 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:25.254649 19027 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:18:25.257375 19031 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:25.258383 18863 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:25.261808 18979 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:25.263685 19039 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:25.249919 19001 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:25.291476 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.271066 18346 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:25.154052 18914 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:18:25.295878 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:25.277421 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.236585 19033 raft_consensus.cc:3055] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:25.152957 19030 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.241905 18977 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.304498 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:25.307225 19034 log.cc:927] Time spent T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:25.307638 18914 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:25.307852 18346 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:25.309939 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.315718 15743 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:25.288082 19039 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.311424 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.283870 18863 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:25.319825 15744 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:25.316130 15748 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:25.318938 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.321055 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.300642 19033 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:25.341368 18933 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:25.341622 19033 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.343791 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.343884 19033 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:25.319288 18914 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.325314 19039 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:25.344564 15675 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 4.
I20260709 13:18:25.345785 15750 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:25.348284 15674 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:25.348547 16309 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:18:25.376664 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.388770 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 239806us
I20260709 13:18:25.429108 15675 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:25.427258 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:25.350952 19030 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:25.437173 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72998.3us
I20260709 13:18:25.438853 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.350046 18977 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:25.441711 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.351192 18914 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:25.320298 18899 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.117s
W20260709 13:18:25.489328 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 99171.6us
I20260709 13:18:25.348697 18346 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:18:25.352752 19004 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:25.495762 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.499993 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 385422us
I20260709 13:18:25.504037 15669 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:18:25.511713 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 62023.6us
I20260709 13:18:25.511849 15742 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:25.513964 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:25.488718 18821 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:25.516814 15716 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:25.489977 19001 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:18:25.522774 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 134193us
W20260709 13:18:25.515499 18889 consensus_meta.cc:287] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.002s
I20260709 13:18:25.525324 18899 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:25.532455 19045 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:25.538865 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:25.560250 19001 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.561093 19001 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:25.564325 19001 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:25.564690 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.565822 15671 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:25.567476 15751 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:25.573907 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:25.576843 19046 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.581355 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.586264 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:25.591610 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.592389 15674 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 4.
I20260709 13:18:25.593545 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.528102 18863 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.597424 18863 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:25.597514 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.598834 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:25.531287 18889 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:25.600728 19035 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:25.601574 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:25.602538 18889 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:25.603286 15746 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
W20260709 13:18:25.604530 19048 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:18:25.609961 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.534757 19049 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:25.604430 19004 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:25.610059 18768 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:25.572353 18914 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.614318 18775 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:18:25.619952 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.611128 19049 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.638672 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 112508us
I20260709 13:18:25.616392 18914 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:25.642041 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:25.529348 19043 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.294s
I20260709 13:18:25.590812 18346 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:25.645109 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:25.653195 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:25.643296 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 117153us
I20260709 13:18:25.655660 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:25.660073 15594 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:25.656809 15600 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:25.659830 15593 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
W20260709 13:18:25.662232 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 51206.6us
I20260709 13:18:25.683753 15601 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:25.685298 15602 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:25.666822 15676 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:18:25.642674 19049 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:25.684279 18768 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.690357 18768 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:25.690759 18768 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.641804 18899 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:18:25.684307 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.698248 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 68565.1us
I20260709 13:18:25.686523 15676 pending_rounds.cc:85] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 4
I20260709 13:18:25.700752 15676 pending_rounds.cc:107] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:25.701035 15676 raft_consensus.cc:2889] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.629900 18889 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:18:25.706897 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:25.707719 15594 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:25.710593 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:25.713841 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 68811.6us
I20260709 13:18:25.718278 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:25.728790 15567 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:25.741071 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:25.758351 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 63441.3us
I20260709 13:18:25.768787 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.705178 19001 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:18:25.739965 16263 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.787s (SENT)
I20260709 13:18:25.740445 15597 raft_consensus.cc:1240] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:18:25.787871 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:25.784257 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:25.740864 15594 raft_consensus.cc:1275] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:25.721668 18914 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:25.725548 18899 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:25.791507 18899 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:25.809984 15593 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:25.741887 18821 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:25.816757 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:25.781689 18933 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.796528 18914 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.810168 18693 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.833853 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.786610 18775 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:18:25.839763 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:25.844188 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 104276us
I20260709 13:18:25.813453 19035 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:25.818656 18821 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.846278 15676 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:25.835166 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:25.853192 15594 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:25.817477 18419 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:25.854773 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.858026 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:25.835969 18914 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:25.831924 18933 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.868139 15596 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:18:25.869282 19033 consensus_meta.cc:287] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.002s
I20260709 13:18:25.869462 18933 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:25.850600 18693 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:25.870977 15677 raft_consensus.cc:1217] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[5.3-9.5]   Dedup: 5.3->[7.4-9.5]
I20260709 13:18:25.871502 15677 pending_rounds.cc:85] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 3
I20260709 13:18:25.871794 15677 pending_rounds.cc:107] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:18:25.872073 18693 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:25.873471 15597 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:25.872084 15677 raft_consensus.cc:2889] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:25.889731 16263 leader_election.cc:336] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.908s (SENT)
I20260709 13:18:25.890385 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:25.851599 19039 consensus_meta.cc:287] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:18:25.851809 19001 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:25.902479 18870 consensus_meta.cc:287] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.877s	user 0.010s	sys 0.000s
I20260709 13:18:25.863163 18821 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:25.902757 19033 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.904026 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:25.904124 19035 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:25.905057 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:25.921293 16306 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:25.906071 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:25.908532 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:25.910351 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:25.912484 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 72880.8us
I20260709 13:18:25.925084 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:25.927603 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.891866 18693 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.943897 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 134125us
I20260709 13:18:25.952980 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:25.954228 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:25.955595 16307 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:25.992342 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:25.993428 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:25.993819 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:25.994238 16310 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:25.995738 15597 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:25.893254 18419 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:25.998829 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 45996us
I20260709 13:18:25.914630 19039 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:25.920076 18870 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.002846 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:26.007634 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 53869.9us
I20260709 13:18:25.936048 19033 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.008141 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:26.030426 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 259542us
I20260709 13:18:26.029718 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.037734 16308 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:26.040056 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.001159 18775 raft_consensus.cc:2764] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:26.033720 15598 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:25.956447 18693 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.040457 15597 raft_consensus.cc:2410] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:18:26.041271 15567 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:26.062497 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:26.065887 16304 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 11: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:26.037256 19043 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.073946 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.075361 15642 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.075640 19075 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.069283 18346 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:26.079877 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.092825 15597 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:26.094897 16302 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:26.096172 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:26.097875 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.102061 15599 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 4. Current term is 5. Ops: []
I20260709 13:18:26.077605 19043 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.106561 19033 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:26.041759 19065 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:18:26.107635 15596 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:26.112998 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:26.111105 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.119318 16299 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:26.077507 19039 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:26.133849 16263 leader_election.cc:336] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.171s (SENT)
I20260709 13:18:26.150053 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:26.076566 19075 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.081248 18346 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:26.144059 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2243) took 1097 ms. Trace:
I20260709 13:18:26.141355 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:26.229348 15747 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:26.158663 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.129263 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:26.137750 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:26.222708 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 72745.3us
I20260709 13:18:26.144856 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:26.230551 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:26.107606 19012 consensus_meta.cc:287] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
I20260709 13:18:26.230764 16304 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:26.114835 19059 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.467s	user 0.000s	sys 0.002s
W20260709 13:18:26.239828 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 201429us
I20260709 13:18:26.236243 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.120741 18933 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.130438 19058 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
W20260709 13:18:26.140838 18924 consensus_meta.cc:287] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.003s
I20260709 13:18:26.249112 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:26.139664 18863 consensus_meta.cc:287] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.001s
I20260709 13:18:26.253295 16306 raft_consensus.cc:2410] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:18:26.234736 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.112031 18775 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:26.254739 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 120906us
W20260709 13:18:26.140170 18935 consensus_meta.cc:287] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.903s	user 0.011s	sys 0.000s
I20260709 13:18:26.242040 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:26.241983 15750 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:26.228262 15745 rpcz_store.cc:276] 0709 13:18:25.046441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.046551 (+   110us) service_pool.cc:224] Handling call
0709 13:18:25.082881 (+ 36330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.111408 (+ 28527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.111436 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.138975 (+ 27539us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.234556 (+ 95581us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:25.234598 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.234664 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.143146 (+908482us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b24003e7248. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb4899c4 00007faefb487acb 00007faefb642dc9 00007faefb642a55 00007faefb641fb0 00007faefe2b8488 00007faefe2b8be8 00007faefe290398 00007faefe28b76a 00007faefe28abb6
0709 13:18:26.143757 (+   611us) raft_consensus.cc:1685] finished
0709 13:18:26.143776 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.143999 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17055,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":19206,"spinlock_wait_cycles":10560256,"thread_start_us":82274,"threads_started":1,"wal-append.queue_time_us":119404}
I20260709 13:18:26.245639 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:26.142880 18419 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:26.243186 15567 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:26.142081 18693 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:26.247349 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 136327us
I20260709 13:18:26.329226 16304 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:26.329749 15642 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.330698 18775 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.331001 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.332043 18775 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:18:26.332573 18775 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:26.227260 18865 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.333070 18775 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:26.333410 18865 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:26.333897 18865 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.250918 15676 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:26.133968 18768 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.338424 18768 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.110581 18870 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:26.248127 19074 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.254804 19039 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.289415 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:26.342518 15747 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:26.340502 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:26.343539 19074 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.343910 19074 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.296962 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:26.298332 19077 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.344679 15749 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:26.345369 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.242609 19012 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.345145 18775 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.347424 19012 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.281960 19047 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.307561 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1938) took 1041 ms. Trace:
I20260709 13:18:26.348130 19047 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.348644 19047 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.348258 15673 rpcz_store.cc:276] 0709 13:18:25.266334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.295072 (+ 28738us) service_pool.cc:224] Handling call
0709 13:18:25.308968 (+ 13896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.309436 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:18:25.509456 (+200020us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.645841 (+136385us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.660503 (+ 14662us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.661031 (+   528us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:25.661083 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.661176 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.129845 (+468669us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:26.304275 (+174430us) raft_consensus.cc:1685] finished
0709 13:18:26.307315 (+  3040us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.307466 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37154,"prepare.queue_time_us":268184,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":12431,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":18470,"spinlock_wait_cycles":14989696,"thread_start_us":261697,"threads_started":2,"wal-append.queue_time_us":217685}
I20260709 13:18:26.351504 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:26.307757 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1936) took 1084 ms. Trace:
I20260709 13:18:26.352824 15672 rpcz_store.cc:276] 0709 13:18:25.223126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.286841 (+ 63715us) service_pool.cc:224] Handling call
0709 13:18:25.301045 (+ 14204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.305444 (+  4399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.305488 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.305557 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:25.305601 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.307504 (+1001903us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b54000820d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:26.307561 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.307694 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9565952}
I20260709 13:18:26.259315 18346 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:26.309240 19049 consensus_meta.cc:287] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 13:18:26.354233 15749 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:26.354580 19049 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.252519 18924 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.321278 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:26.356763 19049 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.356935 15674 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:26.357640 15601 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:18:26.358515 18924 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:26.362470 18865 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.261106 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.368019 18346 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:26.368156 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 107132us
I20260709 13:18:26.369020 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.369796 18865 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.299022 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.260452 18935 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.363473 19075 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.363819 15674 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:26.326179 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:26.364296 18775 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.364964 15642 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.366618 19047 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.370658 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.370754 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:26.369845 18346 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:26.344274 19074 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:26.372627 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 44359.7us
I20260709 13:18:26.372865 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.257395 18933 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.374661 19049 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:18:26.381688 15595 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:26.385334 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.391887 18821 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.317060 19043 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:26.408035 15598 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:26.408829 18924 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:26.411499 15749 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:26.432379 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:26.411799 19077 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.412352 18768 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.412359 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:26.422627 18693 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.426031 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:26.429262 15596 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:26.428659 15565 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.437354 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.430410 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:26.438520 16308 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.431221 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:26.439320 16310 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.436298 19077 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.451778 19077 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:26.452877 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 88025.8us
I20260709 13:18:26.444407 18768 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.461396 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.462198 15595 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:26.463328 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:26.463865 15747 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.465636 15600 raft_consensus.cc:2393] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:26.469664 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:26.470873 15596 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:26.434262 18924 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.452541 19077 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:26.475116 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:26.478039 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.464449 18768 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:26.486759 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 58182.7us
I20260709 13:18:26.500344 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:26.475777 18924 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.505128 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.506260 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.508757 19036 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:26.511132 19036 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:26.511564 19036 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:26.512961 16299 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:26.512550 19036 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.514040 19036 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.517843 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:26.497920 19047 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:26.569800 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 63622.1us
I20260709 13:18:26.570809 15642 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.573997 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1594) took 1352 ms. Trace:
I20260709 13:18:26.574515 15742 rpcz_store.cc:276] 0709 13:18:25.221277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.520698 (+299421us) service_pool.cc:224] Handling call
0709 13:18:25.527569 (+  6871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.529315 (+  1746us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:25.532538 (+  3223us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.698480 (+165942us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.114174 (+415694us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:26.573497 (+459323us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b180009d180. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefe2984bc 00007faefb5e648b 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287
0709 13:18:26.573617 (+   120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.573675 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:26.573729 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.573806 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.573932 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11937,"prepare.queue_time_us":3100,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":5998,"raft.queue_time_us":135877,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":6557,"spinlock_wait_cycles":20879360,"thread_start_us":241444,"threads_started":2,"wal-append.queue_time_us":114519}
I20260709 13:18:26.503082 18981 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.576864 18775 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.577466 18775 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:26.577854 18775 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.578938 18933 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:26.579558 19097 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.581353 15642 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.583793 18875 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:26.584403 18875 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:26.586436 18875 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:26.586764 19107 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.587302 18870 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.586913 18875 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.587230 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 82174.4us
I20260709 13:18:26.589478 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:26.588275 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.590735 16310 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:26.588248 16308 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:26.476814 18693 raft_consensus.cc:476] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:18:26.592439 16304 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:18:26.600557 15676 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:26.603616 16302 raft_consensus.cc:1240] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:26.607372 15747 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:26.607981 15565 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.603616 15593 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:26.611889 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:26.613372 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:26.615538 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.587248 19107 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.603627 18981 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:26.603911 19047 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.628157 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.624668 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:26.604212 19043 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.635776 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:26.638164 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 48751.9us
I20260709 13:18:26.637439 15640 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:26.619262 18768 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.621290 19039 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.652509 16306 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:26.655915 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.623757 19107 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.607826 18875 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.620049 19049 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:18:26.645087 19075 raft_consensus.cc:2764] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:26.669400 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.686079 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.686659 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.661657 18693 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:26.689136 15597 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:26.661502 19033 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.693552 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:26.698679 15594 raft_consensus.cc:2368] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6.
I20260709 13:18:26.694936 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:26.699680 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:26.696465 15595 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:26.700567 15672 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:26.703225 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 62855.3us
I20260709 13:18:26.704246 16263 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.708235 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:26.705109 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 789) took 1466 ms. Trace:
W20260709 13:18:26.716235 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 55364us
I20260709 13:18:26.717803 15642 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.677487 19077 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:26.648114 19047 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.648505 19043 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.661161 18863 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:18:26.721457 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 104212us
I20260709 13:18:26.719429 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.723048 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:26.711495 16295 rpcz_store.cc:276] 0709 13:18:25.229037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.239243 (+ 10206us) service_pool.cc:224] Handling call
0709 13:18:25.256536 (+ 17293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.301664 (+ 45128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.301712 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.301803 (+    91us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:25.301852 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.694785 (+1392933us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5400564fd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:26.694840 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.695009 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92161792}
I20260709 13:18:26.686192 18821 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:26.685832 19001 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.728513 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:26.729732 15747 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:18:26.731738 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.745581 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:26.745942 15597 raft_consensus.cc:2410] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:26.695837 18693 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:26.751246 18693 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:26.744510 15673 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.746517 15748 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:26.740665 19099 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.759490 19099 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:26.760143 19099 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:26.747777 15742 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:18:26.745904 19095 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 13:18:26.750442 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.739655 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:26.764796 15672 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
W20260709 13:18:26.785115 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 152134us
I20260709 13:18:26.710875 19033 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.789981 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:26.791193 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 728) took 1276 ms. Trace:
I20260709 13:18:26.792513 15597 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:26.729164 19075 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:18:26.791618 15751 rpcz_store.cc:276] 0709 13:18:25.515222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.317433 (+802211us) service_pool.cc:224] Handling call
0709 13:18:26.380392 (+ 62959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.396005 (+ 15613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.396036 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.396479 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.612706 (+216227us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:26.612764 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.612860 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.790979 (+178119us) raft_consensus.cc:1685] finished
0709 13:18:26.791001 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.791130 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1898,"raft.queue_time_us":2106,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10494,"thread_start_us":188253,"threads_started":1,"wal-append.queue_time_us":264582}
I20260709 13:18:26.791699 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:26.796947 15744 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:26.784247 19001 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:18:26.803153 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 83824.3us
I20260709 13:18:26.801610 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:26.804239 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:26.788059 18914 consensus_meta.cc:287] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.894s	user 0.012s	sys 0.006s
I20260709 13:18:26.791617 19033 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:26.802248 18981 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.824366 19086 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:26.802944 19111 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.805356 19001 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:26.802804 19095 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:26.805050 19065 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:18:26.805030 19012 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:18:26.819885 19010 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:26.852414 19112 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:18:26.852919 19001 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:26.854579 19001 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:26.814196 19075 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:18:26.810209 18914 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.871186 18914 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.872213 15598 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:18:26.876492 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:26.847628 19012 consensus_queue.cc:1243] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:26.828287 18809 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:18:26.810876 19077 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.846148 19010 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:26.876693 19075 consensus_queue.cc:1243] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:18:26.876394 19103 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:18:26.888587 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.901957 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:26.898782 15673 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:26.887979 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:26.905050 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:26.906445 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:26.908950 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:26.891197 18809 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:26.887578 19110 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.899684 19010 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:26.918903 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:26.906266 15596 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
W20260709 13:18:26.916316 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 95644.6us
I20260709 13:18:26.896956 18875 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:26.926275 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:26.926497 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 117376us
I20260709 13:18:26.904335 19097 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:26.905934 18775 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:18:26.936540 19116 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:18:26.936918 15676 raft_consensus.cc:2393] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:26.939081 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:26.939802 15677 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:26.883279 19122 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:18:26.928823 19047 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.923317 19074 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.943250 19074 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:26.943866 19074 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:26.910039 18870 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.950057 15565 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:26.956621 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.900741 18924 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:26.957939 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:26.962663 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:26.970191 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 239535us
I20260709 13:18:26.970479 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.971235 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:26.981729 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:26.986610 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.996307 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:26.961354 19047 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:26.960923 19086 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.001519 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.002071 16263 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:26.970247 18933 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.003808 16302 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:26.928280 19110 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:27.011199 19102 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.273s	user 0.000s	sys 0.004s
I20260709 13:18:27.014084 19117 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:27.014990 19113 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.015873 19078 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.005148 18809 consensus_queue.cc:1059] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:18:26.994289 19033 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:26.994372 19111 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:26.961470 18870 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.007002 18933 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.005491 19065 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:27.025084 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 217758us
I20260709 13:18:26.994625 18863 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:18:27.031355 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.002138 18875 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:18:27.027129 18346 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.001s
I20260709 13:18:27.022055 19111 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:27.025785 18809 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:27.021615 19033 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.036438 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 49842.1us
I20260709 13:18:27.040166 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.040719 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:27.028357 18933 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.023759 19117 raft_consensus.cc:697] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:27.034835 15640 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:27.018795 19074 consensus_queue.cc:1059] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:18:27.033246 19036 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.029790 19086 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:27.046389 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 47705.7us
I20260709 13:18:27.049245 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.037534 18346 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:27.039561 18775 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.040100 18809 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:27.044296 19033 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.041668 19111 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.032662 19113 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:18:27.059970 15640 leader_election.cc:400] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 5 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6.
I20260709 13:18:27.046150 19047 raft_consensus.cc:697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:27.066718 19134 consensus_queue.cc:1059] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:18:27.067646 19118 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:18:27.068219 19110 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.069504 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.070935 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.054270 19065 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.050567 19036 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.092775 15675 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:27.094091 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.094661 15640 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:27.097940 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:27.098464 15675 raft_consensus.cc:2376] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7. Re-sending same reply.
I20260709 13:18:27.099841 19135 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:27.100889 19036 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.103844 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.105298 19036 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.137611 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.065476 19124 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.060971 19122 consensus_queue.cc:1059] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:27.150148 15675 raft_consensus.cc:2410] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:18:27.158388 19140 raft_consensus.cc:2764] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:18:27.160974 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:27.163285 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:27.164288 15675 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:27.165109 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.165366 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:27.165776 16295 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:27.097556 18775 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:27.154328 19113 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.166157 15675 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.167215 16302 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:27.168040 16263 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.149188 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:27.163293 18346 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:27.173568 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:27.174474 19122 raft_consensus.cc:3055] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:27.175936 19036 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.177481 19047 consensus_queue.cc:237] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:27.179277 19129 log.cc:927] Time spent T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:27.095044 18924 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.136930 19128 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:27.189644 18693 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.146981 19065 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:27.220942 18775 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:27.206673 19107 consensus_meta.cc:287] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.527s	user 0.000s	sys 0.010s
I20260709 13:18:27.223153 19122 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:27.222124 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 73061.8us
I20260709 13:18:27.242462 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:18:27.226142 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 58220.3us
I20260709 13:18:27.226948 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.106191 18875 consensus_queue.cc:1059] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:18:27.226716 19036 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.195495 18809 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.224858 19110 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.052886 19086 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.213205 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.244302 16309 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.248719 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:27.068917 19117 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.233376 18870 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.241465 19113 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.240589 18775 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.266638 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2237) took 2225 ms. Trace:
W20260709 13:18:27.267233 15593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1885) took 1445 ms (client timeout 1740 ms). Trace:
I20260709 13:18:27.227659 18346 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:27.273080 15593 rpcz_store.cc:269] 0709 13:18:25.813052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.813252 (+   200us) service_pool.cc:224] Handling call
0709 13:18:27.258515 (+1445263us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400247f54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:27.258652 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370349952}
I20260709 13:18:27.251346 18865 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:27.279608 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.271865 15746 rpcz_store.cc:276] 0709 13:18:25.032471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.035923 (+  3452us) service_pool.cc:224] Handling call
0709 13:18:25.045206 (+  9283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.603668 (+558462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.257152 (+1653484us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540026b1d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:27.257420 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282879872}
I20260709 13:18:27.252688 19135 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:27.279191 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:27.280851 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.283185 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.284415 16310 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:27.284529 15593 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:27.279851 15567 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.286329 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.287505 15674 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:27.289436 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.292646 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.248880 19107 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.235805 19065 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.282581 18809 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.250944 19130 consensus_queue.cc:1059] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.192s
I20260709 13:18:27.305507 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.305991 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.283690 18870 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.308738 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:27.313205 19043 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.293946 19046 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.288852 18865 raft_consensus.cc:697] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:27.330569 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:27.333055 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 44546us
I20260709 13:18:27.334529 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.337049 15567 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.350256 15674 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:27.353036 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 299149us
I20260709 13:18:27.313659 18693 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.357101 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:27.357929 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:27.296881 19010 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.361814 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:27.374948 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.379419 19137 raft_consensus.cc:3055] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:27.379722 19036 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.379938 19137 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:27.381157 19143 consensus_queue.cc:1059] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:18:27.383100 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:27.361280 19077 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:27.286487 19122 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.360724 19113 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.397558 18933 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:27.401394 19144 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:27.402858 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1949) took 1159 ms. Trace:
I20260709 13:18:27.403617 19033 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.382659 19123 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.405114 19077 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:27.407733 15593 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:18:27.412817 16309 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
W20260709 13:18:27.417168 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 60488.3us
I20260709 13:18:27.405129 19097 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:27.384002 18924 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.364629 18821 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:18:27.429355 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.403196 15670 rpcz_store.cc:276] 0709 13:18:26.243693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.243847 (+   154us) service_pool.cc:224] Handling call
0709 13:18:26.256369 (+ 12522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.256731 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.256759 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.294610 (+ 37851us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.076885 (+782275us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b18002a55c0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1 00007faefe6aba0f
0709 13:18:27.247845 (+170960us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:27.247872 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.247923 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.402559 (+154636us) raft_consensus.cc:1685] finished
0709 13:18:27.402578 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.402795 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2422,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":22873,"spinlock_wait_cycles":69529472,"thread_start_us":170792,"threads_started":1,"wal-append.queue_time_us":981834}
I20260709 13:18:27.409324 19043 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:27.438681 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:27.426914 19097 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.441040 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1886) took 1614 ms. Trace:
I20260709 13:18:27.441445 15601 rpcz_store.cc:276] 0709 13:18:25.826630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.826801 (+   171us) service_pool.cc:224] Handling call
0709 13:18:25.829537 (+  2736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.358164 (+528627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.440807 (+1082643us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540020bf54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:27.440981 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213810048}
I20260709 13:18:27.431242 19122 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.406104 19077 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.434321 19036 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.455238 15675 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:27.455856 19010 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.428948 18865 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.435388 19043 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:27.442286 19097 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.462922 19065 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.463668 19107 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.466702 19043 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.467540 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.470805 16295 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
W20260709 13:18:27.473296 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.456203 18775 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.480964 19145 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:27.481770 19145 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:27.482959 19145 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.469345 19146 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.476275 18693 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:27.428167 19137 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:27.492725 19065 consensus_queue.cc:1175] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7019261981c6431baddd6812c15ac678" responder_term: 7 status { last_received { term: 5 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:27.489252 19107 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:27.495253 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 49669.6us
I20260709 13:18:27.494565 19107 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.496672 16263 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:27.484874 19159 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.503199 19157 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:18:27.512223 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:27.506078 18863 raft_consensus.cc:3055] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:27.500177 19036 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:27.496001 19137 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.495959 19110 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.496778 19033 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.508776 18768 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:27.520485 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 51502.3us
I20260709 13:18:27.522462 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.523491 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.529901 16309 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:27.530552 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:27.527019 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.501561 19086 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.498308 18693 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.518889 18821 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:27.533684 15596 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:27.517066 18863 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:27.535526 15601 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:27.537586 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:27.538255 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:27.521250 19157 raft_consensus.cc:697] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:27.528970 18768 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:27.542021 19157 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.542682 18768 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.543948 18768 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.545295 19130 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.547644 18821 raft_consensus.cc:697] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:27.548591 18821 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.549686 19111 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.551821 19111 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.552214 18863 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.553400 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:27.554030 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.554634 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.555157 19086 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:27.555414 19152 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.555703 18863 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.555677 19086 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.556138 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:27.556762 16295 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:27.557286 16302 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:27.558596 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:27.559120 15750 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:18:27.539395 15599 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:27.555171 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:27.563006 15743 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:27.563524 16306 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:27.540158 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:27.556006 19152 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.568802 15748 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:27.569964 19152 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:27.571632 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.572265 15744 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:27.565151 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.567047 19130 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.572700 19122 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:27.573242 15596 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:27.578369 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.578909 15599 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:27.567018 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.581897 15743 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:27.583149 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:27.589514 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:27.593191 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:27.595729 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.596117 15599 raft_consensus.cc:2376] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6. Re-sending same reply.
I20260709 13:18:27.554055 19107 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.597577 16306 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:27.598784 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.593619 19095 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.610086 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:27.610822 19161 log.cc:927] Time spent T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:18:27.612509 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:27.614596 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:27.610249 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.617216 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 827) took 1143 ms. Trace:
I20260709 13:18:27.629254 15716 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.620302 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:27.620442 19136 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.559s	user 0.000s	sys 0.001s
I20260709 13:18:27.622956 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1963) took 1006 ms. Trace:
I20260709 13:18:27.623515 19086 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:27.629724 16304 rpcz_store.cc:276] 0709 13:18:26.473612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.473745 (+   133us) service_pool.cc:224] Handling call
0709 13:18:26.592240 (+118495us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.592880 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.617007 (+1024127us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400553cd0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:27.617152 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252926720}
I20260709 13:18:27.591579 19130 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:27.625589 19149 raft_consensus.cc:3055] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:27.626085 18775 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:27.626758 19147 log.cc:927] Time spent T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:18:27.626706 19075 raft_consensus.cc:3055] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:27.627470 15672 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:27.592432 19122 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.624481 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.630687 15750 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:27.633026 15596 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.624609 19126 raft_consensus.cc:3055] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:27.632274 15676 rpcz_store.cc:276] 0709 13:18:26.616723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.624323 (+  7600us) service_pool.cc:224] Handling call
0709 13:18:27.622744 (+998421us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54000816d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:27.622874 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":688947072}
I20260709 13:18:27.639314 19095 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.650173 19126 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:27.661067 19126 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.662642 15716 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:27.663643 19162 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:27.664074 19162 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.663825 19043 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.664427 19162 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:27.649499 19145 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:27.650918 15601 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:27.651322 19097 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:27.670423 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.633486 18889 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:27.655037 18346 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.650449 19122 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:27.637643 19149 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:27.664963 15596 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:27.640754 16306 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:27.666049 16265 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.674794 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:27.629197 19012 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:18:27.675725 16304 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:27.678032 15596 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: [5.3-9.5]
I20260709 13:18:27.644503 19075 raft_consensus.cc:740] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:27.680827 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:27.685228 16265 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:27.686036 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:27.697247 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.679324 19122 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.673717 19145 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.706871 19075 consensus_queue.cc:260] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.695294 19033 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:27.708240 19033 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.708628 19033 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:27.700685 19130 consensus_queue.cc:1059] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:18:27.711737 15676 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:27.712201 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:27.717370 19164 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:18:27.671576 19013 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:18:27.695489 19128 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.684245 19112 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:27.698800 19146 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:27.697285 19095 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:27.695677 19111 consensus_queue.cc:1059] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:18:27.740195 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.735867 16304 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:27.695576 18863 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:27.741737 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:27.683701 18346 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:27.758179 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:27.766754 15597 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:18:27.767534 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1894) took 1740 ms. Trace:
I20260709 13:18:27.782346 15600 rpcz_store.cc:276] 0709 13:18:26.033660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.033864 (+   204us) service_pool.cc:224] Handling call
0709 13:18:27.760522 (+1726658us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b54001478d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:27.767438 (+  6916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976526080}
I20260709 13:18:27.772269 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.784547 15600 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: [4.7-8.9]
I20260709 13:18:27.785342 15593 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:27.796043 15595 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:18:27.795118 15600 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:27.798514 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.734380 19146 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.803290 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 50509.2us
I20260709 13:18:27.738121 19095 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.740785 18981 raft_consensus.cc:3055] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:27.811193 15640 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:27.812932 19142 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:27.808712 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1953) took 1216 ms. Trace:
I20260709 13:18:27.813727 15671 rpcz_store.cc:276] 0709 13:18:26.592052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.592221 (+   169us) service_pool.cc:224] Handling call
0709 13:18:26.592497 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.759944 (+167447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.759993 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.760052 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:26.760120 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.808472 (+1048352us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003ae3d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:27.808516 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.808658 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384521088}
W20260709 13:18:27.816479 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.736621 19149 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.807979 18981 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:27.822141 19162 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:27.808094 19168 log.cc:927] Time spent T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:18:27.825649 19111 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:27.826272 19111 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.804207 19146 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.829429 15599 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:27.828790 19047 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.848800 19047 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.813694 19039 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:27.849175 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.849812 19039 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.851049 19047 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.852193 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.853042 15742 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:27.829702 19112 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:27.855528 19097 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.860808 19039 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.861536 19142 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:27.862833 19142 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.805039 19012 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:18:27.832868 19095 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:27.833276 19106 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 1.201s	user 0.004s	sys 0.001s
I20260709 13:18:27.835359 19057 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.875880 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.876504 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.836274 19043 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:27.836422 19169 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:18:27.822796 18981 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.901269 18981 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.901345 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2134) took 1603 ms. Trace:
I20260709 13:18:27.901885 15668 rpcz_store.cc:276] 0709 13:18:26.298192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.298350 (+   158us) service_pool.cc:224] Handling call
0709 13:18:26.298672 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.415931 (+117259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.422338 (+  6407us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.426506 (+  4168us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.622791 (+196285us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:26.622835 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.622896 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.832569 (+1209673us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:27.900921 (+ 68352us) raft_consensus.cc:1685] finished
0709 13:18:27.900951 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.901270 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7612,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":12261120,"thread_start_us":267206,"threads_started":2,"wal-append.queue_time_us":193989}
I20260709 13:18:27.903157 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.841339 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:27.904856 15750 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.905697 19145 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.843744 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.846997 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:27.909219 18775 consensus_queue.cc:1175] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "558532223b984cf796cb6b98ddd6c9f2" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:27.870491 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:27.904845 19111 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.898039 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.912021 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.897066 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:27.914783 15750 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:27.912547 15751 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:27.877684 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:27.896967 19170 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.874810 19010 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:27.930966 15745 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:27.868705 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.828351 19126 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.915921 19122 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.920217 15748 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.928342 15747 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:27.930635 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:27.898015 19057 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:27.824538 19162 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:27.875391 18821 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:18:27.935993 15567 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:27.934484 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 162299us
I20260709 13:18:27.916043 19033 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.938944 15640 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:27.919687 19095 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:27.942005 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:27.942533 15567 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.931238 19010 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:27.933804 19111 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:27.946149 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:27.946586 15743 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:27.947393 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:27.955094 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:27.956858 18935 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:27.957778 19119 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:27.960780 19113 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:27.961638 19128 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:27.962073 19128 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:27.962285 19113 raft_consensus.cc:3055] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:27.962669 19113 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:27.962965 19128 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.963485 19113 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:27.963778 19057 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:27.939659 19039 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:27.972476 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:27.992367 16306 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:18:27.962313 19033 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:27.965309 18863 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:27.996441 18863 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:27.997509 18863 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:28.000000 19153 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.596s	user 0.000s	sys 0.003s
I20260709 13:18:27.947232 19145 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:27.948236 19112 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.009732 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:27.964512 19128 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:28.013796 15749 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:27.947793 18346 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:27.969895 19111 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.025091 19099 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:28.025573 19099 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:28.026501 19099 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.027319 19122 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.027972 19099 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:27.966595 18775 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:27.936699 19170 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.001291 19113 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.948339 19095 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:28.027993 19148 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.644s	user 0.000s	sys 0.002s
W20260709 13:18:28.036934 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 81508.7us
I20260709 13:18:28.009466 19145 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.029906 18346 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.040882 18346 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:28.047298 19075 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:28.039911 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:28.102416 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.115410 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 75601.7us
I20260709 13:18:28.116515 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:28.118077 15567 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:28.121428 19033 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.122232 19033 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.133908 15749 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:28.135653 15567 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:28.141436 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.255685 19077 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:28.256335 19077 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.256814 19077 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:27.964792 19010 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.013803 19039 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.151374 18935 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:28.137421 18914 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.049945 19145 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:28.138175 18821 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:28.225724 19170 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:28.230170 19095 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:28.260880 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 125327us
I20260709 13:18:28.266665 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.033914 18775 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.264278 19033 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.277333 19039 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.285590 18935 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:28.292951 19010 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:28.309278 15601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.027s	sys 0.102s
W20260709 13:18:28.309721 15601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.027s	sys 0.102s
I20260709 13:18:28.274906 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.034183 19146 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:28.323359 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.323786 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.325416 16306 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
W20260709 13:18:28.355345 16264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.050s	sys 0.086s
W20260709 13:18:28.355775 16264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.050s	sys 0.086s
I20260709 13:18:28.303812 18865 consensus_queue.cc:1059] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:18:28.306339 18821 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:18:28.327433 19126 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.331456 19113 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.369699 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:28.418243 19178 log.cc:927] Time spent T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.599s	user 0.001s	sys 0.012s
W20260709 13:18:28.418689 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.459662 19194 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:18:28.419790 19039 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.419631 15749 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:28.422268 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:28.428387 15748 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:28.429075 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:28.374012 19172 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.525s	user 0.010s	sys 0.002s
I20260709 13:18:28.476209 15746 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:28.308990 18914 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:18:28.435497 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:28.436800 18935 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.437288 19057 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:28.440359 15747 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:18:28.443073 19146 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.366431 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:28.451414 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.419567 18693 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:28.466279 19173 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.621s	user 0.011s	sys 0.000s
I20260709 13:18:28.473131 19113 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.491989 15747 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:18:28.489075 15596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.075s	sys 0.108s
I20260709 13:18:28.493199 15744 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
W20260709 13:18:28.485483 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 50060.8us
I20260709 13:18:28.494868 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:28.493942 15596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.075s	sys 0.108s
I20260709 13:18:28.505766 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:28.505951 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.506804 15749 raft_consensus.cc:2393] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:28.508294 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.510448 18346 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.517057 15748 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:18:28.519073 18346 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.519817 18346 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.520370 18346 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:28.476995 19117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.007s	sys 0.027s
W20260709 13:18:28.504882 19154 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.062s	user 0.002s	sys 0.048s
I20260709 13:18:28.474323 19126 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.523844 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:28.527117 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:28.493062 19124 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:28.509428 18693 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.526113 19117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.007s	sys 0.027s
I20260709 13:18:28.530365 18346 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.523342 19056 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:28.530254 15642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.015s	sys 0.035s
W20260709 13:18:28.538596 15642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.015s	sys 0.035s
I20260709 13:18:28.527281 19057 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:28.484166 19077 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:28.545790 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.478638 19039 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.531284 19123 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:28.533886 19107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.087s	sys 0.284s
I20260709 13:18:28.557849 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:28.558756 16309 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
W20260709 13:18:28.561838 19191 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:18:28.564277 19192 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:28.570981 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1912) took 1012 ms. Trace:
I20260709 13:18:28.571450 15596 rpcz_store.cc:276] 0709 13:18:27.558896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.683207 (+124311us) service_pool.cc:224] Handling call
0709 13:18:27.706517 (+ 23310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:27.747380 (+ 40863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.747418 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:27.753842 (+  6424us) log.cc:844] Serialized 52 byte log entry
0709 13:18:28.497063 (+743221us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:28.528146 (+ 31083us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.530504 (+  2358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.530648 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.570720 (+ 40072us) raft_consensus.cc:1685] finished
0709 13:18:28.570742 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.570913 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28064,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":2612,"raft.queue_time_us":22106,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8437,"spinlock_wait_cycles":18540800,"thread_start_us":742727,"threads_started":1,"wal-append.queue_time_us":814690}
W20260709 13:18:28.540031 19130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.005s	sys 0.039s
W20260709 13:18:28.573518 19130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.005s	sys 0.040s
W20260709 13:18:28.557446 19107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.087s	sys 0.285s
I20260709 13:18:28.581136 18914 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.581420 19113 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:28.532635 18875 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:18:28.581687 18914 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.582186 19126 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.583820 18914 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.534843 19108 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.591678 15746 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:28.586956 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.594671 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.613884 15744 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:28.601583 15749 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:18:28.615876 19130 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.584388 18914 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.616400 19130 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.616863 18914 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.617726 19010 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:28.618723 19130 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:28.619424 18914 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:28.620057 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:28.620428 19120 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:28.601389 19117 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.621009 19120 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.621372 19117 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.623071 19120 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:28.625155 19120 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.584787 19145 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:28.625880 19075 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.578s	user 0.012s	sys 0.003s
I20260709 13:18:28.535960 18693 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.625654 19120 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.627022 15748 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:28.627440 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:28.639539 15673 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
W20260709 13:18:28.539157 19154 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.002s	sys 0.049s
I20260709 13:18:28.620683 15742 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:28.641924 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.642714 15599 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:28.550920 19134 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:28.647408 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.647639 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.554951 18775 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:28.560086 19190 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.648284 15595 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:28.649358 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:28.658088 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.660001 15598 raft_consensus.cc:1240] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:28.661999 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:28.626426 19117 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.664496 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.633088 19130 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:28.669399 15594 raft_consensus.cc:2368] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9.
I20260709 13:18:28.667725 15595 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:28.670265 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.640710 19001 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:28.666165 19182 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.671245 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:28.673919 16306 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.676959 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:28.670213 19033 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:18:28.680904 19033 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:28.681102 19184 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:18:28.681409 19033 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.682278 19120 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:28.682750 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1910) took 1133 ms. Trace:
I20260709 13:18:28.683377 19077 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.685096 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.686542 16304 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:28.688517 16306 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:18:28.683120 15601 rpcz_store.cc:276] 0709 13:18:27.549495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.672677 (+123182us) service_pool.cc:224] Handling call
0709 13:18:27.673158 (+   481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:27.702916 (+ 29758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.702951 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:27.710744 (+  7793us) log.cc:844] Serialized 52 byte log entry
0709 13:18:28.310162 (+599418us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:28.330852 (+ 20690us) log.cc:844] Serialized 14 byte log entry
0709 13:18:28.536816 (+205964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.536923 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.682516 (+145593us) raft_consensus.cc:1685] finished
0709 13:18:28.682547 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.682694 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20493,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":218286,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":10007,"thread_start_us":770347,"threads_started":2,"wal-append.queue_time_us":792142}
I20260709 13:18:28.638177 19108 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:28.662002 19134 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.673049 19146 consensus_queue.cc:1059] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:18:28.925338 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:28.923944 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:28.768579 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:28.772507 15742 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:28.931756 18346 raft_consensus.cc:3055] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:28.937548 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.925773 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:28.923547 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:28.766600 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.945695 15672 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:28.945122 18346 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:28.923072 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:28.741335 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.921089 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:28.947057 18346 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.947815 15668 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:28.948374 15640 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:28.946954 15675 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:28.923789 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1663) took 1827 ms. Trace:
I20260709 13:18:28.951473 15597 rpcz_store.cc:276] 0709 13:18:27.096463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.096644 (+   181us) service_pool.cc:224] Handling call
0709 13:18:27.766323 (+669679us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:27.781725 (+ 15402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.923533 (+1141808us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54001478d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:28.923713 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539038592}
I20260709 13:18:28.945084 15593 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.953076 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.953886 15597 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:28.758967 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:28.684466 18693 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:28.945899 15674 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:28.673332 19185 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:28.944800 15677 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:29.007792 15671 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:18:28.976363 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:28.787446 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:28.895217 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.022461 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 79075.9us
I20260709 13:18:28.683379 19033 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:28.910451 15496 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:29.031322 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:29.025710 18346 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.030297 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:29.032944 15598 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:29.033056 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 56813.5us
W20260709 13:18:29.027380 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.924839 19150 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.510s	user 0.008s	sys 0.004s
W20260709 13:18:28.917594 19181 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:28.752354 19157 raft_consensus.cc:3055] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:28.674767 19130 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:28.692281 19057 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:28.702574 19190 raft_consensus.cc:3055] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:29.039937 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.927764 19145 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.011500 19149 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.096450 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:28.703157 19099 consensus_meta.cc:287] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.004s
I20260709 13:18:28.937134 18851 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:29.008167 19123 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.099598 15640 leader_election.cc:400] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9.
I20260709 13:18:29.035171 19117 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.100226 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:28.973809 19124 raft_consensus.cc:697] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:28.987624 18875 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:28.919570 18933 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.107824 15593 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:18:29.099423 19157 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:29.034914 19198 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:18:29.034991 18775 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.151870 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.120935 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:29.122987 15596 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:29.025161 19189 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:29.039410 18693 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:29.125990 15640 leader_election.cc:403] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:28.933715 19039 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.039635 19120 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:29.120121 18935 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.024s	sys 0.025s
I20260709 13:18:29.099982 19146 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:29.143311 19196 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.112350 19179 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:28.688546 19182 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.085801 19075 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:18:29.110069 19190 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:29.150619 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:28.685693 19001 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.153316 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:29.165560 15567 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.022s	sys 0.038s
I20260709 13:18:29.144273 18851 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:29.164296 15598 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
W20260709 13:18:29.155500 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.014s	sys 0.024s
W20260709 13:18:29.194217 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.015s	sys 0.024s
I20260709 13:18:29.145364 19099 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.097286 15600 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
W20260709 13:18:29.197801 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 409075us
I20260709 13:18:29.197863 15600 raft_consensus.cc:606] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:29.185155 15599 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:29.191645 15567 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.023s	sys 0.038s
W20260709 13:18:29.199162 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 598841us
I20260709 13:18:29.164026 19189 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:29.167855 18935 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.024s	sys 0.025s
W20260709 13:18:29.194494 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 659448us
I20260709 13:18:29.196004 15602 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 549) took 2123 ms. Trace:
I20260709 13:18:29.166102 18693 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.164935 19145 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:29.165659 18775 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.213769 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:29.215019 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:29.196904 19134 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.207921 15602 rpcz_store.cc:276] 0709 13:18:27.072580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.072738 (+   158us) service_pool.cc:224] Handling call
0709 13:18:27.097213 (+ 24475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:27.104873 (+  7660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:27.104904 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:27.105438 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:18:27.288017 (+182579us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:27.288060 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.288135 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.924087 (+1635952us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:29.167301 (+243214us) raft_consensus.cc:1685] finished
0709 13:18:29.167332 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.195911 (+ 28579us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32595,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":38779,"spinlock_wait_cycles":27869056,"thread_start_us":181922,"threads_started":1,"wal-append.queue_time_us":253784}
I20260709 13:18:29.219208 15716 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:29.222599 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:29.184312 19120 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.201892 19198 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.202461 15567 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:29.148109 19117 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.182883 19075 consensus_queue.cc:1243] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:18:29.145278 19123 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.191404 18875 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.189565 19196 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.174938 19146 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.206254 19189 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.144001 19135 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.227053 18346 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:29.209950 18693 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.223800 19057 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:29.225814 19134 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.294756 15597 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.225361 19056 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:29.227026 15567 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:29.202018 19099 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.232982 18935 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:29.224066 19203 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:29.280016 15549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 48004.7us
I20260709 13:18:29.300906 18346 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:29.217283 19145 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:29.303264 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 76306us
I20260709 13:18:29.312280 18346 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.287858 19146 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:29.291793 19135 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:29.307657 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 276452us
I20260709 13:18:29.315992 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:29.328521 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 376974us
I20260709 13:18:29.328814 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:29.318676 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.321412 18346 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.212664 19157 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.335070 15668 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.224215 19190 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.224092 19124 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.233207 19198 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.338894 15745 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:29.285876 18875 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.340478 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:29.341084 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.372149 15748 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.372360 15673 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:29.341156 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.373502 15742 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:29.312348 18935 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.347008 16295 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:29.347987 15670 raft_consensus.cc:1240] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:29.350904 15594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
W20260709 13:18:29.351234 19213 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:18:29.351987 19200 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:18:29.387872 15668 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:29.347546 19220 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:29.340337 19205 consensus_queue.cc:1059] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:18:29.357127 19108 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.401613 19099 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.402390 19099 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.402951 19099 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.309891 19201 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:29.404206 19201 raft_consensus.cc:697] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:29.405926 19198 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.405577 19201 consensus_queue.cc:237] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.360189 16302 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:18:29.333307 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 110664us
W20260709 13:18:29.361544 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 139004us
I20260709 13:18:29.303779 19134 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.362118 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:29.363618 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:29.364698 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 279358us
I20260709 13:18:29.345952 19130 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.379499 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.381932 19157 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:29.382720 19210 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:18:29.383477 19207 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:29.292196 18851 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.397680 15675 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:29.400010 19220 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.341981 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.380658 18935 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.363206 19222 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.556247 15673 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:29.452776 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1612) took 1031 ms. Trace:
I20260709 13:18:29.384519 19202 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:29.420182 18768 raft_consensus.cc:3055] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:29.381582 19075 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.413512 19218 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:29.570833 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.396564 19001 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.450515 19205 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:29.393462 19145 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.473544 15748 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:29.563359 15751 rpcz_store.cc:276] 0709 13:18:28.421579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.424701 (+  3122us) service_pool.cc:224] Handling call
0709 13:18:28.425094 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.425529 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.425570 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.426129 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.763447 (+337318us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:28.763500 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.763596 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.452543 (+688947us) raft_consensus.cc:1685] finished
0709 13:18:29.452564 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.452713 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1358,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":336813,"threads_started":1,"wal-append.queue_time_us":768989}
W20260709 13:18:29.557893 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 207993us
W20260709 13:18:29.479427 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.558921 15676 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:29.380030 19190 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.559463 18775 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.561269 19182 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:29.596874 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.597859 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:29.413683 18875 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:29.422353 19117 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.574261 19130 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.610936 19039 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.572371 18821 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.623106 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 170562us
I20260709 13:18:29.594147 19205 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:29.596306 19056 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:29.595129 19218 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.570195 18768 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:29.639997 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.598889 19001 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.644248 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:29.611423 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:29.644853 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.609022 19185 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.000s	sys 0.015s
W20260709 13:18:29.645247 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.646143 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:29.658370 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 47051.5us
I20260709 13:18:29.658715 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2280) took 1066 ms. Trace:
I20260709 13:18:29.601135 19145 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.644510 19099 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.642522 19123 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.635116 18775 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:18:29.664258 18775 consensus_queue.cc:1243] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:29.664817 18775 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:29.664935 18768 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.665602 18775 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:29.665987 18768 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.666265 19039 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:29.667315 19001 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.667749 19203 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:29.668494 15746 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:29.668691 15673 raft_consensus.cc:2393] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:29.669587 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.670245 15673 raft_consensus.cc:2393] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:29.670940 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:29.671388 15673 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:29.671819 19182 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.672366 19182 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.673058 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.673975 16305 raft_consensus.cc:2410] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:18:29.674927 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.675187 19182 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.675684 16306 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:29.675755 19182 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.676780 19036 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.677738 18863 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.678260 18863 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.680763 19196 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.681203 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.681828 16304 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:29.681958 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:29.682924 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.684103 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.684196 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.685220 16310 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:29.687283 19039 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.687601 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.687804 19039 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.688534 15673 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:29.659216 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:29.689633 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.690444 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.692392 19001 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.693257 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.693831 16304 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:29.665989 18775 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:29.695670 19134 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.695363 18775 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.698561 19039 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:29.708132 19039 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:29.708652 19039 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.709074 19039 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.709843 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.680497 18863 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:29.593405 19075 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.677349 19036 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.651697 18821 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.704217 19215 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:29.704713 19214 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.705998 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.698661 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:29.701498 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:29.706001 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.700300 18851 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.651548 19227 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:29.659200 15747 rpcz_store.cc:276] 0709 13:18:28.592067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.592205 (+   138us) service_pool.cc:224] Handling call
0709 13:18:28.592591 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.619339 (+ 26748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.619372 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.619875 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.013003 (+393128us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:29.013042 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.013119 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.658432 (+645313us) raft_consensus.cc:1685] finished
0709 13:18:29.658461 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.658642 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17442,"raft.queue_time_us":301310,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":392786,"threads_started":1,"wal-append.queue_time_us":656487}
I20260709 13:18:29.712929 18863 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:29.739719 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.740325 15642 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:29.764400 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:29.676041 19013 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:29.770201 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 810) took 1100 ms. Trace:
W20260709 13:18:29.771086 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 72556us
I20260709 13:18:29.770710 15670 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:29.658007 15676 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
W20260709 13:18:29.657205 19185 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.016s
I20260709 13:18:29.655424 19218 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:29.773167 19229 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.100s	user 0.000s	sys 0.002s
I20260709 13:18:29.763679 19134 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.645555 19130 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.798467 19013 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:29.798735 16309 rpcz_store.cc:276] 0709 13:18:28.669459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.669673 (+   214us) service_pool.cc:224] Handling call
0709 13:18:28.677820 (+  8147us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:28.678189 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.678215 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:28.678740 (+   525us) log.cc:844] Serialized 52 byte log entry
0709 13:18:29.023217 (+344477us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:29.307277 (+284060us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.309159 (+  1882us) log.cc:844] Serialized 14 byte log entry
0709 13:18:29.311572 (+  2413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.311674 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.711994 (+400320us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b180010edc0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:29.769865 (+ 57871us) raft_consensus.cc:1685] finished
0709 13:18:29.769905 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.770127 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197808,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":2813,"raft.queue_time_us":5189,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":5281,"spinlock_wait_cycles":4576512,"thread_start_us":564119,"threads_started":2,"wal-append.queue_time_us":613581}
I20260709 13:18:29.803699 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.775405 18775 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:29.814544 15671 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:29.766781 19235 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.676383 19182 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.781375 19121 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:29.802007 19111 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.770287 19215 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:29.676110 19189 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.831403 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.831748 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.714049 19074 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.796743 19142 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:29.801157 19001 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:29.833262 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.839382 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.748625 19145 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.863547 15594 raft_consensus.cc:606] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:29.799050 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 58807.8us
I20260709 13:18:29.865398 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:29.840682 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:29.841413 15597 consensus_meta.cc:287] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.005s
I20260709 13:18:29.842940 15675 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:29.866765 15597 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:29.802395 19185 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:29.832149 19036 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.849717 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:29.866770 15751 raft_consensus.cc:2376] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9. Re-sending same reply.
I20260709 13:18:29.849237 15567 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:29.854288 15742 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:18:29.854779 15747 raft_consensus.cc:2393] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:29.787012 19214 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.871320 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:29.796412 19227 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.826378 19237 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:29.853188 19215 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.878005 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:29.883160 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.883983 15567 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:29.853971 19111 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:29.888283 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 198597us
W20260709 13:18:29.893482 15743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 754) took 1412 ms (client timeout 1811 ms). Trace:
I20260709 13:18:29.866122 19121 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:29.880285 19149 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.748s	user 0.013s	sys 0.000s
I20260709 13:18:29.823624 19134 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.836486 19146 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.937987 16263 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:29.951987 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 68104.2us
I20260709 13:18:29.896591 16310 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:29.952697 16263 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:29.846812 19235 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.931584 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.931638 18914 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:18:29.955233 19235 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:29.956199 19075 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:29.955238 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.956758 19097 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:29.957638 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:29.957496 19121 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.958684 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.880686 19201 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:29.881450 19223 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:29.948114 15669 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
W20260709 13:18:29.943725 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52504.4us
I20260709 13:18:29.828650 19013 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.895922 15673 raft_consensus.cc:2410] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:18:29.857708 19074 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.942397 19220 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:29.938272 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 756) took 1182 ms. Trace:
I20260709 13:18:29.822721 19205 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:29.970074 16295 raft_consensus.cc:2393] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:29.937253 15743 rpcz_store.cc:269] 0709 13:18:28.471331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.478887 (+  7556us) service_pool.cc:224] Handling call
0709 13:18:29.883278 (+1404391us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001d24d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:29.883415 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2619809664}
I20260709 13:18:29.887564 19036 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:18:29.888505 19230 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:29.931552 19240 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.863463 19142 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.968299 15749 rpcz_store.cc:276] 0709 13:18:28.756370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.756567 (+   197us) service_pool.cc:224] Handling call
0709 13:18:28.787499 (+ 30932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.276239 (+488740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.276274 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.293487 (+ 17213us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.595527 (+302040us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:29.595565 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.595642 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:29.933346 (+337704us) raft_consensus.cc:1685] finished
0709 13:18:29.933367 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:29.938187 (+  4820us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117886,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":268,"thread_start_us":659046,"threads_started":2,"wal-append.queue_time_us":357421}
I20260709 13:18:29.965675 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:29.933421 19238 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:29.962417 19201 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.892666 19237 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.976723 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.937629 19225 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:29.964421 19001 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.985296 19183 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:29.985745 19183 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:29.986092 19183 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.964920 19097 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:29.992897 15748 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:29.988943 18933 raft_consensus.cc:3055] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:29.974278 19013 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:29.966207 19223 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:29.952649 19111 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:29.993870 15673 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:30.057035 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.070082 15746 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:29.952786 19056 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.016095 15677 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:29.997953 18933 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:30.027769 19039 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:30.028815 19204 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.715s	user 0.004s	sys 0.000s
I20260709 13:18:30.029525 19214 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:30.093539 19039 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:30.095332 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:30.095474 19142 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.096035 16306 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:30.096272 15673 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:18:30.096657 15673 pending_rounds.cc:85] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 3
I20260709 13:18:30.096871 15673 pending_rounds.cc:107] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:30.097110 15673 raft_consensus.cc:2889] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.098512 15673 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:30.099210 15642 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:29.975565 19230 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:30.100932 19230 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.101739 19234 raft_consensus.cc:993] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:18:30.102257 19234 raft_consensus.cc:1081] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:18:30.031965 15672 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:30.035243 15674 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:30.038578 19227 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.040987 19130 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.040477 15496 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.041528 18821 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.041599 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.042325 19182 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.043191 19189 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.044121 19145 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.045514 19074 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:30.047145 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.122011 15677 raft_consensus.cc:2410] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:18:30.047879 16304 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:30.025051 19223 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.025844 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.050457 15676 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:29.981803 19238 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.052561 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:30.129887 15747 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:30.130674 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.055699 15669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1969) took 2328 ms (client timeout 2072 ms). Trace:
I20260709 13:18:29.939540 19185 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.063812 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:30.004088 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.007370 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.142932 15743 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:30.069865 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:30.142930 15565 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.503s (SENT) [suppressed 18 similar messages]
I20260709 13:18:30.070502 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.980939 19205 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:30.070938 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:29.994846 19201 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:30.040352 19237 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:30.079900 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:30.077724 19108 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:18:29.972658 19075 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:30.071461 19126 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.167747 15747 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:29.999008 19001 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.078619 19222 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9.
W20260709 13:18:30.090389 18693 consensus_meta.cc:287] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.787s	user 0.006s	sys 0.005s
I20260709 13:18:30.072165 19246 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:30.207587 19246 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.200225 19237 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.208091 19246 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.208379 19237 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.210613 19237 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:30.078378 19135 consensus_meta.cc:287] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.005s
I20260709 13:18:30.212010 19135 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.214450 19135 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.117671 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.215229 19215 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.215711 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.216841 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:30.217834 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:30.118984 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.219584 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:30.220139 15744 raft_consensus.cc:2376] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8. Re-sending same reply.
I20260709 13:18:30.220934 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:30.131134 15669 rpcz_store.cc:269] 0709 13:18:27.727133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.727230 (+    97us) service_pool.cc:224] Handling call
0709 13:18:30.055493 (+2328263us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b54001a6b54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:30.055620 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5063382272}
I20260709 13:18:30.225426 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:30.226661 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:30.062616 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:30.227460 16309 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
W20260709 13:18:30.131844 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 271753us
I20260709 13:18:30.148152 19234 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:30.130228 15640 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:30.145814 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.000108 19225 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.147001 15746 raft_consensus.cc:2410] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:30.149125 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.246819 15749 raft_consensus.cc:2410] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:18:30.150894 15742 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:30.247879 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.071727 19110 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.189062 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:29.990943 19240 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.190953 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.194653 15751 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:30.197157 15747 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:30.129549 19220 raft_consensus.cc:2764] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:30.200109 15743 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:30.140961 19238 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.206333 18346 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.218560 15672 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:30.096276 19142 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.231725 16302 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:30.231832 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.232532 15676 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:30.200615 19126 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.244822 15744 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
W20260709 13:18:30.162439 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 209880us
I20260709 13:18:30.200103 19097 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:30.207625 19242 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:18:30.299300 15674 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:18:30.506975 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 364046us
I20260709 13:18:30.641034 15748 raft_consensus.cc:2393] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:30.604725 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.642180 18346 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.276510 15668 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:30.259472 15742 raft_consensus.cc:2393] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:30.347328 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 95239.3us
W20260709 13:18:30.325788 18935 consensus_meta.cc:287] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.000s
I20260709 13:18:30.648051 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:30.647547 18935 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.294236 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:30.648875 16306 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
W20260709 13:18:30.641228 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.650576 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:30.297925 19221 log.cc:927] Time spent T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:18:30.651403 16302 raft_consensus.cc:2393] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:30.651559 15565 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:30.649744 15673 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
W20260709 13:18:30.262099 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 131954us
W20260709 13:18:30.659323 16263 connection.cc:256] RPC call timeout handler was delayed by -1.0234969760001604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260709 13:18:30.327904 19250 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:18:30.280090 15669 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:30.661958 15565 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:30.667209 18346 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:30.310117 15497 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46324 (request call id 314) took 14382 ms (client timeout 15000 ms). Trace:
I20260709 13:18:30.640268 15674 pending_rounds.cc:85] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 4
I20260709 13:18:30.669554 15674 pending_rounds.cc:107] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:30.339107 19001 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.297991 19222 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:30.667217 19121 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:30.667511 19142 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.292026 19120 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.315016 18933 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:30.654326 19110 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.236450 18693 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.642570 19245 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:30.601209 19077 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.296860 19108 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:30.677175 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.680512 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:30.681120 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.710570 15743 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:30.677440 18346 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.759191 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.760097 15743 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:30.773340 15671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.027s	sys 0.022s
I20260709 13:18:30.762394 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:30.299095 19247 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.692979 19183 consensus_meta.cc:287] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.004s
I20260709 13:18:30.788065 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.669915 15674 raft_consensus.cc:2889] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.310791 15496 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 5, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:18:30.785684 15671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.030s	sys 0.022s
W20260709 13:18:30.340044 19243 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:18:30.699954 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.800047 15747 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:30.290568 19225 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.682612 19120 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.545360 19249 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.683928 19205 consensus_meta.cc:287] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.000s
W20260709 13:18:30.676575 19218 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.000s
I20260709 13:18:30.796085 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 2170) took 1437 ms. Trace:
I20260709 13:18:30.330751 19230 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.827150 15668 rpcz_store.cc:276] 0709 13:18:29.355095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.681736 (+326641us) service_pool.cc:224] Handling call
0709 13:18:30.792364 (+1110628us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400364a54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:30.792533 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296276864}
I20260709 13:18:30.685840 19110 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.796892 15743 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:30.828429 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:30.829432 15749 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:30.506595 19228 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.840251 19202 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.668695 15497 rpcz_store.cc:269] 0709 13:18:15.927485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.927656 (+   171us) service_pool.cc:224] Handling call
0709 13:18:30.309995 (+14382339us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:24.996035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:25.228528 (+232493us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:25.243591 (+ 15063us) write_op.cc:435] Acquired schema lock
0709 13:18:25.251990 (+  8399us) tablet.cc:662] Decoding operations
0709 13:18:25.257979 (+  5989us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:25.258072 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:25.258098 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:18:25.259409 (+  1311us) tablet.cc:701] Row locks acquired
0709 13:18:25.259459 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:18:25.259646 (+   187us) write_op.cc:270] Start()
0709 13:18:25.259802 (+   156us) write_op.cc:276] Timestamp: P: 1783603105259563 usec, L: 0
0709 13:18:25.259824 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:25.489023 (+229199us) log.cc:844] Serialized 4749 byte log entry
0709 13:18:26.326211 (+837188us) op_driver.cc:464] REPLICATION: finished
0709 13:18:26.484629 (+158418us) write_op.cc:301] APPLY: starting
0709 13:18:26.484744 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:26.485137 (+   393us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:26.485284 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:26.487109 (+  1825us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:26.487597 (+   488us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:18:26.487669 (+    72us) write_op.cc:312] APPLY: finished
0709 13:18:26.488226 (+   557us) log.cc:844] Serialized 89 byte log entry
0709 13:18:26.489462 (+  1236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.489658 (+   196us) write_op.cc:454] Released schema lock
0709 13:18:26.489769 (+   111us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:26.510491 (+ 20722us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ebe28 00007faf02126581 00007faf02125d58 00007faf0212a9f1 00007faf0212a9a9 00007faf0212a939 00007faf0212a901 00007faf02129b2d 000000000038f354 000000000038f199
0709 13:18:26.510758 (+   267us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:26.510785 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91384,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":158081,"apply.run_cpu_time_us":4720,"apply.run_wall_time_us":8548,"num_ops":12,"prepare.queue_time_us":126709,"prepare.run_cpu_time_us":36876,"prepare.run_wall_time_us":1541807,"raft.queue_time_us":294529,"raft.run_cpu_time_us":33131,"raft.run_wall_time_us":158475,"replication_time_us":1066212,"spinlock_wait_cycles":44497536,"thread_start_us":456237,"threads_started":4,"wal-append.queue_time_us":352572,"wal-append.run_cpu_time_us":8314,"wal-append.run_wall_time_us":1603250}]]}
I20260709 13:18:30.840889 19202 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.845057 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.326306 19146 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.332465 19111 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.683636 19142 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.624051 19215 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:30.692284 19223 consensus_meta.cc:287] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.001s
I20260709 13:18:30.699489 19240 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.858610 19142 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.692617 19121 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:30.859277 19142 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.761619 19233 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:30.854947 19220 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.861259 19220 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.863724 19223 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.697863 19077 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.864763 15670 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:30.802675 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2279) took 2211 ms. Trace:
I20260709 13:18:30.866483 19223 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.355327 19237 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.789317 15744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:18:30.809635 15751 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:30.809922 15746 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:30.866127 15750 rpcz_store.cc:276] 0709 13:18:28.591055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.591208 (+   153us) service_pool.cc:224] Handling call
0709 13:18:28.601348 (+ 10140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.097809 (+496461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.097843 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.110024 (+ 12181us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.480206 (+370182us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:29.480262 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.480363 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.802408 (+1322045us) raft_consensus.cc:1685] finished
0709 13:18:30.802431 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.802614 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":69671,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":15017,"spinlock_wait_cycles":16384,"thread_start_us":809952,"threads_started":2,"wal-append.queue_time_us":682542}
I20260709 13:18:30.885912 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:30.812196 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 1984) took 1108 ms. Trace:
I20260709 13:18:30.829826 19222 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:30.695631 19245 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.832563 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.828958 15496 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 4, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 4 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.850267 18693 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.837502 19225 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.826814 19206 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.838665 18935 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.839828 19205 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:30.810108 19246 consensus_meta.cc:287] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.005s
I20260709 13:18:30.292732 19047 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.529s
I20260709 13:18:30.848560 15745 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:30.850291 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.698172 19108 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.680436 19201 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.840731 19218 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.858425 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.860484 19233 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:30.831255 19249 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.705565 18933 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:30.260154 19234 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.846596 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:30.876859 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2154) took 1553 ms. Trace:
I20260709 13:18:30.840588 19228 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.819239 18346 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:30.847177 19134 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.847965 19001 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.870031 19232 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.024s	sys 0.033s
W20260709 13:18:30.938333 19232 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.025s	sys 0.034s
I20260709 13:18:30.866990 19077 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.836707 19110 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:30.799356 19183 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.848555 19056 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:30.797467 19247 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.894289 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.895077 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.850930 19075 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:30.946282 15748 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:30.946688 15746 raft_consensus.cc:2410] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:18:30.897477 15496 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 7, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 7 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.946456 19075 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.947453 19247 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:30.948001 15496 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 6, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 6 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:30.899403 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:30.950034 15750 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:30.830281 19120 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.864413 19220 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.903118 15743 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:30.867539 15675 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:30.917191 16309 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:30.893024 19111 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:30.905725 19206 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.889477 19146 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.922856 15670 rpcz_store.cc:276] 0709 13:18:29.323630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.881667 (+558037us) service_pool.cc:224] Handling call
0709 13:18:29.937697 (+ 56030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.865179 (+927482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.874303 (+  9124us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54003007d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:30.876746 (+  2443us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113634176}
I20260709 13:18:30.887482 15676 rpcz_store.cc:276] 0709 13:18:29.703440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.126393 (+422953us) service_pool.cc:224] Handling call
0709 13:18:30.160868 (+ 34475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.641823 (+480955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:30.811889 (+170066us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400363154. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:30.812131 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164282112}
W20260709 13:18:30.926338 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 79874.9us
I20260709 13:18:30.967337 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:30.890929 19237 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:30.928197 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.931849 19001 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.933053 19142 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:30.936843 19126 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.976248 19013 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:30.976758 19013 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:30.977619 19013 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.978907 19013 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:30.981292 19255 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:30.982899 19234 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.988497 19201 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.908392 19246 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.922457 19202 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:30.937798 18693 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:30.918774 19233 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:30.905220 19222 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.943444 19249 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.943790 16308 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:30.944808 19183 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.944979 19228 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:30.945324 19056 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:30.903756 19225 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:30.901417 19215 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.973505 19146 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.001214 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2155) took 1671 ms. Trace:
I20260709 13:18:31.005748 15496 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 5, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:31.007158 16310 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:30.992035 19220 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.017254 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.022352 15676 raft_consensus.cc:2410] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:18:31.018450 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:30.994598 18693 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.019321 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.023590 15670 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:30.999678 19075 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.020838 15675 rpcz_store.cc:276] 0709 13:18:29.330065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.983700 (+653635us) service_pool.cc:224] Handling call
0709 13:18:29.984216 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.960820 (+976604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.000886 (+ 40066us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b54001ce3d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:31.001131 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030985600}
I20260709 13:18:30.967972 19111 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.031477 15496 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 8, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 8 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:31.040225 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.041173 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.033857 15744 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:31.049701 15744 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.052758 19225 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.024735 19220 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:31.054378 19218 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.054891 19220 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.007066 19206 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.058410 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.032774 19230 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.064884 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.065531 15676 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:31.066938 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.074234 19220 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.024492 19215 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:31.078879 19215 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:31.081679 19220 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.085052 19108 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.086831 19222 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.024861 18693 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:31.132779 16265 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.034s	sys 0.029s
W20260709 13:18:31.133270 16265 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.035s	sys 0.030s
W20260709 13:18:31.133623 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 712016us
I20260709 13:18:31.137811 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:31.141088 15743 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:31.145942 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.146461 19056 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:31.146883 15750 raft_consensus.cc:2410] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:31.147980 19237 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.131453 19245 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:31.162025 19146 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.163789 19111 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:31.164848 19120 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.166179 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:31.167070 15670 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:31.184122 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.180135 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:31.104120 15744 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:31.164310 18693 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:31.194315 16263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.017s	sys 0.016s
I20260709 13:18:31.144609 19206 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:18:31.201964 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:31.199452 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 484927us
W20260709 13:18:31.213860 16263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.018s	sys 0.017s
I20260709 13:18:31.219419 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.219503 19246 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.227146 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:31.228080 15745 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.235158 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.236871 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.238099 15746 raft_consensus.cc:2410] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:18:31.239255 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:31.240026 15749 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.250715 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.251844 15746 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:31.261859 15745 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:31.219789 19108 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:31.267001 15671 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:31.288663 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:31.289865 16308 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:31.272508 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.268508 16265 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:31.270622 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 482212us
I20260709 13:18:31.274359 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:31.274601 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:31.223389 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 369536us
I20260709 13:18:31.292779 16310 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:31.275619 15749 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:31.266577 19228 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.292686 16265 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:31.295243 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:31.266629 19047 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:31.210527 19215 consensus_queue.cc:1059] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:31.217278 19013 consensus_queue.cc:1059] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:18:31.292420 19238 consensus_meta.cc:287] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:18:31.270145 19258 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:31.309144 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.316059 16310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:31.316386 16309 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:31.316748 16310 raft_consensus.cc:606] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.317183 16310 raft_consensus.cc:614] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:31.317582 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.294131 19218 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.293973 19237 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.323215 15670 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:31.318315 16302 raft_consensus.cc:2393] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:31.312616 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.327069 16308 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:31.310627 16265 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:31.294427 19245 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:31.270931 19201 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:18:31.318441 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:31.320091 18346 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:31.329635 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.330384 16265 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:31.276149 18935 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:31.276753 18933 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:18:31.361469 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:31.370014 15673 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:31.301329 19077 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:18:31.377774 15642 leader_election.cc:336] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.661s (SENT)
I20260709 13:18:31.371785 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.378264 15642 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:31.368281 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:31.373862 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.311750 19001 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:31.377403 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 47099us
I20260709 13:18:31.378708 15669 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:31.385139 16309 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:31.381119 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.387125 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.387146 16308 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:31.394330 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:31.427983 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 55635.2us
I20260709 13:18:31.308943 19047 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:31.470798 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.480957 15714 connection.cc:256] RPC call timeout handler was delayed by -1.3670074970000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:18:31.482038 15714 connection.cc:256] RPC call timeout handler was delayed by -1.1465074969999023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260709 13:18:31.476994 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 89954.6us
I20260709 13:18:31.483058 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.322506 19228 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:18:31.483299 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:31.492353 16305 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.360097 19259 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.317767 19260 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.373378 19185 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.487183 19056 raft_consensus.cc:3055] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:31.487347 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.494077 16304 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:31.387640 19246 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:31.335700 19218 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.498739 18346 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.522845 18346 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.498835 15642 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:31.325443 19238 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.501777 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:31.500931 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 182465us
I20260709 13:18:31.503248 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:31.503732 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 184014us
I20260709 13:18:31.383247 19077 consensus_queue.cc:1243] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:31.467888 19120 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:31.512315 19220 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:18:31.508051 19260 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.518452 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.508870 19185 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.507720 19001 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:31.501081 19261 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.522200 19246 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.531167 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:31.572788 15565 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:31.386300 19264 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:31.334302 19258 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.361011 19245 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.532094 15567 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:31.482285 19222 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:31.538650 15744 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:31.387420 19232 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:18:31.549674 19275 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:18:31.506909 19233 consensus_meta.cc:287] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
W20260709 13:18:31.520545 19257 log.cc:927] Time spent T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 13:18:31.542219 18346 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.542028 19260 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.466226 19201 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:31.467948 19234 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 13:18:31.410430 19183 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:18:31.497731 19240 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:31.547500 19185 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:31.499436 19259 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:31.616757 19259 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.530968 15642 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:31.619948 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 89051.1us
I20260709 13:18:31.513916 19056 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:31.621343 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.621623 19220 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:31.621876 19258 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.559650 15676 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:31.622545 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:31.577369 19274 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:31.578536 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:31.621343 19056 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.623822 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.624390 19274 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:31.592351 19215 consensus_queue.cc:1059] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:18:31.623792 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45359.3us
I20260709 13:18:31.598960 19119 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:31.625309 19120 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:31.625648 15565 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.625799 19119 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:31.624796 19222 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:31.551041 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.626850 19119 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:31.627599 16308 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:31.628767 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.628831 19274 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:31.628921 19275 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:31.629576 16308 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:31.587339 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 55339.6us
I20260709 13:18:31.629863 19278 consensus_queue.cc:1059] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:31.630084 18346 consensus_queue.cc:1059] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:31.630585 15567 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:31.630926 18346 raft_consensus.cc:3055] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:31.631013 19278 raft_consensus.cc:3055] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:31.631625 19278 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:31.632026 19110 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:31.490114 19190 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:31.632615 19110 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:31.632947 19190 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.580928 19228 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:31.633563 19110 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:31.635345 19190 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.540370 19230 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:31.636358 19230 raft_consensus.cc:697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:31.605242 19233 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.629493 19274 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.636888 19245 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.637348 19274 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.637390 19230 consensus_queue.cc:237] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:31.638657 19233 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.640033 19240 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.631521 18346 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:31.553928 19261 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:31.641119 19261 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.641294 18346 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.584713 19264 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:31.643337 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.587723 18693 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:31.616000 19262 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:18:31.622387 19220 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:31.604835 19201 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:31.579245 19218 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.668118 15746 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:18:31.602710 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:48744 (request call id 2304) took 1486 ms. Trace:
I20260709 13:18:31.633563 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2301) took 1579 ms. Trace:
I20260709 13:18:31.645234 15595 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: [5.3-9.5]
I20260709 13:18:31.595613 16263 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:31.670174 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.647837 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:31.670675 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 75135us
I20260709 13:18:31.649852 16305 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:31.650434 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:31.671806 16299 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:31.672760 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:31.608395 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 69223.2us
I20260709 13:18:31.665349 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.629493 19047 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:31.655397 18346 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.672693 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:31.585918 19246 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:31.669512 15742 rpcz_store.cc:276] 0709 13:18:30.053990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.785312 (+731322us) service_pool.cc:224] Handling call
0709 13:18:30.785739 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:30.791690 (+  5951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.791728 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:30.856359 (+ 64631us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b2c0003e3a8. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefcfe9a11 00007faefcff9372 00007faefe72ba01 00007faefe6f043a 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2
0709 13:18:30.882934 (+ 26575us) log.cc:844] Serialized 52 byte log entry
0709 13:18:31.308381 (+425447us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:31.308426 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.308495 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.633257 (+324762us) raft_consensus.cc:1685] finished
0709 13:18:31.633283 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.633500 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1692,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6523,"spinlock_wait_cycles":12378368,"thread_start_us":402985,"threads_started":1,"wal-append.queue_time_us":713678}
I20260709 13:18:31.677606 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:31.683036 16263 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:31.682976 15594 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:31.668834 15744 rpcz_store.cc:276] 0709 13:18:30.105744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.789151 (+683407us) service_pool.cc:224] Handling call
0709 13:18:31.519370 (+730219us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400216954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6e7a3d 00007faf036b7cd0 00007faefcc3c254 00007faefcc3c1e2 00007faefcc3c111 00007faefcc3c08c 00007faefcc3b342 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:31.592258 (+ 72888us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":197,"spinlock_wait_cycles":344432000}
I20260709 13:18:31.691989 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:31.692162 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:31.692679 15749 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:31.694669 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.695501 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:31.696175 15595 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:31.697697 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.699096 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.624846 19056 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.697057 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.631139 19238 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.705576 18346 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:31.705930 18346 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:31.706056 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.706388 18346 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:31.703174 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.647153 19275 consensus_queue.cc:1243] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:18:31.711035 15594 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:31.708045 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.713404 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.714121 16308 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:31.654138 19264 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:31.716293 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.676141 19222 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.717509 15594 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:31.721711 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.722116 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.722749 15593 raft_consensus.cc:2410] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:18:31.691208 19245 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:31.725597 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.728677 18346 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.730749 15602 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:31.732710 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:31.734491 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 57734.2us
I20260709 13:18:31.736742 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.737742 16305 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:31.698693 19183 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.701311 19218 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:31.742329 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.751694 18346 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.752022 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:31.753867 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.753765 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.754740 16308 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:31.713689 18693 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.709251 19097 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:31.750975 15594 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:31.762151 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 765) took 1098 ms. Trace:
I20260709 13:18:31.717288 18933 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.765974 15747 rpcz_store.cc:276] 0709 13:18:30.663810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.824693 (+160883us) service_pool.cc:224] Handling call
0709 13:18:30.825081 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.837988 (+ 12907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.838022 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.838530 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.270520 (+431990us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:31.270562 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.270643 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.761894 (+491251us) raft_consensus.cc:1685] finished
0709 13:18:31.761917 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.762085 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11799,"raft.queue_time_us":12081,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":430287,"threads_started":1,"wal-append.queue_time_us":583084}
I20260709 13:18:31.763548 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.768396 15595 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:31.723531 19238 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:31.709038 19047 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:18:31.722704 19240 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:31.735734 19120 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:31.785478 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.795037 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.800904 15594 pending_rounds.cc:85] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 2
I20260709 13:18:31.806664 15594 pending_rounds.cc:107] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:18:31.807178 15594 raft_consensus.cc:2889] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:31.758689 19218 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.806749 16308 raft_consensus.cc:2393] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:31.812251 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:31.815970 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.767802 18693 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.818152 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.832792 15602 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:31.677714 19278 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.774987 18933 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.770138 19285 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.784439 19258 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.837901 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:31.778908 19238 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.786659 19222 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.849296 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.849804 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.792949 19263 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:18:31.850972 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 130391us
I20260709 13:18:31.834126 19220 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.816831 19218 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.834421 18693 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.835500 19215 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.837212 19290 raft_consensus.cc:3055] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:31.862150 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.756707 19201 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:31.859655 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:31.874446 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.867609 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.875134 16308 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:31.870718 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1643) took 1035 ms. Trace:
I20260709 13:18:31.875289 15675 raft_consensus.cc:2410] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:18:31.870622 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.842525 18933 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.871841 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:31.875334 15602 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:31.854379 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:31.874711 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.876267 15673 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:31.875381 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:31.877480 15670 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:31.875543 15751 rpcz_store.cc:276] 0709 13:18:30.835631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.900587 (+ 64956us) service_pool.cc:224] Handling call
0709 13:18:30.900985 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:30.901238 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:31.360289 (+459051us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.716193 (+355904us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b180049d920. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:31.870290 (+154097us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.870336 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:31.870376 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.870547 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:31.870663 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":598689,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":181275,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":27986,"spinlock_wait_cycles":17787648,"thread_start_us":780923,"threads_started":3,"wal-append.queue_time_us":280382}
I20260709 13:18:31.852857 19238 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.880416 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:31.893748 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.893918 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.900032 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:31.900420 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:31.901093 15751 raft_consensus.cc:2393] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:31.904817 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.870527 19206 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:31.871874 19290 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:31.873646 19278 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.856400 19258 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.860502 19222 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.909247 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.910923 15749 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:31.969372 16305 raft_consensus.cc:2410] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:18:31.911162 19269 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:31.911911 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.912889 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:31.895335 19108 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:31.914532 19259 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.915004 19274 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:31.910977 15776 heartbeater.cc:646] Failed to heartbeat to 127.14.41.126:40467 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.41.126:40467 timed out after 15.000s (SENT)
I20260709 13:18:31.873891 19215 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:31.851594 19285 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:31.921768 19288 consensus_queue.cc:1059] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:31.925491 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:32.014024 15602 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.964011 19110 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:31.906836 15595 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:31.928349 15673 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:31.868923 19220 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:31.972244 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.975142 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:31.907855 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:32.023633 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 351043us
I20260709 13:18:31.966852 19263 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:32.045579 15642 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:32.061801 15597 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:32.000746 19201 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:31.973268 19108 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.059484 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 95004.9us
I20260709 13:18:32.062673 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:32.067538 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:32.068620 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:32.070983 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:32.076747 15671 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:31.907892 19120 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:32.082986 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:32.087909 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:32.090662 15596 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:32.064989 19286 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.094867 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:32.074530 19230 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.072824 19108 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:32.080073 19293 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:18:32.067096 19263 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.074925 19290 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.223582 15602 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
W20260709 13:18:32.237531 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.238067 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:32.169270 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 100718us
I20260709 13:18:32.179903 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:32.174437 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:32.240576 16307 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:32.240983 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 333235us
I20260709 13:18:32.243345 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:32.241289 15598 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:32.245414 15596 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:32.247212 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:32.247339 19309 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:32.085036 19225 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:32.279940 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:32.304587 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:32.248186 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:32.081122 19185 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:32.118431 19270 log.cc:927] Time spent T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 13:18:32.305758 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:32.314028 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:32.313555 15676 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:32.260563 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:32.327245 15670 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:32.249501 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:32.248178 19308 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:32.329100 19308 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:32.329538 19308 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.329821 19222 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:32.210426 19264 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:32.333323 19263 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:32.334438 19296 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:18:32.335170 19264 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:32.338080 19246 consensus_meta.cc:287] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.005s
I20260709 13:18:32.338514 19246 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.339619 16305 raft_consensus.cc:2368] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7.
I20260709 13:18:32.269048 19258 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:32.269593 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:32.249112 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:32.341969 15598 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.341691 19308 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:32.343580 19261 consensus_meta.cc:287] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.004s
I20260709 13:18:32.343999 19308 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:32.312497 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:32.256752 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 189439us
I20260709 13:18:32.345286 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:32.105515 19230 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.202850 19289 log.cc:927] Time spent T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:32.345796 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:32.305984 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 62748.3us
I20260709 13:18:32.348127 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:32.348282 15596 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:32.319509 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:32.245568 19245 raft_consensus.cc:697] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:32.349871 19245 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.118348 19302 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:32.351107 19302 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:32.249169 19220 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:32.352077 19302 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.328380 15673 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:32.354516 19284 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.355180 19284 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.354754 15598 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:32.355545 19284 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.357291 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 849) took 1711 ms. Trace:
I20260709 13:18:32.360297 16295 rpcz_store.cc:276] 0709 13:18:30.646121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.646248 (+   127us) service_pool.cc:224] Handling call
0709 13:18:30.646587 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:30.918338 (+271751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:30.918372 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:30.918824 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.312347 (+393523us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:31.312389 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.312457 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.357084 (+1044627us) raft_consensus.cc:1685] finished
0709 13:18:32.357107 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.357236 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208785,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":29646,"thread_start_us":589479,"threads_started":2,"wal-append.queue_time_us":746067}
I20260709 13:18:32.215864 19274 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:32.356948 19013 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:18:32.245492 19288 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.362809 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:32.371587 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:32.327714 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 102340us
I20260709 13:18:32.365278 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:32.366997 16309 raft_consensus.cc:2368] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11.
W20260709 13:18:32.373507 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.313258 19309 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:32.374279 19309 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:32.114903 19215 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:32.374437 15598 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:32.374871 19293 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:32.374639 16263 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:32.378386 19258 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:32.379925 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:32.383615 19258 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:32.384135 19258 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:32.304867 19307 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:32.384666 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:32.385083 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:32.385001 19307 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:32.385692 15747 raft_consensus.cc:1240] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:32.387421 19307 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:32.117082 19285 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:32.212944 19260 consensus_meta.cc:287] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.000s
I20260709 13:18:32.316270 19225 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:32.388836 19263 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:32.393525 19263 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:32.394054 19263 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.394691 15750 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:32.396395 15749 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:32.389740 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:32.399814 19304 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:32.403030 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:32.404026 19304 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:32.404515 19304 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.405172 19304 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:32.405405 19225 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:32.392532 19260 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:32.409587 15601 raft_consensus.cc:2393] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:32.389077 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:32.390379 19047 consensus_queue.cc:1059] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:18:32.404464 19263 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.412976 19047 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:32.414711 19304 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.415125 19047 raft_consensus.cc:3055] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:32.415730 19047 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:32.411623 19311 consensus_queue.cc:1059] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:18:32.425173 19311 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:32.425917 19311 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:32.427142 16295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:32.427856 16295 raft_consensus.cc:606] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:32.428282 16295 raft_consensus.cc:614] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:32.346032 19230 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:32.431533 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.108791 19286 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:32.476774 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:32.478627 15749 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:32.384579 19258 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:32.415293 19260 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:32.585824 15642 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.616s (SENT)
I20260709 13:18:32.644537 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 836) took 1156 ms. Trace:
I20260709 13:18:32.644924 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:32.645088 16295 rpcz_store.cc:276] 0709 13:18:31.488450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.643611 (+1155161us) service_pool.cc:224] Handling call
0709 13:18:32.643974 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.644191 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.644216 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.644256 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:32.644287 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.644342 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.644474 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.646684 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:32.647789 16295 raft_consensus.cc:2410] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:32.366489 19308 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:32.699606 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 349118us
I20260709 13:18:32.358048 19261 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.476774 19259 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.001999 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:32.760254 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:33.005427 19259 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:32.787722 19238 consensus_meta.cc:287] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.884s	user 0.007s	sys 0.002s
I20260709 13:18:33.006271 16265 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:33.006563 19238 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:32.763986 19311 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.008131 19311 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:32.822345 18933 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.003s
I20260709 13:18:33.001945 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.009069 18933 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.010360 15599 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:32.663362 19111 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:33.011947 19111 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.817353 19222 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.014257 19222 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.803654 19308 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:32.762439 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.016192 15593 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:32.786799 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.017895 15594 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:33.005995 19259 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.006677 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:33.030764 16295 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:33.031600 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 779) took 1542 ms. Trace:
I20260709 13:18:32.835304 15749 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:33.032142 16295 rpcz_store.cc:276] 0709 13:18:31.493409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.030162 (+1536753us) service_pool.cc:224] Handling call
0709 13:18:33.030540 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.031304 (+   764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.031528 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:32.430498 19288 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.009496 15598 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:32.914489 19220 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:32.890152 19056 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.180s	user 0.007s	sys 0.004s
W20260709 13:18:32.866561 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 72981.3us
W20260709 13:18:32.991153 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.871536 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.020787 19261 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.037571 19202 raft_consensus.cc:3055] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:32.661501 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 776) took 1149 ms. Trace:
I20260709 13:18:33.044979 16295 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:32.503296 19047 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.051440 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.040513 19318 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.043627 19263 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.152823 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 780) took 1648 ms. Trace:
I20260709 13:18:33.154683 16295 rpcz_store.cc:276] 0709 13:18:31.524953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.041059 (+1516106us) service_pool.cc:224] Handling call
0709 13:18:33.044737 (+  3678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.130614 (+ 85877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.152743 (+ 22129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:33.131527 15594 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:33.086117 19304 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.093178 19319 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.094404 19185 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.095544 19246 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.169719 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.170621 15594 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
W20260709 13:18:33.101328 19218 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 1.227s	user 0.010s	sys 0.001s
I20260709 13:18:33.102308 19320 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.117293 19183 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.119709 19288 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:33.122709 19309 consensus_meta.cc:287] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.747s	user 0.004s	sys 0.003s
W20260709 13:18:33.124590 19110 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.064s	user 0.008s	sys 0.000s
I20260709 13:18:33.125790 19245 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.130375 15743 rpcz_store.cc:276] 0709 13:18:31.512325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.512691 (+   366us) service_pool.cc:224] Handling call
0709 13:18:31.512991 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.642144 (+129153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.642174 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.642216 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:31.642247 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.661148 (+1018901us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002cf6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:32.661216 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.661414 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296561536}
W20260709 13:18:33.146441 16307 consensus_meta.cc:287] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.901s	user 0.009s	sys 0.001s
W20260709 13:18:33.166497 15640 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.603s (SENT)
W20260709 13:18:33.183879 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 177684us
I20260709 13:18:33.190953 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.152529 19202 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:33.202914 16307 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:33.212183 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.214392 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:33.196388 19232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.001s	sys 0.036s
I20260709 13:18:33.218719 16307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 863) took 1167 ms. Trace:
I20260709 13:18:33.221419 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.219370 15743 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:33.223223 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.041s
I20260709 13:18:33.220719 16307 rpcz_store.cc:276] 0709 13:18:32.043803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.179551 (+135748us) service_pool.cc:224] Handling call
0709 13:18:33.210623 (+1031072us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:33.223598 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.002s	sys 0.041s
W20260709 13:18:33.224706 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 523781us
I20260709 13:18:33.225968 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.203464 19110 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.242897 15749 pending_rounds.cc:85] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 6
I20260709 13:18:33.243263 15749 pending_rounds.cc:107] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:18:33.243499 15749 raft_consensus.cc:2889] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:33.223979 19232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.001s	sys 0.036s
I20260709 13:18:33.187644 19319 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.247794 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.253736 15594 raft_consensus.cc:2410] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:18:33.250098 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.188521 19218 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.183630 19318 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.220963 19183 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:33.282262 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.204098 19309 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.311383 15677 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:33.279574 15642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.026s
W20260709 13:18:33.313572 15642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.000s	sys 0.026s
I20260709 13:18:33.314297 15598 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:33.277274 18693 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 1.376s	user 0.012s	sys 0.000s
W20260709 13:18:33.314924 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 729089us
I20260709 13:18:33.194226 19320 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.320456 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 776) took 1911 ms. Trace:
I20260709 13:18:33.319785 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:33.281026 19316 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:33.327411 15672 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
W20260709 13:18:33.330149 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 48005.9us
I20260709 13:18:33.323439 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.324585 16299 rpcz_store.cc:276] 0709 13:18:31.409590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.489818 (+ 80228us) service_pool.cc:224] Handling call
0709 13:18:31.671648 (+181830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.676325 (+  4677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.320279 (+1643954us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400600250. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:33.320409 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":352942848}
I20260709 13:18:33.332823 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:33.323127 19283 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.296s	user 0.001s	sys 0.001s
I20260709 13:18:33.314419 19308 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.344383 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.350739 15598 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:33.328917 19201 consensus_meta.cc:287] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.255s	user 0.012s	sys 0.000s
I20260709 13:18:33.320964 18933 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.358003 19001 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:33.361210 19001 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 9 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:33.362090 19001 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:33.363878 19258 consensus_meta.cc:287] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.000s
I20260709 13:18:33.365897 19218 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.354856 19326 consensus_queue.cc:1059] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:18:33.367841 19318 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.312268 19183 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.330255 19316 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:33.364360 19258 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.368274 19320 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.389151 19259 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.392004 19238 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:33.392343 19321 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:18:33.393131 19323 log.cc:927] Time spent T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:33.325317 18693 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:33.394120 19278 consensus_meta.cc:287] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.423s	user 0.008s	sys 0.004s
I20260709 13:18:33.313959 19202 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.398113 19309 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.403419 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:33.339833 19285 raft_consensus.cc:2764] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:18:33.407078 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 74322.5us
W20260709 13:18:33.393371 19108 consensus_meta.cc:287] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.232s	user 0.011s	sys 0.000s
I20260709 13:18:33.335741 19335 raft_consensus.cc:2764] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:18:33.422111 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.370026 19260 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.422650 16304 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:33.458416 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.458529 19260 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.459578 19258 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.466760 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2327) took 1087 ms. Trace:
I20260709 13:18:33.425151 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:33.467911 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:33.469026 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 43990.6us
I20260709 13:18:33.467229 15748 rpcz_store.cc:276] 0709 13:18:32.379612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.380709 (+  1097us) service_pool.cc:224] Handling call
0709 13:18:32.381134 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:32.381572 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.381605 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:32.382381 (+   776us) log.cc:844] Serialized 52 byte log entry
0709 13:18:32.745746 (+363365us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:32.915508 (+169762us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.217084 (+301576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.217161 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.466503 (+249342us) raft_consensus.cc:1685] finished
0709 13:18:33.466523 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.466691 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":311818,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":142140,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":240,"thread_start_us":833388,"threads_started":3,"wal-append.queue_time_us":839910}
I20260709 13:18:33.402485 19316 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.368670 19286 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.404963 19225 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.390666 19245 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:18:33.472504 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:33.472652 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.483080 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.483626 15750 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:33.483748 15593 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:33.473376 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.467002 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.484784 15598 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:33.472918 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.472326 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.476577 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.485690 15743 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:33.486475 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.486529 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:33.486918 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2335) took 1087 ms. Trace:
I20260709 13:18:33.487278 15745 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:33.488160 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.485000 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.428800 19259 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:33.481451 15642 leader_election.cc:336] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.608s (SENT)
I20260709 13:18:33.487296 15742 rpcz_store.cc:276] 0709 13:18:32.399529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.399673 (+   144us) service_pool.cc:224] Handling call
0709 13:18:32.399962 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.400169 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.400191 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.400660 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.667270 (+266610us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:32.667311 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.667389 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.486728 (+819339us) raft_consensus.cc:1685] finished
0709 13:18:33.486746 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.486866 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":266214,"threads_started":1,"wal-append.queue_time_us":815734}
I20260709 13:18:33.489084 15642 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.489526 16263 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.489529 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:33.492566 15742 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:33.492834 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:33.493991 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.494969 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.495956 15743 raft_consensus.cc:2410] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:18:33.467099 19222 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.468271 19278 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.497539 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:33.491778 19230 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.988s	user 0.011s	sys 0.009s
I20260709 13:18:33.498772 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:33.499828 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.480233 19318 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:33.494910 15640 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:33.522324 15742 raft_consensus.cc:2368] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9.
I20260709 13:18:33.486563 19245 consensus_queue.cc:1243] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:33.497097 19304 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:33.516137 19341 log.cc:927] Time spent T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:33.493813 19225 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:33.519465 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.541599 15593 raft_consensus.cc:2376] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10. Re-sending same reply.
I20260709 13:18:33.519933 15595 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:33.523239 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.457258 19108 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.496618 19258 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:33.520735 15743 raft_consensus.cc:2376] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9. Re-sending same reply.
I20260709 13:18:33.552663 16307 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 786) took 1762 ms. Trace:
I20260709 13:18:33.497838 19218 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:33.528565 15642 leader_election.cc:336] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.071s (SENT)
I20260709 13:18:33.554824 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:33.499600 19286 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.555284 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:33.545578 19319 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.528046 19222 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.518590 19278 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:33.550799 15600 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:33.551357 18693 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:33.543148 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.553213 16307 rpcz_store.cc:276] 0709 13:18:31.789957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.242695 (+1452738us) service_pool.cc:224] Handling call
0709 13:18:33.243006 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:33.243361 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.243389 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:33.274916 (+ 31527us) log.cc:844] Serialized 52 byte log entry
0709 13:18:33.412517 (+137601us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:33.491764 (+ 79247us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.494657 (+  2893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.494727 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.552289 (+ 57562us) raft_consensus.cc:1685] finished
0709 13:18:33.552330 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.552563 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14967,"raft.queue_time_us":4380,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":14234,"thread_start_us":122556,"threads_started":2,"wal-append.queue_time_us":192836}
I20260709 13:18:33.557471 19001 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:18:33.560889 15642 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.211s (SENT)
I20260709 13:18:33.566198 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.566358 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:33.567441 16307 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.529084 19304 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.568420 15642 leader_election.cc:336] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.245s (SENT)
I20260709 13:18:33.571668 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.542018 19318 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:33.574924 19318 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.577996 19183 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.565479 19222 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:33.578404 19108 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.578882 19222 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.579440 15594 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:33.580653 16299 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:33.581647 15744 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:33.583034 19225 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.573006 19309 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:33.586795 15593 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:33.588075 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.502815 19332 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:18:33.586668 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:33.589370 16307 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:33.628415 16299 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:33.590027 19278 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.590699 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.630250 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.630424 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:33.564893 19238 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:33.632333 19238 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.614307 19316 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.634902 19238 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.635166 19316 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.594429 19206 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:33.571105 19284 consensus_meta.cc:287] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.201s	user 0.010s	sys 0.000s
I20260709 13:18:33.598613 19304 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.599380 19220 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.639387 15748 raft_consensus.cc:2393] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:33.599596 15671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48128 (request call id 1998) took 1727 ms (client timeout 1675 ms). Trace:
I20260709 13:18:33.605935 16302 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:33.639995 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:33.610212 19311 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.602s	user 0.005s	sys 0.005s
W20260709 13:18:33.612329 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.613909 19190 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:33.644670 19190 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:33.645635 19190 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.646693 19190 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.623207 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:33.624732 15642 leader_election.cc:336] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.561s (SENT)
I20260709 13:18:33.648965 15593 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:33.649957 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.650557 15593 raft_consensus.cc:2376] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8. Re-sending same reply.
I20260709 13:18:33.651099 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.651392 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.651901 15675 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.636955 19284 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.654124 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:33.610037 16309 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 831) took 2216 ms (client timeout 1744 ms). Trace:
I20260709 13:18:33.655014 19284 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:33.639992 15671 rpcz_store.cc:269] 0709 13:18:31.871776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.874474 (+  2698us) service_pool.cc:224] Handling call
0709 13:18:33.599336 (+1724862us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001a6654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:33.599491 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459619200}
I20260709 13:18:33.655427 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.655895 15751 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:33.656080 15673 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:33.656984 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.657135 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.657547 15673 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:33.657735 15676 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:33.655227 16309 rpcz_store.cc:269] 0709 13:18:31.393984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.394103 (+   119us) service_pool.cc:224] Handling call
0709 13:18:33.609797 (+2215694us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400057dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:33.609928 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071631104}
I20260709 13:18:33.656100 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.655061 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.660777 15668 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:33.660983 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.661572 15669 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.661664 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:33.662312 19334 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.192s	user 0.002s	sys 0.000s
I20260709 13:18:33.662876 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.663858 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.664330 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.664952 15593 raft_consensus.cc:2376] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9. Re-sending same reply.
I20260709 13:18:33.643615 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 785) took 1857 ms. Trace:
I20260709 13:18:33.666651 15596 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:33.665751 16295 rpcz_store.cc:276] 0709 13:18:31.789616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.168529 (+1378913us) service_pool.cc:224] Handling call
0709 13:18:33.183982 (+ 15453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.184445 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.184487 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.191810 (+  7323us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.286439 (+ 94629us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:33.286490 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.286585 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.643382 (+356797us) raft_consensus.cc:1685] finished
0709 13:18:33.643409 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.643555 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6148,"raft.queue_time_us":844,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7328,"thread_start_us":65829,"threads_started":1,"wal-append.queue_time_us":190662}
I20260709 13:18:33.641942 15594 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:33.668061 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.636096 19206 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.669451 19220 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.669936 19220 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.670897 19206 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.672106 19220 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.672101 15668 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:33.668475 15676 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:33.668123 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:33.665220 15599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1699) took 1693 ms (client timeout 2151 ms). Trace:
I20260709 13:18:33.674026 15596 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:33.674357 15671 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:18:33.668843 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.674568 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:33.674252 15599 rpcz_store.cc:269] 0709 13:18:31.971723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.971905 (+   182us) service_pool.cc:224] Handling call
0709 13:18:33.665019 (+1693114us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b54001009d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:33.665164 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2238722432}
I20260709 13:18:33.664955 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.529206 19230 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.669168 15675 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:33.679540 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.680258 15675 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:33.681429 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.682107 15675 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:33.682202 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:33.676222 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.683394 19218 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.675362 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.684654 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 832) took 2278 ms. Trace:
I20260709 13:18:33.684939 15671 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:33.690728 15596 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:33.677567 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.672823 19220 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:33.678537 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.679606 15670 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:33.676815 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:33.637877 19237 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.697494 15593 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:33.694368 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:33.682993 19119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.892s	user 0.089s	sys 0.117s
I20260709 13:18:33.699910 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.700693 15676 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:33.692164 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.685222 16306 rpcz_store.cc:276] 0709 13:18:31.394891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.395005 (+   114us) service_pool.cc:224] Handling call
0709 13:18:31.499033 (+104028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.607494 (+108461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.607525 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:31.607568 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:31.607605 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.673418 (+2065813us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b540004f454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:33.673462 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.673578 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248959232}
I20260709 13:18:33.693722 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.694242 15640 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.702703 15668 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:33.698410 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.703053 16263 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:33.698279 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.704037 15596 raft_consensus.cc:2376] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9. Re-sending same reply.
I20260709 13:18:33.705827 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.708951 15675 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:33.708177 15640 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.708432 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.710413 15598 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:33.709187 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.711443 15594 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:33.684641 19195 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:33.711369 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.708849 15673 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:33.713038 15671 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:33.699057 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.713770 15593 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:33.714376 15671 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:33.715400 15669 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:33.715664 15675 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:33.712965 15598 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:33.718186 15668 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:18:33.699795 19119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.915s	user 0.089s	sys 0.117s
I20260709 13:18:33.719370 15640 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:33.720765 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.722247 15598 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:33.723512 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.701316 19238 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:33.727100 15598 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:33.717077 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.728320 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.729604 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.735045 15668 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:33.735607 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.736315 15675 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.701188 19265 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:33.730458 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.739627 15671 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.737449 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:33.741446 15668 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:33.701437 19220 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.750655 19218 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:33.751204 19218 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:33.751582 19218 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:33.753465 15672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 635) took 1452 ms (client timeout 1578 ms). Trace:
W20260709 13:18:33.754132 15672 rpcz_store.cc:269] 0709 13:18:32.300844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.300982 (+   138us) service_pool.cc:224] Handling call
0709 13:18:33.753204 (+1452222us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54003197d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:33.753374 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302024064}
W20260709 13:18:33.755544 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.755635 19304 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.695145 19183 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:18:33.757009 19183 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:33.757370 19183 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:33.709776 19332 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:33.731739 19337 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:33.712314 19001 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.760053 15672 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:33.759071 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.709852 18693 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:33.738389 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.758729 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:33.767122 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 47834.9us
I20260709 13:18:33.767050 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.712632 19195 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:33.769543 15640 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.769459 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.775048 15675 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:33.739229 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.778384 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.780115 15598 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:33.779238 15593 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:33.784185 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.785120 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:33.788483 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:33.701778 19237 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.786839 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:33.792567 15675 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:33.788480 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.758114 19265 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:33.800217 19265 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.769351 19286 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:33.763275 19238 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:33.799643 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.803076 15594 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
W20260709 13:18:33.803514 19302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.000s	sys 0.008s
I20260709 13:18:33.804769 15668 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:33.808353 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:33.884649 15743 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:33.786240 19259 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:33.897949 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.783613 19097 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:33.811344 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:33.903585 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:33.805143 19348 log.cc:927] Time spent T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:33.804236 15565 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:33.784018 19185 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:33.895694 19205 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:33.902312 18693 raft_consensus.cc:697] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:33.904377 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 93154.1us
I20260709 13:18:33.814697 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:33.903162 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 114784us
I20260709 13:18:33.802241 19232 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:18:33.916982 19330 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:33.918066 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 113929us
I20260709 13:18:33.918408 18821 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:33.918905 19097 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:33.919704 19304 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:33.924484 15593 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:33.785024 19234 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.113s
W20260709 13:18:33.896661 19302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.000s	sys 0.008s
I20260709 13:18:33.815132 19337 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:33.887673 19265 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:33.966914 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:33.813052 19220 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:33.813314 19286 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:33.939514 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:33.974875 15565 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:34.002576 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 63121.6us
W20260709 13:18:34.008051 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 238649us
I20260709 13:18:33.805465 19183 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:33.887171 19359 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:33.885311 19326 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:33.816992 19319 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.151s
I20260709 13:18:33.992880 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:33.976847 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:33.939335 19205 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.979192 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:34.017674 15593 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:34.018682 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:34.015488 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:34.022215 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:34.017722 19304 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:34.023205 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:34.023373 19205 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:33.905112 19222 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:33.973913 19108 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:18:33.974258 19233 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:18:34.002679 19336 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.064981 15743 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:34.008025 19234 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:34.011279 19332 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:34.069375 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 54317.5us
I20260709 13:18:34.069372 15749 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:34.010237 19302 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:34.097936 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:34.100538 15743 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:34.066979 19183 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:34.070173 19230 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:34.064940 18821 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:34.029456 19326 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.093967 19259 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:34.098778 19185 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:34.017371 19238 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.100622 19302 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:34.119122 19234 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:34.119149 19302 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:34.126885 19363 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:34.124707 19332 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.127410 19259 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.120824 19237 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:34.123845 19374 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:34.107026 19286 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.147239 19326 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:34.181226 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 185355us
W20260709 13:18:34.182086 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 176008us
I20260709 13:18:34.024308 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:34.185652 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:34.186172 15565 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:34.187233 15594 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:34.181308 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:34.188931 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:34.189952 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:34.190412 15594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:34.191463 15594 raft_consensus.cc:606] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:34.191998 15594 raft_consensus.cc:614] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:34.192345 15593 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:34.203233 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:18:34.203644 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.068013 19097 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.069991 18693 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:34.256873 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 61915.7us
W20260709 13:18:34.268865 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.128808 19234 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:34.270835 19374 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:34.271534 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 85796.5us
I20260709 13:18:34.272967 19386 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:34.274776 19319 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.275861 19319 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.271668 19234 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.278862 19319 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:34.218325 19381 consensus_queue.cc:1059] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:18:34.219982 19379 consensus_queue.cc:1059] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:18:34.272972 19374 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.302743 15593 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:34.321923 15593 pending_rounds.cc:85] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 6
I20260709 13:18:34.322340 15593 pending_rounds.cc:107] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:18:34.322685 15593 raft_consensus.cc:2889] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:34.335170 19001 consensus_meta.cc:287] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.012s
I20260709 13:18:34.324409 15567 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:34.340401 19319 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:34.341022 19319 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.341588 19319 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:34.382272 15671 consensus_meta.cc:287] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.009s
I20260709 13:18:34.383139 15671 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:34.384307 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:34.395437 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 75853.4us
I20260709 13:18:34.369088 19185 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.397271 19381 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:34.397914 19381 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:34.398445 19381 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:34.386358 19218 consensus_meta.cc:287] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.634s	user 0.015s	sys 0.007s
I20260709 13:18:34.371637 19001 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:34.423910 15595 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1704) took 2341 ms (client timeout 2186 ms). Trace:
W20260709 13:18:34.428804 15601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1929) took 2781 ms (client timeout 2038 ms). Trace:
I20260709 13:18:34.429095 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:34.429291 15601 rpcz_store.cc:269] 0709 13:18:31.647482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.647594 (+   112us) service_pool.cc:224] Handling call
0709 13:18:34.428356 (+2780762us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54000a9e54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:34.428592 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697791360}
I20260709 13:18:34.430004 15743 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
W20260709 13:18:34.431267 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.427117 19319 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.434661 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:34.432576 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:34.443763 15602 raft_consensus.cc:2376] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8. Re-sending same reply.
W20260709 13:18:34.444461 15602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1707) took 2279 ms (client timeout 2251 ms). Trace:
W20260709 13:18:34.444875 15602 rpcz_store.cc:269] 0709 13:18:32.165448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.254264 (+ 88816us) service_pool.cc:224] Handling call
0709 13:18:34.432266 (+2178002us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b5800005198. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cbeee 0000000000375939 00007faf0363f1e0 00007faf037080c4 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:34.444391 (+ 12125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14577792}
I20260709 13:18:34.434160 19108 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:18:34.448920 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 216990us
W20260709 13:18:34.424513 15595 rpcz_store.cc:269] 0709 13:18:32.082461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.082642 (+   181us) service_pool.cc:224] Handling call
0709 13:18:34.423468 (+2340826us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001013d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:34.423688 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062337792}
I20260709 13:18:34.459522 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:34.462071 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:34.468376 15749 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
W20260709 13:18:34.471704 16305 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 788) took 2535 ms (client timeout 1855 ms). Trace:
I20260709 13:18:34.480187 19218 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.487046 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2329) took 2106 ms. Trace:
I20260709 13:18:34.487742 15751 rpcz_store.cc:276] 0709 13:18:32.380198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.384380 (+  4182us) service_pool.cc:224] Handling call
0709 13:18:34.486440 (+2102060us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400217354. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:34.486803 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917665536}
I20260709 13:18:34.490190 15567 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:34.493387 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:34.505033 15744 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
W20260709 13:18:34.472277 16305 rpcz_store.cc:269] 0709 13:18:31.935528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.027638 (+ 92110us) service_pool.cc:224] Handling call
0709 13:18:34.470867 (+2443229us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540023bed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:34.471249 (+   382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624084864}
I20260709 13:18:34.506850 15744 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:34.508996 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:34.509742 15745 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:34.510224 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1653) took 1033 ms. Trace:
I20260709 13:18:34.510496 15745 rpcz_store.cc:276] 0709 13:18:33.476812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.489326 (+ 12514us) service_pool.cc:224] Handling call
0709 13:18:34.508560 (+1019234us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800184298. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:34.510170 (+  1610us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2690432}
W20260709 13:18:34.503456 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62414.1us
I20260709 13:18:34.552559 16310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 829) took 3166 ms. Trace:
I20260709 13:18:34.553289 16310 rpcz_store.cc:276] 0709 13:18:31.387325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.392806 (+  5481us) service_pool.cc:224] Handling call
0709 13:18:31.393123 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.558547 (+2165424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.558577 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:33.558617 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:33.558646 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.551820 (+993174us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54005cf3d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:34.551927 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.552238 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4979572096}
I20260709 13:18:34.562455 19319 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:34.570812 19218 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:34.513859 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:18:34.601076 19391 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:18:34.548420 19108 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:34.620776 19108 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.621332 19108 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.570909 19292 raft_consensus.cc:3055] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:34.625571 19292 raft_consensus.cc:740] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:34.614286 15671 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:34.614562 19056 raft_consensus.cc:3055] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:18:34.620208 19342 log.cc:927] Time spent T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.146s	user 0.000s	sys 0.012s
W20260709 13:18:34.625919 19355 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.814s	user 0.001s	sys 0.000s
W20260709 13:18:34.634809 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 144675us
I20260709 13:18:34.636027 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:34.636159 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1661) took 1156 ms. Trace:
I20260709 13:18:34.629411 15671 pending_rounds.cc:85] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 4
I20260709 13:18:34.637149 15671 pending_rounds.cc:107] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:18:34.637722 15671 raft_consensus.cc:2889] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:34.636759 15742 rpcz_store.cc:276] 0709 13:18:33.479271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.543219 (+ 63948us) service_pool.cc:224] Handling call
0709 13:18:33.543584 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.543945 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.544000 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.544476 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.698086 (+153610us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:18:33.698122 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.698179 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.624738 (+926559us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:34.635407 (+ 10669us) raft_consensus.cc:1685] finished
0709 13:18:34.635439 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.635900 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1066,"raft.queue_time_us":1071,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":23311744,"thread_start_us":153299,"threads_started":1,"wal-append.queue_time_us":244585}
I20260709 13:18:34.627545 19292 consensus_queue.cc:260] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.630411 19056 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:34.641876 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:34.654769 19378 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:34.657562 19378 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:34.658054 19378 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.698630 19290 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:34.703004 19319 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:34.703756 19319 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:34.706130 19317 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 1.648s	user 0.000s	sys 0.003s
I20260709 13:18:34.712478 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:34.714062 19183 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:34.714545 19183 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:34.714960 19183 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.705441 19319 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:34.694106 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54429.3us
W20260709 13:18:34.672147 19302 consensus_meta.cc:287] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.006s
W20260709 13:18:34.742923 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.737484 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:34.763424 15597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 1927) took 3120 ms (client timeout 2017 ms). Trace:
W20260709 13:18:34.763914 15597 rpcz_store.cc:269] 0709 13:18:31.642990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.643102 (+   112us) service_pool.cc:224] Handling call
0709 13:18:34.762996 (+3119894us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400100ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:34.763238 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960409984}
I20260709 13:18:34.766747 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 574) took 1545 ms. Trace:
I20260709 13:18:34.767205 15600 rpcz_store.cc:276] 0709 13:18:33.221040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.221160 (+   120us) service_pool.cc:224] Handling call
0709 13:18:34.766343 (+1545183us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54001ca2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:34.766551 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128827776}
I20260709 13:18:34.768973 19292 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:34.774317 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:34.783169 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:34.746109 19302 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.790570 15742 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:34.764317 19378 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.798207 19295 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:34.798453 15669 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:18:34.807284 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.809046 19387 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:18:34.811793 19378 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:34.813172 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.828238 15642 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.506s (SENT)
I20260709 13:18:34.829043 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:34.772717 19108 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.818151 19056 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.854772 19108 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:34.855468 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 479744us
W20260709 13:18:34.856405 19320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.015s	sys 0.009s
W20260709 13:18:34.856873 19320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.044s	user 0.016s	sys 0.009s
I20260709 13:18:34.860930 19185 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.861711 19185 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:34.862361 19390 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:18:34.864138 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 199851us
I20260709 13:18:34.865080 16263 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:34.866253 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:34.867628 19218 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.868256 19218 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.875818 19185 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:34.876802 19185 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:34.877518 19185 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:34.878293 19260 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:34.878495 19185 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.879838 19232 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:34.880330 19232 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:34.881608 19232 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.882589 19218 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:34.883282 19218 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:34.884290 19218 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:34.890444 15742 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:34.845175 19001 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:34.898170 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.905557 19381 consensus_meta.cc:287] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.000s
I20260709 13:18:34.906036 19381 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:34.908484 19381 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:34.884280 19364 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.784s	user 0.001s	sys 0.000s
I20260709 13:18:34.883317 19232 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:34.875833 19201 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:34.908507 19245 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:34.945825 19056 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:34.946725 19362 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.842s	user 0.001s	sys 0.000s
I20260709 13:18:34.929221 19258 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:34.916544 19201 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:34.948882 19304 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.022s	sys 0.018s
I20260709 13:18:34.948549 19258 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.949941 19260 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.949692 19201 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:34.950326 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 154368us
I20260709 13:18:34.950508 19260 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.951001 19201 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:34.951375 19258 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:34.952682 19260 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:34.952937 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.953282 19260 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:18:34.949442 19304 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.022s	sys 0.018s
I20260709 13:18:34.956259 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:34.919080 19108 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.960944 19304 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:34.923532 19245 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:34.974938 15597 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:18:34.976759 19260 consensus_queue.cc:1243] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:34.979432 15595 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:34.979182 19304 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:34.981568 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 597) took 1345 ms. Trace:
I20260709 13:18:34.982091 15593 rpcz_store.cc:276] 0709 13:18:33.632366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.320878 (+688512us) service_pool.cc:224] Handling call
0709 13:18:34.321444 (+   566us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:18:34.324150 (+  2706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.324178 (+    28us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:18:34.365525 (+ 41347us) log.cc:844] Serialized 104 byte log entry
0709 13:18:34.740311 (+374786us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:34.775808 (+ 35497us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.790306 (+ 14498us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.906902 (+116596us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b180033c700. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:34.907329 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.907640 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:18:34.907876 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.907951 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.975804 (+ 67853us) raft_consensus.cc:1685] finished
0709 13:18:34.975823 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.978017 (+  2194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157634,"prepare.queue_time_us":50180,"prepare.run_cpu_time_us":176,"prepare.run_wall_time_us":180,"raft.queue_time_us":141363,"raft.run_cpu_time_us":587,"raft.run_wall_time_us":2565,"spinlock_wait_cycles":3330432,"thread_start_us":319328,"threads_started":1,"wal-append.queue_time_us":490854}
W20260709 13:18:34.987843 15642 leader_election.cc:336] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.552s (SENT)
W20260709 13:18:34.988586 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:34.994234 19396 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:18:35.000267 19383 raft_consensus.cc:3055] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:35.000907 19383 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:35.001796 15567 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:35.002966 19260 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:35.003701 19260 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:34.997205 19108 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.006098 19260 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.006440 19108 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:35.010234 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.011221 15751 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:35.011543 19359 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:35.012851 18693 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:35.012615 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.014115 15742 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:35.018532 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:35.019116 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 137519us
I20260709 13:18:35.019996 15742 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.019325 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.020750 15749 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:35.026471 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.032693 19404 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.033632 19195 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.035733 19195 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.036741 19001 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.015516 18693 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:35.038962 19338 log.cc:927] Time spent T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.564s	user 0.002s	sys 0.000s
I20260709 13:18:35.040244 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2199) took 1335 ms. Trace:
I20260709 13:18:35.039963 18693 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.040786 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2337) took 2511 ms. Trace:
I20260709 13:18:35.041301 18693 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.041216 15747 rpcz_store.cc:276] 0709 13:18:32.417428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.417549 (+   121us) service_pool.cc:224] Handling call
0709 13:18:32.417904 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.418264 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.418305 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.418904 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:18:34.489171 (+2070267us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b180034ac20. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1 00007faefe6aba0f
0709 13:18:34.892295 (+403124us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:34.892371 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:34.909826 (+ 17455us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:34.909878 (+    52us) raft_consensus.cc:1685] finished
0709 13:18:34.909890 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:34.928257 (+ 18367us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57763,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":47457,"spinlock_wait_cycles":826207488,"thread_start_us":334138,"threads_started":1,"wal-append.queue_time_us":2456390}
I20260709 13:18:35.043895 19202 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.045907 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:35.046566 16310 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 5.
I20260709 13:18:35.046602 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:35.047413 16302 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.047911 16305 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:35.048475 16306 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:35.049033 19222 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.049826 16295 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:35.050091 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:35.051172 19245 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.052369 19047 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.052512 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:35.057832 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.060879 19309 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.061460 19309 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.062579 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:35.062888 15716 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.448s	user 0.008s	sys 0.016s
I20260709 13:18:35.063283 15676 pending_rounds.cc:85] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 3
I20260709 13:18:35.063638 15676 pending_rounds.cc:107] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:18:35.063803 19309 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.063911 15676 raft_consensus.cc:2889] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:35.034500 19399 log.cc:927] Time spent T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:18:35.063282 15716 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.008s	sys 0.016s
I20260709 13:18:35.070628 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.064277 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.063846 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.072711 15668 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:35.080343 16302 raft_consensus.cc:2410] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:35.072854 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.060443 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:35.074160 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 1.46003e+06us
I20260709 13:18:35.080173 19234 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:35.073493 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.017709 19183 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.099403 15742 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:35.099646 15565 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.073886 19001 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:35.105079 15749 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:35.106724 19238 raft_consensus.cc:2764] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:35.040644 15673 rpcz_store.cc:276] 0709 13:18:33.704865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.713795 (+  8930us) service_pool.cc:224] Handling call
0709 13:18:33.714185 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:33.714555 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:33.714582 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:33.716968 (+  2386us) log.cc:844] Serialized 26 byte log entry
0709 13:18:33.770558 (+ 53590us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:33.792001 (+ 21443us) log.cc:844] Serialized 14 byte log entry
0709 13:18:33.905295 (+113294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.905387 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.012917 (+1107530us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b180035d520. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:35.039563 (+ 26646us) raft_consensus.cc:1685] finished
0709 13:18:35.039809 (+   246us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.040025 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30896,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":140790,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":11632,"spinlock_wait_cycles":15044864,"thread_start_us":163113,"threads_started":2,"wal-append.queue_time_us":88198}
I20260709 13:18:35.072543 19313 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.102109 15716 connection.cc:256] RPC call timeout handler was delayed by -1.1937279680000756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:18:35.117552 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 57202us
I20260709 13:18:35.033658 19404 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.118206 15674 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:35.118046 19222 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:18:35.128787 19264 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:18:35.124347 19001 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:35.130594 15677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 636) took 2825 ms (client timeout 1809 ms). Trace:
W20260709 13:18:35.131078 15677 rpcz_store.cc:269] 0709 13:18:32.304854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.305414 (+   560us) service_pool.cc:224] Handling call
0709 13:18:35.130240 (+2824826us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400337554. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:35.130392 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265891584}
I20260709 13:18:35.133549 16302 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:35.118570 19309 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:35.098256 19383 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.154268 19313 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:35.155664 19402 log.cc:927] Time spent T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:18:35.157267 19111 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.157860 19307 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.204475 19304 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.204656 19111 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:35.204954 19307 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.205178 19304 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.207710 19307 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:35.159453 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.158842 15746 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 13:18:35.161330 19404 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.159880 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1647) took 1677 ms. Trace:
I20260709 13:18:35.209332 19304 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.159858 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.172899 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.209864 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.210373 15674 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:35.173717 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.159510 19329 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:35.210848 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.211562 15743 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:35.211406 19329 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.175307 15750 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:35.161003 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 789) took 2744 ms. Trace:
I20260709 13:18:35.167516 15640 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:35.186455 19183 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:35.186929 15567 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:35.191919 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:35.192518 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.192389 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.184741 19120 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:18:35.141461 19309 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:35.196524 19377 raft_consensus.cc:3055] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:18:35.192993 15642 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.705s (SENT) [suppressed 65 similar messages]
I20260709 13:18:35.232220 16309 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:18:35.205446 19111 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.207777 19001 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:35.221567 19313 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:35.250756 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 83335.6us
I20260709 13:18:35.230448 19302 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.215328 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.251842 19001 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.252192 15749 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:35.214143 19245 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.230468 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.253427 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.253777 19111 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.254252 15747 raft_consensus.cc:2410] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:35.254475 19313 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:35.254866 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.255050 19313 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:35.255633 15749 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:35.255901 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.256042 19313 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.256901 15747 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:35.249960 15677 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.258083 16304 rpcz_store.cc:276] 0709 13:18:32.416193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.329008 (+912815us) service_pool.cc:224] Handling call
0709 13:18:33.355359 (+ 26351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:33.456932 (+101573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.160528 (+1703596us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5400603454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:35.160823 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154181888}
W20260709 13:18:35.226074 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.218318 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.264734 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.266587 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.267961 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.209482 15748 rpcz_store.cc:276] 0709 13:18:33.471949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.472077 (+   128us) service_pool.cc:224] Handling call
0709 13:18:35.118083 (+1646006us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540026bbd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:35.149728 (+ 31645us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348627712}
I20260709 13:18:35.289580 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.289871 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.291318 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.292086 15675 raft_consensus.cc:2393] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 11: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:35.249663 19377 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:35.294904 19377 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.296030 19377 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:35.252763 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 65910.8us
I20260709 13:18:35.297163 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:35.298038 19047 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.298417 19047 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.298738 19047 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.252214 15745 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:18:35.220860 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:35.300701 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:35.301402 16307 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:35.302139 16310 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:35.226380 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:35.303646 16302 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:35.139060 19319 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:35.304585 19319 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.305086 19319 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.212532 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.308990 15743 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.213037 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:35.219642 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.313369 15746 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.315342 19001 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.252326 19309 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.270089 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:35.317162 16299 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:35.256497 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.321739 15749 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:35.214052 19329 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:35.271112 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.322093 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.229874 19374 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.322832 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.323383 15749 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:35.323263 19374 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.326104 16306 raft_consensus.cc:2410] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:35.251850 15640 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:35.328869 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 77186.4us
I20260709 13:18:35.274310 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:35.330123 15640 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:35.178478 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.332386 15640 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.281008 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.281765 15598 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:35.334450 15640 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:35.334831 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1717) took 1865 ms (client timeout 2196 ms). Trace:
W20260709 13:18:35.335286 15598 rpcz_store.cc:269] 0709 13:18:33.469837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.788076 (+318239us) service_pool.cc:224] Handling call
0709 13:18:35.334629 (+1546553us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540020c6d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:35.334776 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3398032640}
I20260709 13:18:35.336194 19366 raft_consensus.cc:2764] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:18:35.285027 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.278115 19383 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.337119 15668 raft_consensus.cc:2368] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9.
I20260709 13:18:35.286091 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.338172 15670 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 5.
I20260709 13:18:35.287030 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.339196 15671 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:35.336397 19195 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.286881 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.340195 19195 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.323542 19201 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.199455 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:35.341821 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 148859us
W20260709 13:18:35.341969 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 191209us
I20260709 13:18:35.342749 19320 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:35.343129 19392 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:35.343588 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 44080.9us
I20260709 13:18:35.343777 19392 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.324328 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.287947 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.249967 15673 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:35.332536 15742 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:35.335374 19302 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:35.333452 19120 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:35.342993 19056 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:35.352010 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.352414 19056 consensus_queue.cc:1243] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:35.353242 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.344422 19195 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.354017 19309 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.354450 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.355158 15675 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:35.344393 15716 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:35.355561 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:35.262017 15750 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1652) took 1785 ms (client timeout 1506 ms). Trace:
W20260709 13:18:35.356753 15750 rpcz_store.cc:269] 0709 13:18:33.476521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.484758 (+  8237us) service_pool.cc:224] Handling call
0709 13:18:35.261742 (+1776984us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54002698d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:35.261929 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3877812096}
I20260709 13:18:35.358254 15747 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:35.358297 19201 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.345597 15674 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.346597 19392 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:35.364964 19374 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.368829 19414 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.348274 15565 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.369762 19414 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:35.323391 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:35.371579 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.372654 19201 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.373734 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.374500 15671 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:35.375130 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.375847 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.376818 19302 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:35.377866 19120 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:35.378895 19120 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.381942 19392 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:35.382620 19392 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:35.383605 19392 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.384943 19201 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:35.386328 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:35.387748 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.390062 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:35.388331 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.389760 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:35.391249 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 46961.6us
I20260709 13:18:35.345566 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:35.369451 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.392740 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 56572.8us
I20260709 13:18:35.364976 15743 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:35.395020 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.374498 15745 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:35.397053 19056 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.397326 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:35.397518 19313 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.398253 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.408368 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.398614 15746 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:35.398972 15748 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:35.416288 15674 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:35.417272 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.405139 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.406343 15677 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:35.406388 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:35.414700 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.415634 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:35.416460 15751 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:35.399363 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.420622 16306 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:35.422000 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.422873 15742 raft_consensus.cc:2393] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:35.424724 16304 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:18:35.425195 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.426191 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.426355 15745 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:35.426440 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.427387 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.425069 16304 pending_rounds.cc:85] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 9
I20260709 13:18:35.429137 16304 pending_rounds.cc:107] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:18:35.429405 16304 raft_consensus.cc:2889] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.428397 15716 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:35.415829 19056 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.432449 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.433125 15749 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:35.430819 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.424443 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:35.431488 15747 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.435892 19111 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:35.436165 15677 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:35.436511 19111 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.430954 16263 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.438512 19309 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:35.439445 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.441119 15673 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:18:35.442066 19245 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:35.442500 19245 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.442850 19245 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.418207 19319 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.444356 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.444942 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.445758 15669 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:35.447038 15669 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:35.418028 19304 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:35.448632 19001 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:18:35.448936 19275 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.448895 19304 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.449846 15743 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:35.449378 19056 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.413585 15498 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 7, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:35.451783 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.445029 15668 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:35.460938 16305 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:35.437065 19111 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.448472 15669 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:35.456379 15676 raft_consensus.cc:1240] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:35.446898 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:35.460187 15750 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:35.471167 15745 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:35.444883 19319 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.472740 15745 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:35.475083 15745 raft_consensus.cc:1275] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:18:35.475384 15745 pending_rounds.cc:85] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 7
I20260709 13:18:35.475628 15745 pending_rounds.cc:107] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:18:35.475842 15745 raft_consensus.cc:2889] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.476045 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.476859 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.477648 15675 raft_consensus.cc:2393] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:35.477913 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:35.478504 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.478873 19001 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.479203 15675 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 5.
I20260709 13:18:35.479287 19001 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:35.479686 19001 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.480077 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.480943 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.478549 16305 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.482031 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:35.485399 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.483661 15675 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:35.487645 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.488508 15671 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:35.487743 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.487735 19275 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:35.487673 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:35.490242 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.493793 15749 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.498973 15750 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:35.451431 19304 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.499848 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.500173 15747 raft_consensus.cc:2410] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:35.502589 15677 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:35.507087 16263 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.508203 16263 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.511216 15746 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:35.509859 19329 raft_consensus.cc:2764] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:35.515630 15670 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:35.489140 19374 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.497690 19275 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.518283 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.526235 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:35.528215 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.531563 15673 raft_consensus.cc:2393] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 6: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:35.528429 15677 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:18:35.519040 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 81980.8us
I20260709 13:18:35.529320 15742 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:35.528903 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.531950 15672 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
W20260709 13:18:35.554453 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 50812.7us
W20260709 13:18:35.557016 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 69419.3us
I20260709 13:18:35.558503 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.552706 15669 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:35.515836 19409 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:35.568578 15595 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:35.535761 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.566922 19261 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:35.567466 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.515583 19218 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:35.516780 19291 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.535030 19275 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:35.571055 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.530121 19392 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.575820 15593 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:35.516551 19378 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:18:35.576675 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.571391 15498 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 7, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.580178 15596 raft_consensus.cc:1240] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:18:35.585435 15602 raft_consensus.cc:2410] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:18:35.585760 15642 leader_election.cc:336] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.842s (SENT)
I20260709 13:18:35.586658 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.581944 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.589951 15597 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:35.572841 19261 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.576843 19291 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.574560 19218 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:35.517748 19366 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:18:35.553246 19374 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:35.604719 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 89676.2us
I20260709 13:18:35.584479 19377 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:35.590699 19286 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.574477 19375 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:18:35.621917 19427 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.621474 15498 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:35.625253 15640 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.625960 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.626832 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.630194 19201 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:35.635792 19245 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:35.636679 15496 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 214) took 17781 ms (client timeout 15000 ms). Trace:
I20260709 13:18:35.601014 19261 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:35.603256 19047 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.608662 19414 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.639180 19374 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:35.643728 15714 connection.cc:256] RPC call timeout handler was delayed by -3.7641343420000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
I20260709 13:18:35.605545 19218 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.646531 16265 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:35.650301 15602 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 9. Ops: []
I20260709 13:18:35.606472 19291 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:35.690977 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 105285us
I20260709 13:18:35.658026 15598 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:35.674775 16305 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:35.684852 15601 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:35.687877 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:35.694545 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 48098.3us
W20260709 13:18:35.697258 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.700743 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.702256 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.703393 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.674741 19427 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.704578 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:35.737150 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.717151 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:35.718125 15642 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.000s (SENT)
W20260709 13:18:35.737910 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 165712us
I20260709 13:18:35.738180 15746 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.720357 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.720638 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:35.719762 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 94617.3us
I20260709 13:18:35.740553 15674 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:35.705500 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.669137 19309 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.711628 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.717442 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.705590 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.719017 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:35.743523 15602 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:35.726766 16265 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:35.735422 15567 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:35.732383 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.753623 15677 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:35.756078 19375 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:35.759407 19313 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:35.765565 16265 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:35.768008 19183 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:35.768674 19183 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:35.769095 19183 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:35.768677 19375 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:35.768008 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:35.684942 19319 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.705003 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.779522 15595 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:35.751176 15601 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:35.782492 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.735289 15498 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:35.754808 15567 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:35.793323 15498 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 6 to 9, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 9 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:35.794951 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.821954 15498 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:35.823276 15498 catalog_manager.cc:5697] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 2 to 8, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 8 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
W20260709 13:18:35.824963 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 106893us
W20260709 13:18:35.825029 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 57085.8us
I20260709 13:18:35.795490 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.726074 19245 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.716850 19286 raft_consensus.cc:2764] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:18:35.842550 19286 consensus_queue.cc:1059] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:35.843310 19286 consensus_queue.cc:1243] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:35.704682 19374 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:35.807117 19047 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:35.720769 19366 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.748925 19260 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.775835 19302 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:18:35.809926 15670 raft_consensus.cc:3055] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:35.810307 19375 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.817006 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.817909 19392 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:35.826395 15594 raft_consensus.cc:2393] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 7: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:35.826880 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.835750 19201 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.836374 15642 leader_election.cc:336] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.045s (SENT)
I20260709 13:18:35.853700 15670 raft_consensus.cc:740] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:35.863827 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.838382 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.707804 19427 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:35.840458 15596 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 8: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:35.824930 19313 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:35.844739 15498 catalog_manager.cc:5697] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:35.846809 15599 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
W20260709 13:18:35.847015 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.851608 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.727272 19056 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.784439 19409 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:35.863905 15642 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:35.863170 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:35.870671 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 43867.2us
I20260709 13:18:35.897887 16265 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:35.775422 19120 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:18:35.896340 15677 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
W20260709 13:18:35.898890 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.858938 19275 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.853626 19047 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:35.896415 15594 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:35.903962 16265 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:35.778496 19309 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.908862 15597 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.917680 15748 raft_consensus.cc:2368] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10.
I20260709 13:18:35.918671 15746 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:35.924265 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:35.925115 15672 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.901158 19383 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:35.929091 15498 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:35.930280 15600 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:35.906340 15670 consensus_queue.cc:260] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.845201 19183 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.877326 19313 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:35.837097 19319 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.934365 16265 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:35.903574 19374 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:35.943662 15598 raft_consensus.cc:2376] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8. Re-sending same reply.
I20260709 13:18:35.974056 19313 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:35.975952 15674 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:35.877938 19366 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.976877 15498 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 8 to 9, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
W20260709 13:18:35.979534 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.946210 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:35.986411 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.975765 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.916086 19245 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.982455 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:35.992475 15594 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:35.983017 16308 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:35.869503 19260 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:35.906142 19278 consensus_queue.cc:1059] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:18:35.989126 15595 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:36.004527 15601 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:36.000656 19319 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.002048 19056 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:35.895138 19392 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.009754 16305 raft_consensus.cc:1240] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:35.981714 19304 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:36.006253 15596 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:35.918581 19234 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:18:35.907431 19201 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.945529 19047 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.989709 15498 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 6 to 7, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.025581 15595 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:36.026806 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:36.029953 19183 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:36.035111 19275 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.037361 19260 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:36.038496 19111 consensus_meta.cc:287] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:18:36.038920 19111 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.000660 19366 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.039989 19366 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:35.989223 19375 consensus_queue.cc:1048] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:18:36.042240 19001 consensus_meta.cc:287] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.000s
I20260709 13:18:36.042649 19001 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.039266 19414 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:36.045073 19111 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:36.054355 19201 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.055688 15498 catalog_manager.cc:5697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 1 to 7, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.057659 15498 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 5 to 6, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 6 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.070515 19261 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:35.988003 19218 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.080456 19218 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:36.082072 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:36.083688 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:36.086001 15599 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:18:35.669734 15496 rpcz_store.cc:269] 0709 13:18:17.724817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.725200 (+   383us) service_pool.cc:224] Handling call
0709 13:18:35.489014 (+17763814us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:31.597208 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:31.597851 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:31.597896 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:18:31.603580 (+  5684us) tablet.cc:662] Decoding operations
0709 13:18:31.638360 (+ 34780us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:31.638420 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:31.638450 (+    30us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:31.639183 (+   733us) tablet.cc:701] Row locks acquired
0709 13:18:31.639199 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:31.639353 (+   154us) write_op.cc:270] Start()
0709 13:18:31.639477 (+   124us) write_op.cc:276] Timestamp: P: 1783603111639303 usec, L: 0
0709 13:18:31.639498 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:31.640216 (+   718us) log.cc:844] Serialized 3190 byte log entry
0709 13:18:33.326856 (+1686640us) op_driver.cc:464] REPLICATION: finished
0709 13:18:33.561100 (+234244us) write_op.cc:301] APPLY: starting
0709 13:18:33.561183 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:33.561383 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:33.561507 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:33.574283 (+ 12776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:33.574495 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:18:33.574540 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:33.574813 (+   273us) log.cc:844] Serialized 65 byte log entry
0709 13:18:33.574994 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.575106 (+   112us) write_op.cc:454] Released schema lock
0709 13:18:33.575152 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:33.575510 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.575538 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4708130,"reported_tablets":28,"spinlock_wait_cycles":1010432,"child_traces":[["op",{"apply.queue_time_us":210134,"apply.run_cpu_time_us":3033,"apply.run_wall_time_us":14404,"num_ops":8,"prepare.queue_time_us":499271,"prepare.run_cpu_time_us":15524,"prepare.run_wall_time_us":471189,"raft.queue_time_us":824082,"raft.run_cpu_time_us":52575,"raft.run_wall_time_us":221045,"replication_time_us":1670575,"thread_start_us":1092673,"threads_started":4,"wal-append.queue_time_us":477264,"wal-append.run_cpu_time_us":12011,"wal-append.run_wall_time_us":2412272}]]}
W20260709 13:18:36.098469 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 351918us
I20260709 13:18:36.098771 15594 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:36.100168 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:36.102730 15595 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.059552 15498 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 5, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:36.121140 15594 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:36.027464 19319 raft_consensus.cc:3055] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:36.114946 16305 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 9: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:36.121752 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:36.105499 15640 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:36.025254 19304 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.128351 15672 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:36.134084 15594 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:18:36.138419 15594 pending_rounds.cc:85] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 7
I20260709 13:18:36.138774 15594 pending_rounds.cc:107] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:36.139051 15594 raft_consensus.cc:2889] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.134053 16304 pending_rounds.cc:85] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 7
W20260709 13:18:36.140962 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.141296 16304 pending_rounds.cc:107] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:18:36.141695 16304 raft_consensus.cc:2889] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.097570 19375 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:36.159489 15744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.010s	sys 0.046s
I20260709 13:18:36.130633 19319 raft_consensus.cc:740] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:36.176049 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:36.176789 15747 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.178612 15746 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:36.179884 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 784) took 1021 ms. Trace:
I20260709 13:18:36.139129 19304 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.156262 19414 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:36.185317 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:36.174897 15498 catalog_manager.cc:5697] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 6 to 7, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.189289 15597 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:36.186183 15750 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:36.164223 19275 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.205682 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:36.211562 15745 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.205778 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:36.213140 15751 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.205832 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:36.206519 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:36.115489 19291 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.164044 19260 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.222846 15743 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:36.229228 19433 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:36.229863 19433 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:36.230351 19433 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.114619 19409 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.244910 15593 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:36.247931 15745 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:36.209237 15498 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 5, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:36.260792 15747 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:36.264189 19260 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:36.265552 19434 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:36.180480 15744 rpcz_store.cc:276] 0709 13:18:35.158428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.158576 (+   148us) service_pool.cc:224] Handling call
0709 13:18:35.158868 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.159152 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:35.429244 (+270092us) log.cc:844] Serialized 14 byte log entry
0709 13:18:36.167870 (+738626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:36.167919 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:36.179583 (+ 11664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.179688 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.179815 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20201,"prepare.queue_time_us":337797,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":4591,"raft.queue_time_us":69395,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":9849,"thread_start_us":906688,"threads_started":3,"wal-append.queue_time_us":164709}
I20260709 13:18:36.261632 15751 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:36.270339 15498 catalog_manager.cc:5697] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 5, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 5 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:36.218873 19414 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:36.253029 19377 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:36.241047 19056 consensus_queue.cc:1059] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:36.221910 19275 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.296176 19427 raft_consensus.cc:3055] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:36.285687 19309 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.290060 19392 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:36.306736 15676 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.015s	sys 0.034s
W20260709 13:18:36.308449 15676 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.015s	sys 0.034s
W20260709 13:18:36.312106 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 397688us
I20260709 13:18:36.297230 19261 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:36.307132 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.014s	sys 0.042s
I20260709 13:18:36.317858 19392 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:36.325052 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.015s	sys 0.042s
I20260709 13:18:36.300066 19427 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:36.329775 15498 catalog_manager.cc:5697] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:36.328680 15567 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:36.333503 19427 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.334873 19427 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:36.337204 19234 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:36.337864 19234 raft_consensus.cc:697] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:36.339327 19374 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.338922 19234 consensus_queue.cc:237] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.341806 19275 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.342998 19291 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:36.347749 15596 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:36.348003 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:36.358131 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 428290us
I20260709 13:18:36.381788 15595 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:36.381877 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:36.383097 15565 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:36.392073 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:36.359935 15498 catalog_manager.cc:5697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 4 to 7, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:36.392174 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:36.402825 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:36.408876 15498 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 7 to 8, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 8 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:36.407250 19423 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:36.414822 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:36.381412 19120 consensus_queue.cc:1243] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:18:36.417591 15498 catalog_manager.cc:5697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } }
I20260709 13:18:36.419637 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:36.420081 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.419739 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:36.428098 15669 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:36.412751 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:36.421365 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:36.416937 15714 connection.cc:256] RPC call timeout handler was delayed by -2.5641604570000709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:18:36.429549 15714 connection.cc:256] RPC call timeout handler was delayed by -2.4210604570000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:18:36.430006 15714 connection.cc:256] RPC call timeout handler was delayed by -2.4210604570000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:18:36.430392 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3931604570000218s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1706s for a response
W20260709 13:18:36.430753 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3589604569999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:18:36.431109 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3490604569999505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:18:36.431500 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1609604570001011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
W20260709 13:18:36.432147 15714 connection.cc:256] RPC call timeout handler was delayed by -2.0943604569999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20379999999999998s for a response
W20260709 13:18:36.432531 15714 connection.cc:256] RPC call timeout handler was delayed by -2.0700604569999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:18:36.432920 15714 connection.cc:256] RPC call timeout handler was delayed by -1.9863604570000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:18:36.441994 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:36.459223 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.416172 19201 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:36.393714 19261 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:18:36.420327 19374 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:36.498365 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:36.521621 15677 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.009s	sys 0.034s
W20260709 13:18:36.521868 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 685468us
I20260709 13:18:36.485553 19260 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:36.502702 19436 log.cc:927] Time spent T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:18:36.529683 15677 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.009s	sys 0.034s
I20260709 13:18:36.383313 19414 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.503754 19374 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:36.542407 15598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.015s	sys 0.028s
W20260709 13:18:36.542940 15598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.015s	sys 0.028s
W20260709 13:18:36.528206 19443 log.cc:927] Time spent T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:18:36.520239 19201 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:36.585973 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:36.592433 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.571801 19374 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:36.593391 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 179465us
I20260709 13:18:36.604676 19442 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:36.582016 19260 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.608650 15642 leader_election.cc:336] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.129s (SENT)
I20260709 13:18:36.609299 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:36.610692 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:36.614631 16263 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:36.605577 19383 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.618346 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:36.624945 16305 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:36.618623 19383 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.570582 19444 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 13:18:36.636348 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 54517.1us
I20260709 13:18:36.637245 16263 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:36.576737 19433 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.623565 19260 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.624258 19111 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:18:36.633932 19404 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:36.650908 19404 raft_consensus.cc:697] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:36.650494 19319 consensus_queue.cc:260] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.651095 19260 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.651849 19319 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:36.613716 19218 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:18:36.652809 19201 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.623790 19375 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:18:36.661335 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52760.8us
I20260709 13:18:36.664945 15670 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:36.665781 15714 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:36.669701 19438 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:36.671005 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1751) took 1143 ms. Trace:
I20260709 13:18:36.671520 15600 rpcz_store.cc:276] 0709 13:18:35.527202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.530944 (+  3742us) service_pool.cc:224] Handling call
0709 13:18:35.583001 (+ 52057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.946865 (+363864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.670674 (+723809us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54002d78d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:36.670900 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798232320}
I20260709 13:18:36.675993 19047 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.606451 19291 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:18:36.677254 19377 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.677937 19377 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:36.668365 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:36.623278 19442 raft_consensus.cc:697] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:36.642406 19409 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:36.651878 19404 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.701409 19409 raft_consensus.cc:697] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:36.677307 19313 consensus_meta.cc:287] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.680s	user 0.010s	sys 0.001s
I20260709 13:18:36.680922 18693 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:36.706974 15670 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:18:36.709457 15670 pending_rounds.cc:85] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 6
I20260709 13:18:36.709867 15670 pending_rounds.cc:107] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:18:36.710421 15670 raft_consensus.cc:2889] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.693249 19438 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:36.727716 19383 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.747507 16265 leader_election.cc:400] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10.
I20260709 13:18:36.747977 16265 leader_election.cc:403] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.748231 15751 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:36.748584 19111 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.748824 15751 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:36.749212 19111 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.749899 15751 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.751195 15751 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:36.751533 19111 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:36.747612 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:36.753510 15750 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.754438 19001 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.757822 19183 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.763650 15743 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:36.765113 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:36.765403 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:36.765926 15743 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:36.766254 15744 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.767280 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:36.769318 15747 raft_consensus.cc:1240] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:36.769585 15748 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:36.772365 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:36.776871 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:36.782307 15750 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:36.712770 19438 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:36.711675 19313 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:36.802239 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54938.2us
I20260709 13:18:36.805364 16308 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 884) took 1099 ms. Trace:
I20260709 13:18:36.838536 15745 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:18:36.807191 15671 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:36.838949 15745 pending_rounds.cc:85] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 3
I20260709 13:18:36.839234 15745 pending_rounds.cc:107] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:18:36.839164 15671 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:36.839671 15745 raft_consensus.cc:2889] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:36.807585 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 97198.3us
I20260709 13:18:36.722138 19409 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.827733 15751 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:36.837895 16308 rpcz_store.cc:276] 0709 13:18:35.705834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.749121 (+ 43287us) service_pool.cc:224] Handling call
0709 13:18:35.790018 (+ 40897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:35.993490 (+203472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.805027 (+811537us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54005c0154. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:36.805285 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433406848}
I20260709 13:18:36.863662 19440 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.864992 19458 log.cc:927] Time spent T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:18:36.864526 19440 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.866561 19374 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.867373 19440 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:36.869225 19456 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:36.871253 19433 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:36.873410 19457 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:36.875581 19313 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:36.876689 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1757) took 1038 ms. Trace:
I20260709 13:18:36.877214 15597 rpcz_store.cc:276] 0709 13:18:35.838716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.206719 (+368003us) service_pool.cc:224] Handling call
0709 13:18:36.206998 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.207323 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.207351 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.220105 (+ 12754us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.672637 (+452532us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:36.672677 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.672743 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.876369 (+203626us) raft_consensus.cc:1685] finished
0709 13:18:36.876398 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.876616 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33064,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":442450,"threads_started":1,"wal-append.queue_time_us":571229}
I20260709 13:18:36.879959 15744 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:36.799177 19442 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:36.893005 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.892500 19440 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:36.896927 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:36.897719 15743 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:36.898375 19260 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.898869 19260 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.880359 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:36.881775 19375 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:36.885530 19383 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:36.844947 19438 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.834723 19275 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.890288 15671 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:36.890818 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:36.844703 19261 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.900972 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:36.901329 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52654.8us
I20260709 13:18:36.933197 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:36.936997 16265 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:36.938282 16265 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:36.940230 15565 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.005s	sys 0.033s
W20260709 13:18:36.941401 15565 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.005s	sys 0.033s
W20260709 13:18:36.946163 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.956255 15671 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:36.931978 19433 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:36.959297 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 332798us
I20260709 13:18:36.960734 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:36.949921 19218 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:36.986758 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 96011.3us
I20260709 13:18:36.934701 19291 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:36.986007 19195 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:36.959332 19439 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:36.947633 19261 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:36.947384 19275 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.004844 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:36.965471 19433 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:37.004833 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.007020 15597 raft_consensus.cc:2410] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:18:37.007926 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.982717 19454 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:36.982935 19374 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:37.004151 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:36.990006 19446 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.022081 15671 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:36.999899 19195 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:36.996687 19047 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.028740 19195 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:37.028920 19047 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.029604 19319 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:37.030717 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:37.031680 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:37.032253 15743 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.032066 19120 consensus_queue.cc:1059] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:37.033378 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.034868 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:37.035660 19446 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.025954 15671 pending_rounds.cc:85] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 5
I20260709 13:18:37.027778 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.037199 15670 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:36.988950 19260 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.038071 15671 pending_rounds.cc:107] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:37.038492 15671 raft_consensus.cc:2889] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:37.039316 15597 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:37.039340 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2237) took 1215 ms. Trace:
I20260709 13:18:37.040046 15743 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:37.040552 15669 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:37.038817 15565 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:36.985664 19383 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:18:37.040138 15671 rpcz_store.cc:276] 0709 13:18:35.823771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.824084 (+   313us) service_pool.cc:224] Handling call
0709 13:18:35.824405 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:36.807087 (+982682us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540015caa0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe667dc0 00007faefe6f21c0 00007faefe6f3231 00007faefe6efd8f 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c
0709 13:18:36.955776 (+148689us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b58006473d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe64c0aa 00007faefe6ce447 00007faefe6e6fe7 00007faefe6e87de 00007faefe6f2b49 00007faefe6f3416 00007faefe6efd8f 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4
0709 13:18:37.039044 (+ 83268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.039268 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411821312}
I20260709 13:18:37.042593 15595 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:37.042495 15599 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:37.045945 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.051883 15668 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.046854 19260 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:37.047564 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:37.010459 19433 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:37.056344 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:36.986158 19278 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:18:37.048012 19195 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:37.053112 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 43660.2us
W20260709 13:18:37.057667 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.014456 19111 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:37.014909 19375 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.057041 15676 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:37.069849 19404 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:37.052842 19302 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:18:37.064323 15670 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:37.059890 19427 consensus_meta.cc:287] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.006s
W20260709 13:18:37.112316 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45995.8us
I20260709 13:18:37.056114 19260 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.125268 19448 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:37.135353 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 473095us
I20260709 13:18:37.075357 19374 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:18:37.142833 15596 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:37.055058 19460 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:18:37.133051 19375 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:37.126531 19111 raft_consensus.cc:697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:37.133170 19392 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:18:37.146036 19183 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10.
W20260709 13:18:37.133865 19304 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.909s	user 0.007s	sys 0.006s
I20260709 13:18:37.130671 19260 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:37.051138 19454 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:37.102015 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.118629 19404 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:37.174506 15642 leader_election.cc:336] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.879s (SENT)
I20260709 13:18:37.195127 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:37.199793 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 261550us
I20260709 13:18:37.200732 16265 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:37.201574 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 236399us
W20260709 13:18:37.205714 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 65234.4us
W20260709 13:18:37.213940 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 156406us
I20260709 13:18:37.214779 16308 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.171784 19304 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.210402 19183 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.216645 19218 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:37.236027 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2238) took 1394 ms. Trace:
I20260709 13:18:37.210114 19291 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:18:37.236500 15677 rpcz_store.cc:276] 0709 13:18:35.841177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.907390 (+ 66213us) service_pool.cc:224] Handling call
0709 13:18:35.907853 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.583028 (+675175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.583064 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.625609 (+ 42545us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.998650 (+373041us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:36.998703 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.998798 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.235788 (+236990us) raft_consensus.cc:1685] finished
0709 13:18:37.235817 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.235966 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13404,"raft.queue_time_us":132503,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":233,"thread_start_us":910862,"threads_started":2,"wal-append.queue_time_us":532340}
I20260709 13:18:37.237962 15668 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:37.230796 19183 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:37.239794 19183 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.242189 19446 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.243405 16295 raft_consensus.cc:1240] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:37.253772 19414 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:37.254269 16304 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:37.255415 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.261693 15593 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:37.256563 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 82097.4us
I20260709 13:18:37.261785 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:37.257354 19453 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:18:37.260429 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:37.274349 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:37.295904 15642 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.235s (SENT)
I20260709 13:18:37.281661 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:37.293620 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:37.307457 15677 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:37.311007 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:37.284423 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:37.283716 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 77266.9us
I20260709 13:18:37.319921 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.324065 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:37.325686 15593 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:37.323745 15565 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:37.317322 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:37.333554 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:37.281391 19439 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.339988 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 65739.3us
I20260709 13:18:37.334232 15676 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:37.292246 19309 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.333417 19392 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:37.217983 19111 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.346135 19392 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.346726 19392 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:37.279868 19414 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.348874 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:37.345191 19309 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.349539 15593 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.281603 19120 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.225246 19375 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.283506 19427 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.365453 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 69607.1us
I20260709 13:18:37.366381 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:37.376893 15668 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:37.377593 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:37.380231 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.380929 15669 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.384532 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:37.391280 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.393009 15669 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:37.403659 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.403908 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.404496 15673 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:37.404505 15669 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:37.333455 19302 raft_consensus.cc:3055] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:37.281490 19442 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:18:37.309759 19446 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:18:37.356148 19286 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:37.434460 15670 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:37.451874 15669 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:37.381798 19427 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.362550 19453 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.475713 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 145507us
I20260709 13:18:37.422616 19302 raft_consensus.cc:740] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:37.491410 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.492419 15676 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:37.447273 19286 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.410620 19120 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.445914 19482 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:37.356762 19439 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.464231 19414 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.502849 15593 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:37.502781 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.530854 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.533500 16304 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:37.516252 19286 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.516527 19454 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.502049 19496 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.550540 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.551818 15671 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:37.552160 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.526677 19482 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.533277 19111 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:37.554401 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.535506 19404 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:37.569151 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.462817 19218 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.575676 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:37.566198 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.570948 19492 consensus_queue.cc:1059] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:37.576336 15676 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.555382 19452 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.469614 19453 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.584223 15593 raft_consensus.cc:1240] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:18:37.564069 19482 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:37.595927 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 119359us
W20260709 13:18:37.587949 19463 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:18:37.600054 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.597630 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:37.593809 19477 log.cc:927] Time spent T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.348s	user 0.001s	sys 0.001s
I20260709 13:18:37.585201 19461 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:37.634294 16306 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:37.576771 19111 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.576741 19496 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:37.633093 19377 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.955s	user 0.011s	sys 0.005s
I20260709 13:18:37.639122 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:37.588865 19452 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.658967 19489 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:18:37.635794 19427 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:37.651727 19484 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:18:37.585816 19302 consensus_queue.cc:260] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:37.673244 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 355977us
W20260709 13:18:37.720096 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.678455 16295 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
W20260709 13:18:37.722095 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 62828us
I20260709 13:18:37.658660 19120 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:37.725957 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.726797 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:37.664294 19111 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:37.662367 19439 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:37.665067 19483 log.cc:927] Time spent T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:18:37.733490 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.649616 19480 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:37.726996 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.727586 15747 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:37.657640 19304 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.743418 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:37.660486 19404 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:37.742139 15602 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:37.742205 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 602) took 2013 ms. Trace:
I20260709 13:18:37.742678 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:37.667102 19438 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.719s	user 0.010s	sys 0.002s
I20260709 13:18:37.657624 19461 raft_consensus.cc:697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:37.745081 15749 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.749329 15601 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.660214 19481 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:37.746862 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.751892 16265 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:37.749084 15598 rpcz_store.cc:276] 0709 13:18:35.728876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.988306 (+259430us) service_pool.cc:224] Handling call
0709 13:18:36.006618 (+ 18312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.543372 (+536754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.543419 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.579415 (+ 35996us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.950425 (+371010us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:36.950477 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.950580 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.742021 (+791441us) raft_consensus.cc:1685] finished
0709 13:18:37.742040 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.742154 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28931,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":875315,"threads_started":2,"wal-append.queue_time_us":572800}
W20260709 13:18:37.740159 19433 consensus_meta.cc:287] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.005s
I20260709 13:18:37.672775 19309 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.678695 19291 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.750968 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.750488 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.719658 19427 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.673308 19509 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:37.740079 19260 consensus_meta.cc:287] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.567s	user 0.005s	sys 0.005s
I20260709 13:18:37.758268 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:37.761128 15673 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:37.731935 19302 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:37.751622 15716 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:37.657061 19377 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.765431 16306 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:37.804839 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.805533 15599 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:37.766458 15748 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:37.732051 19440 raft_consensus.cc:3055] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:37.808097 15749 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:37.757436 19438 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.769392 19291 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.764379 19433 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.785465 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.748086 19480 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.747684 19392 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.739225 19492 consensus_queue.cc:1059] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:18:37.797089 19461 consensus_queue.cc:237] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.804098 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.828564 15598 raft_consensus.cc:2393] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 11: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:37.748656 19404 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:37.764887 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:37.769392 19427 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.807864 19440 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:37.840070 16305 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:37.821239 15676 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:37.741683 19439 consensus_queue.cc:1059] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:37.823563 15600 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:37.829396 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 77864.3us
I20260709 13:18:37.801092 19260 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.762482 19481 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:37.863564 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 43642.4us
I20260709 13:18:37.836369 19404 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.841375 19517 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:37.850896 19479 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:37.882638 19517 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.887051 19453 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.893988 15598 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:37.881336 19515 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:37.909729 19517 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:37.889206 19479 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.935894 19516 raft_consensus.cc:3055] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:37.936911 19260 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.914786 19452 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.946111 19447 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:37.946787 19447 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.948441 19433 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.953032 19496 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.958828 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:37.916905 19440 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.975056 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.975623 15565 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:37.920994 19515 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:37.959589 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.978287 19195 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.978526 16306 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:37.978477 19515 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.960531 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.970664 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:37.983769 19454 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.984316 19377 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.984510 19507 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.985499 19275 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.986407 19261 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.984368 19454 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:37.988479 19454 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.971446 19438 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:37.985137 19507 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.965560 19480 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:37.970235 19291 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.982779 19479 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:37.958828 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:37.975927 15593 raft_consensus.cc:2368] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8.
I20260709 13:18:37.996743 15601 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:37.993110 15565 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:37.951869 19286 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.972095 19427 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:38.002595 19261 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:38.003216 19261 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.003667 19261 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:37.998417 19500 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.005474 19500 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.936470 19516 raft_consensus.cc:740] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:38.010219 19516 consensus_queue.cc:260] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:37.962304 19392 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:38.013614 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:38.014781 19260 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.014822 15598 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 13: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:38.028155 16308 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:38.028472 19479 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:38.000864 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:38.036559 15672 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:18:38.040581 19486 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.500s	user 0.000s	sys 0.002s
I20260709 13:18:38.039685 19482 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.047046 15600 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:38.047302 19481 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:38.052997 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:38.057449 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 56704.7us
I20260709 13:18:38.058997 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:38.059638 16263 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:38.077770 19496 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:38.044862 19516 raft_consensus.cc:3060] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:38.095280 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:38.095537 15642 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.633s (SENT)
I20260709 13:18:38.095952 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:38.097549 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:38.099540 19465 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.050256 19286 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:38.103693 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.060389 19481 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.078472 19496 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:38.116350 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:38.035148 19260 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:38.131400 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:38.092013 19480 raft_consensus.cc:2804] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:38.136927 16295 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:38.138263 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:38.101631 19377 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:18:38.138813 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 387107us
W20260709 13:18:38.141691 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 376862us
I20260709 13:18:38.144807 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:38.147912 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:38.130295 19302 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:38.149104 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:38.136050 19462 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:38.149204 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:38.149932 15716 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:38.138743 19392 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:38.148406 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:38.170015 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:38.171696 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:38.173215 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:38.175060 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 95786us
I20260709 13:18:38.181412 16299 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
W20260709 13:18:38.181573 15642 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.424s (SENT)
I20260709 13:18:38.182039 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:38.141058 19501 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.140182 19507 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:38.179430 16265 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:38.179592 15742 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:18:38.143190 19480 raft_consensus.cc:697] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:38.100121 19465 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.156471 19383 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.156272 19482 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:38.196079 19479 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.196801 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:38.197214 15747 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:38.197890 19524 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:38.198132 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:38.198696 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:38.198827 15747 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:38.200314 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:38.201252 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:38.198278 19465 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:38.193032 19501 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.204543 16265 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:38.204927 19510 raft_consensus.cc:2764] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:18:38.205540 19479 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:38.205988 19479 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.206300 19515 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:38.204766 19465 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:18:38.206664 19479 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.206882 19515 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:38.208210 15746 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:38.207844 19515 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:38.212235 19465 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:38.180310 19392 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.197929 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:38.174561 19493 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.210007 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:38.191444 19427 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.210999 19532 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:38.150527 19481 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:38.190712 15742 pending_rounds.cc:85] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 7
I20260709 13:18:38.204342 16299 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:38.185839 19286 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.222950 16304 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:38.257009 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 47091.5us
I20260709 13:18:38.209630 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:38.220165 19392 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.205850 19510 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:38.227874 19501 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:38.230731 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.198314 19491 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:38.258116 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:38.205721 19496 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:38.258706 15742 pending_rounds.cc:107] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:18:38.278386 15742 raft_consensus.cc:2889] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:38.191398 19377 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:38.262208 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:38.192586 19439 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:38.259850 19492 raft_consensus.cc:2764] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:38.232780 19427 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:38.219352 19404 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.257073 19493 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.262854 19513 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:38.312693 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:38.771251 15747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.037s	sys 0.028s
W20260709 13:18:38.943367 15747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.044s	sys 0.035s
I20260709 13:18:38.834491 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:38.772248 15748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.007s	sys 0.027s
W20260709 13:18:38.944463 15748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.008s	sys 0.037s
W20260709 13:18:38.473626 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 251716us
W20260709 13:18:38.910459 19516 consensus_meta.cc:287] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.808s	user 0.011s	sys 0.001s
I20260709 13:18:38.265811 19510 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:38.475646 19517 consensus_meta.cc:287] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.003s
W20260709 13:18:38.931517 15668 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.010s
W20260709 13:18:38.951701 15668 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.005s	sys 0.010s
W20260709 13:18:38.575248 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.720161 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:38.763022 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 504972us
I20260709 13:18:38.946115 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:38.950996 15742 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 5.
I20260709 13:18:38.954102 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:38.955021 15742 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:38.956405 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:38.890944 19547 log.cc:927] Time spent T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
W20260709 13:18:38.899047 19261 consensus_meta.cc:287] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.895s	user 0.008s	sys 0.004s
W20260709 13:18:38.797581 19535 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:18:38.797907 19479 consensus_meta.cc:287] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:18:38.973089 19462 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:38.973179 19479 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.973745 19462 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:38.975533 19479 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:38.966723 19517 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.978461 19517 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:38.966753 19454 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:38.979455 19454 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.981575 19454 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:38.983165 19523 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 1.051s	user 0.000s	sys 0.001s
I20260709 13:18:38.982820 19462 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.985469 19462 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:38.790246 19543 log.cc:927] Time spent T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
W20260709 13:18:38.593358 19530 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:18:38.791059 19538 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:38.970459 16305 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:38.787680 19302 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:38.941936 19427 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:38.971117 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.971776 19047 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:38.999392 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:39.000751 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 43736.3us
I20260709 13:18:39.002203 15567 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:39.005110 19501 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:18:38.868934 19524 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:38.988884 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 628) took 1100 ms. Trace:
I20260709 13:18:38.306131 19377 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:38.773797 19446 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:38.951324 19510 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:38.708461 19260 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:38.322903 19480 consensus_queue.cc:237] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:38.986668 19440 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:18:39.006268 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.007305 15714 leader_election.cc:400] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9.
I20260709 13:18:38.972080 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.033092 15742 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:39.034021 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.034340 15567 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:39.008626 15743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.013s	sys 0.044s
I20260709 13:18:38.317822 19438 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:39.008711 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:39.010507 15599 rpcz_store.cc:276] 0709 13:18:37.888111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.888310 (+   199us) service_pool.cc:224] Handling call
0709 13:18:37.910649 (+ 22339us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:18:37.922055 (+ 11406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.922102 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:37.935224 (+ 13122us) log.cc:844] Serialized 78 byte log entry
0709 13:18:38.162046 (+226822us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:38.162103 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.162216 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:38.988663 (+826447us) raft_consensus.cc:1685] finished
0709 13:18:38.988681 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:38.988824 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7380,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8541,"thread_start_us":171377,"threads_started":1,"wal-append.queue_time_us":397536}
I20260709 13:18:39.014379 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 669) took 1635 ms. Trace:
W20260709 13:18:39.025452 19392 consensus_meta.cc:287] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.001s
I20260709 13:18:38.993047 19261 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:39.061703 15743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.014s	sys 0.044s
I20260709 13:18:39.008265 19501 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:39.080684 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.041285 15674 rpcz_store.cc:276] 0709 13:18:37.379281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.379433 (+   152us) service_pool.cc:224] Handling call
0709 13:18:37.379762 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.494526 (+114764us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:37.537846 (+ 43320us) log.cc:844] Serialized 14 byte log entry
0709 13:18:37.973530 (+435684us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b18003a6360. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe29023a 00007faefe6faa2a
0709 13:18:38.275174 (+301644us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.302750 (+ 27576us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.302891 (+   141us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:38.302927 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.302995 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.006647 (+703652us) raft_consensus.cc:1685] finished
0709 13:18:39.014154 (+  7507us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.014312 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41589,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":152264,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":42257,"spinlock_wait_cycles":6899456,"thread_start_us":393329,"threads_started":2,"wal-append.queue_time_us":1444733}
I20260709 13:18:39.089778 15742 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
W20260709 13:18:39.011734 19504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.009s	sys 0.007s
I20260709 13:18:39.082499 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.015493 19377 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.091481 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 830) took 1349 ms. Trace:
W20260709 13:18:39.096136 19499 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 1.428s	user 0.005s	sys 0.010s
I20260709 13:18:39.093619 15750 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:39.095150 15745 rpcz_store.cc:276] 0709 13:18:37.741971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.747377 (+  5406us) service_pool.cc:224] Handling call
0709 13:18:37.764261 (+ 16884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.816349 (+ 52088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.816370 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.828095 (+ 11725us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.132933 (+304838us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:38.132990 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.134018 (+  1028us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.091240 (+957222us) raft_consensus.cc:1685] finished
0709 13:18:39.091267 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.091422 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62354,"raft.queue_time_us":70346,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5397,"thread_start_us":261415,"threads_started":1,"wal-append.queue_time_us":632913}
I20260709 13:18:39.098489 15745 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:18:39.100950 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 93753.9us
I20260709 13:18:39.101703 19433 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:39.101914 15745 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:39.102550 16308 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:18:39.092792 19501 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.107334 19447 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.108129 19447 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:39.111546 19514 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:39.112046 19514 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:39.117687 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:39.120678 16308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:39.092348 15751 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:39.121534 16308 raft_consensus.cc:606] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.122210 19493 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.123210 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:39.124001 16299 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.129182 19500 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.088073 19392 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.131844 15596 raft_consensus.cc:2393] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:39.101703 15714 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:39.007721 19302 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:39.146425 16305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 888) took 1137 ms. Trace:
I20260709 13:18:39.146994 16305 rpcz_store.cc:276] 0709 13:18:38.009044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.045272 (+ 36228us) service_pool.cc:224] Handling call
0709 13:18:38.045602 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.993002 (+947400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.146121 (+153119us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400600254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:39.146351 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126357760}
I20260709 13:18:39.148278 19302 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.030647 19446 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.151584 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 665) took 1775 ms. Trace:
I20260709 13:18:39.152124 15672 rpcz_store.cc:276] 0709 13:18:37.376305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.376416 (+   111us) service_pool.cc:224] Handling call
0709 13:18:37.376780 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.037215 (+660435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.151233 (+1114018us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54000852d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:39.151500 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516555648}
I20260709 13:18:39.159713 19427 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:39.080426 19491 consensus_meta.cc:287] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.796s	user 0.013s	sys 0.000s
I20260709 13:18:39.132664 16299 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:39.137194 15750 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:39.140515 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:39.142103 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.195883 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.143086 19392 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.144268 19404 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:39.081871 19461 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.015686 19524 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.133199 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:39.160359 15746 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:39.167990 19513 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:39.168817 19447 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.213274 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2402) took 1069 ms. Trace:
I20260709 13:18:39.193233 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:39.219059 16304 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:39.206023 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:39.180450 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:39.210901 16299 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:39.211416 19546 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.123s	user 0.000s	sys 0.003s
W20260709 13:18:39.212215 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 110588us
I20260709 13:18:39.150913 19446 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:39.186872 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52067.2us
W20260709 13:18:39.216519 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.216570 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:39.212735 19466 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 1.990s	user 0.004s	sys 0.005s
I20260709 13:18:39.223551 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:39.212668 19440 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:18:39.221783 19472 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.853s	user 0.000s	sys 0.013s
I20260709 13:18:39.217656 15749 rpcz_store.cc:276] 0709 13:18:38.144339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.144751 (+   412us) service_pool.cc:224] Handling call
0709 13:18:38.145191 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.149816 (+  4625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.149846 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.150297 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.404294 (+253997us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:38.426380 (+ 22086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.426584 (+   204us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.213057 (+786473us) raft_consensus.cc:1685] finished
0709 13:18:39.213079 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.213217 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4907,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":19456,"thread_start_us":174842,"threads_started":1,"wal-append.queue_time_us":892623}
I20260709 13:18:39.277627 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:39.277992 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:39.278807 15749 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:39.212507 19552 log.cc:927] Time spent T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.003s
W20260709 13:18:39.230883 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 137523us
I20260709 13:18:39.288748 19481 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:39.288906 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:39.289515 15599 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:39.289345 19481 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:18:39.213292 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 267322us
I20260709 13:18:39.291731 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:39.292339 15750 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.200472 19461 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:39.213605 19559 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
I20260709 13:18:39.208334 19491 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:39.240161 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 617) took 1992 ms. Trace:
I20260709 13:18:39.296756 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:39.297207 15597 rpcz_store.cc:276] 0709 13:18:37.248083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.248210 (+   127us) service_pool.cc:224] Handling call
0709 13:18:37.250680 (+  2470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.251080 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.251127 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:37.884471 (+633344us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b2c000014c8. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefcfe9a11 00007faefcff9372 00007faefe72ba01 00007faefe6f043a 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2
0709 13:18:37.885373 (+   902us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.102321 (+216948us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:38.102361 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.102442 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.222498 (+1120056us) raft_consensus.cc:1685] finished
0709 13:18:39.222535 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.240095 (+ 17560us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":903,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":19246336,"thread_start_us":184991,"threads_started":1,"wal-append.queue_time_us":579701}
I20260709 13:18:39.246034 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:39.212924 19513 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.204675 19302 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.254711 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 50384.3us
W20260709 13:18:39.307314 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 75600.2us
I20260709 13:18:39.206748 19111 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:39.225214 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:39.256366 15674 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:39.215505 19509 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.259872 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.281158 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 667) took 1902 ms. Trace:
I20260709 13:18:39.281616 15670 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:39.277009 19440 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:39.288120 15567 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:39.256800 19392 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:39.290977 19521 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:39.309804 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:39.318341 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 58571.6us
I20260709 13:18:39.319480 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:39.316865 19111 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.323364 19234 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:39.216879 19514 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.344494 19111 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.323745 19427 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:39.345521 19504 consensus_queue.cc:1175] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "398beb97ee4b40688f6279f18fa51ade" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:39.346813 19446 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:39.347252 19446 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.347599 19446 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.344391 19234 raft_consensus.cc:697] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:39.350999 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:39.356966 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:39.317366 15668 rpcz_store.cc:276] 0709 13:18:37.378696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.378843 (+   147us) service_pool.cc:224] Handling call
0709 13:18:37.379157 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:37.404752 (+ 25595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.404857 (+   105us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:37.405402 (+   545us) log.cc:844] Serialized 52 byte log entry
0709 13:18:38.323210 (+917808us) spinlock_profiling.cc:243] Waited 8.47 ms on lock 0x7b18003cdc00. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefe2984bc 00007faefb5e648b 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1
0709 13:18:38.323411 (+   201us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:38.952133 (+628722us) log.cc:844] Serialized 14 byte log entry
0709 13:18:39.095824 (+143691us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b240010d048. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb4899c4 00007faefb487acb 00007faefb642dc9 00007faefb642a55 00007faefb64209d 00007faefe27410e 00007faefe28b88c 00007faefe28abb6 00007faefe28a7d8 00007faefe294221
0709 13:18:39.209017 (+113193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.209128 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.280955 (+ 71827us) raft_consensus.cc:1685] finished
0709 13:18:39.280974 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.281102 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7047,"prepare.queue_time_us":676533,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":270102,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":19818,"spinlock_wait_cycles":40151168,"thread_start_us":997399,"threads_started":4,"wal-append.queue_time_us":190535}
W20260709 13:18:39.326763 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 101651us
I20260709 13:18:39.319967 19438 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:39.294059 19461 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.329738 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 841) took 1119 ms. Trace:
I20260709 13:18:39.331151 19562 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:39.360822 15743 rpcz_store.cc:276] 0709 13:18:38.210324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.216929 (+  6605us) service_pool.cc:224] Handling call
0709 13:18:38.257664 (+ 40735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.280625 (+ 22961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.280670 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.308226 (+ 27556us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.084307 (+776081us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:39.084351 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.084425 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.329485 (+245060us) raft_consensus.cc:1685] finished
0709 13:18:39.329504 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.329659 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2145,"raft.queue_time_us":59493,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":119,"thread_start_us":599361,"threads_started":1,"wal-append.queue_time_us":744519}
I20260709 13:18:39.331331 19510 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:39.222174 19447 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.334563 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:39.381336 15670 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:39.334643 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:39.338353 19548 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:18:39.321936 19440 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:39.339336 16263 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:39.384825 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:39.390117 15672 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:39.390166 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:39.390506 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 51246.8us
I20260709 13:18:39.387070 15567 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:39.391650 16263 leader_election.cc:400] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8.
I20260709 13:18:39.392052 16263 leader_election.cc:403] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:39.391767 15567 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.392838 19462 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:39.392927 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:39.393564 19462 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.340343 19536 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:39.394114 19462 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.341866 19291 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:39.345191 19514 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.397220 16263 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:39.399243 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2406) took 1213 ms. Trace:
I20260709 13:18:39.399750 15747 rpcz_store.cc:276] 0709 13:18:38.186060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.199565 (+ 13505us) service_pool.cc:224] Handling call
0709 13:18:38.199900 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.200274 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.200309 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.202131 (+  1822us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.944052 (+741921us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:38.944112 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.944215 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.399019 (+454804us) raft_consensus.cc:1685] finished
0709 13:18:39.399053 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.399185 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5406,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":741454,"threads_started":1,"wal-append.queue_time_us":954836}
I20260709 13:18:39.350835 19234 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.351776 19201 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:39.333667 19302 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.354326 19481 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:39.327503 19490 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:39.357684 15675 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
W20260709 13:18:39.359921 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.380260 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:39.382040 16304 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:39.426249 15677 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.382687 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:39.426638 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:39.390801 15674 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:39.300501 15749 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:39.363348 19562 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:39.366366 19319 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:39.383543 19499 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:39.420239 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.414309 15750 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:39.363193 19564 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:39.423044 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:39.437666 15668 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:39.416635 15670 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:39.336444 19392 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.447171 19392 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:39.449056 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:39.441381 19490 raft_consensus.cc:697] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:39.450559 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:39.451195 15673 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:39.421244 19465 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:39.451188 19490 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.454095 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 840) took 1244 ms. Trace:
I20260709 13:18:39.454193 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.454586 15746 rpcz_store.cc:276] 0709 13:18:38.209253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.209354 (+   101us) service_pool.cc:224] Handling call
0709 13:18:39.453915 (+1244561us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54003048d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:39.454031 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073894656}
I20260709 13:18:39.454972 15743 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:39.456281 19427 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:39.456934 19427 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.407711 19517 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8.
I20260709 13:18:39.432587 16265 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:39.433954 15747 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:39.404460 19454 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.461162 19533 raft_consensus.cc:2764] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:18:39.563575 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 181023us
I20260709 13:18:39.564502 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.446362 19510 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:39.429212 19480 consensus_queue.cc:1059] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 13:18:39.378993 19491 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:18:39.581179 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.463120 15746 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:39.475126 16304 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:39.489699 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:39.497421 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 189342us
I20260709 13:18:39.478554 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:39.508983 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 216136us
I20260709 13:18:39.408233 19218 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:39.486912 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:39.584170 15670 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:39.431835 19446 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.419555 19565 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:39.417572 19278 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:39.421002 19183 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:39.536584 15677 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:39.439321 19562 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:39.539516 15673 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:39.542804 15672 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:39.470642 15675 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:39.335865 19509 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.389259 19047 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
W20260709 13:18:39.573760 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 141245us
I20260709 13:18:39.611227 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:39.611837 15670 raft_consensus.cc:2410] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:18:39.611896 15674 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
W20260709 13:18:39.612838 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 206988us
I20260709 13:18:39.613444 16265 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:39.575593 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 842) took 1365 ms. Trace:
I20260709 13:18:39.429242 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.477588 19501 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:39.597021 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1756) took 3752 ms. Trace:
I20260709 13:18:39.587409 19111 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:39.629521 16265 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:39.619669 15749 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:39.614642 15716 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:39.615278 15744 rpcz_store.cc:276] 0709 13:18:38.210634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.223866 (+ 13232us) service_pool.cc:224] Handling call
0709 13:18:38.231563 (+  7697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:38.383958 (+152395us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:38.401690 (+ 17732us) log.cc:844] Serialized 14 byte log entry
0709 13:18:38.401896 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:38.401956 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:38.402016 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.977525 (+575509us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b1800359920. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:39.337384 (+359859us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b1800359920. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5d12a6 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419
0709 13:18:39.575345 (+237961us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540030edd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:39.575391 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.575528 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17545,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":17596,"raft.queue_time_us":20156,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":608843648}
I20260709 13:18:39.459915 19564 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:39.625670 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:39.593930 19515 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.580360 19504 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:39.568832 19454 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.621999 15594 rpcz_store.cc:276] 0709 13:18:35.838471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.161155 (+322684us) service_pool.cc:224] Handling call
0709 13:18:36.660759 (+499604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.692104 (+ 31345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.692143 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.692801 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:18:37.119536 (+426735us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:37.119575 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.119652 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.150338 (+2030686us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:39.401612 (+251274us) raft_consensus.cc:1685] finished
0709 13:18:39.401641 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.590357 (+188716us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54001013d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:39.590479 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30862,"raft.queue_time_us":31000,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"spinlock_wait_cycles":1204259584,"thread_start_us":395385,"threads_started":1,"wal-append.queue_time_us":519457}
I20260709 13:18:39.645789 16265 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:39.595636 19524 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.621115 19438 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:39.658815 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.659567 19479 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:39.643597 19516 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:39.644872 19489 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:39.675329 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:39.673164 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 259661us
I20260709 13:18:39.649163 19183 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:39.609428 19571 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:18:39.654210 19111 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:39.652181 19480 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:18:39.698405 16295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:39.700078 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:39.704095 16295 raft_consensus.cc:606] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
W20260709 13:18:39.701530 16263 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.575s (SENT)
I20260709 13:18:39.704655 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:39.660851 19427 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.608816 19565 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.686199 19479 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.717788 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:39.718643 19567 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:18:39.719405 19454 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.656230 19515 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.684201 19409 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:39.708436 19438 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:18:39.725075 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 64951us
I20260709 13:18:39.728475 19578 consensus_queue.cc:1059] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:18:39.731242 19587 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:39.733697 19565 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.719249 19588 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:18:39.736368 19513 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:39.737232 19563 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:18:39.737648 19574 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:39.738957 19261 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.865512 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.741890 19517 raft_consensus.cc:3055] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:18:39.742182 19566 log.cc:927] Time spent T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:18:39.740356 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:39.703903 19489 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:39.708665 19480 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.709254 19516 raft_consensus.cc:697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:39.735772 19515 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.720747 19479 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:39.755723 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 129191us
I20260709 13:18:39.757438 19278 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:39.853578 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 263851us
W20260709 13:18:39.862123 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 240113us
I20260709 13:18:39.863572 16295 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "958e81841a784ee79fccc9f488562c59"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:39.869237 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:39.869640 16263 leader_election.cc:336] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.680s (SENT)
I20260709 13:18:39.951745 16295 raft_consensus.cc:606] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.952162 16295 raft_consensus.cc:614] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:39.920226 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 287552us
I20260709 13:18:39.929662 15745 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:39.855382 19578 raft_consensus.cc:3055] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:39.870112 19517 raft_consensus.cc:740] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:39.938603 15641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.013s	sys 0.013s
I20260709 13:18:39.744138 19291 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.944787 15749 raft_consensus.cc:2393] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:39.911293 19533 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:39.947513 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 288737us
W20260709 13:18:39.952119 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 82454.8us
I20260709 13:18:39.751708 19587 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:39.955045 15640 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:39.971007 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:39.949609 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:39.971351 16263 leader_election.cc:336] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.697s (SENT)
I20260709 13:18:39.971289 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:39.965538 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 616) took 2717 ms. Trace:
I20260709 13:18:39.935695 19447 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.871901 19574 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:39.987107 15642 leader_election.cc:336] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.534s (SENT)
W20260709 13:18:39.958268 15641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.013s	sys 0.013s
I20260709 13:18:39.973852 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:40.001412 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:39.955518 19501 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.974326 15595 rpcz_store.cc:276] 0709 13:18:37.247803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:37.247923 (+   120us) service_pool.cc:224] Handling call
0709 13:18:37.248256 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.248857 (+   601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:37.248902 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.998479 (+1749577us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b2c000014c8. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefcfe9a11 00007faefcff9372 00007faefe72ba01 00007faefe6f043a 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2
0709 13:18:38.999246 (+   767us) log.cc:844] Serialized 26 byte log entry
0709 13:18:39.282748 (+283502us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:39.282807 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.282899 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:39.947679 (+664780us) raft_consensus.cc:1685] finished
0709 13:18:39.947703 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:39.965447 (+ 17744us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":508,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":159,"spinlock_wait_cycles":23688960,"thread_start_us":283035,"threads_started":1,"wal-append.queue_time_us":437148}
I20260709 13:18:40.016870 19201 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:40.018252 19513 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:39.927182 19183 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:39.969434 19509 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:40.020015 19392 consensus_meta.cc:287] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 13:18:39.974375 16305 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:40.021878 19514 consensus_meta.cc:287] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.001s
I20260709 13:18:40.023557 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:40.006397 19572 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:40.024923 19260 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:40.024775 19572 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.022598 19392 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.025417 19260 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.025921 19260 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.008966 19584 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.936903 19111 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.026612 19584 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:39.981626 19533 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.029894 19446 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.031805 19533 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:40.030587 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 59480.8us
I20260709 13:18:39.954820 19578 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:40.009999 19278 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:39.989892 19291 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:40.012264 19580 log.cc:927] Time spent T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:18:39.997817 19510 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:39.946075 19480 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:40.021432 19579 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:18:40.035197 15565 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:40.035917 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:40.041517 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:40.039911 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 68987.7us
I20260709 13:18:40.067271 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:40.039338 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52266.7us
I20260709 13:18:39.977501 19302 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.003957 19490 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:18:40.048211 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:39.997231 15745 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:40.010079 19440 consensus_meta.cc:287] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 13:18:40.030314 19392 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.094245 19578 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:40.095660 19590 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:18:40.095922 19578 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:40.095714 19514 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:40.078325 19201 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:40.079547 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:40.127656 15595 raft_consensus.cc:606] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
W20260709 13:18:40.128072 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.023594 19602 raft_consensus.cc:2764] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:40.083271 19291 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:40.087009 15750 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:40.087620 19500 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.089350 19448 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:40.091008 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 55933.1us
I20260709 13:18:40.134155 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:40.091602 19501 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:40.064203 19516 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.092706 19574 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:39.988708 19600 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:18:40.021479 19587 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.154953 19501 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:40.093381 19302 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.029948 19489 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.047353 19447 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:40.047566 19454 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:40.103081 19573 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.075371 19446 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.104892 19584 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:40.104996 19561 log.cc:927] Time spent T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:18:40.178728 19302 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:40.105934 19591 log.cc:927] Time spent T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:18:40.126626 19562 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.187629 19572 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:40.107798 19521 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:40.109787 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:40.188619 19521 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.188616 19446 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.189395 19562 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.189702 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:40.190155 15749 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:40.190377 16309 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:40.111233 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:40.042868 19564 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:40.094292 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 58457.1us
I20260709 13:18:40.185750 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:40.044842 19462 consensus_meta.cc:287] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.003s
I20260709 13:18:40.111994 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:40.069979 15642 leader_election.cc:336] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.705s (SENT)
I20260709 13:18:40.194289 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:40.101402 19377 consensus_meta.cc:287] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.006s	user 0.012s	sys 0.000s
I20260709 13:18:40.064885 19588 consensus_queue.cc:1059] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:18:40.118767 19375 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:40.115199 19440 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.119675 19599 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.121280 19607 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:40.072206 19465 consensus_meta.cc:287] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
W20260709 13:18:40.081439 19576 log.cc:927] Time spent T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:40.137430 15745 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:40.143527 19500 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.149963 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:40.136035 19448 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:40.152019 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:40.143931 19319 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.051095 19565 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:18:40.048321 19533 consensus_queue.cc:1059] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:18:40.179935 19447 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.110674 16265 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:40.179183 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 111858us
I20260709 13:18:40.171161 19201 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:40.204775 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:40.205888 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:40.131459 19480 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.190953 19446 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.137951 15565 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:40.242017 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 104144us
I20260709 13:18:40.242887 15565 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:40.188760 19302 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:40.219435 16310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e105ea6267284f22bdfda14678176b49"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
W20260709 13:18:40.223953 16263 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.478s (SENT) [suppressed 14 similar messages]
I20260709 13:18:40.244966 16310 raft_consensus.cc:606] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:40.197739 19462 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.197887 19454 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:40.204484 19375 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:40.174854 19260 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.229954 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:40.234280 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:40.217696 19587 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.244663 19201 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.251483 19448 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.252758 19448 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:40.238680 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 128118us
I20260709 13:18:40.253736 19375 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.254953 19375 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.219857 19572 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.256678 19562 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:40.258508 19404 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:40.259177 19260 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:40.260221 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 844) took 2045 ms. Trace:
I20260709 13:18:40.260813 19478 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:40.262218 19478 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:40.262564 19478 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:40.263392 19478 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.264187 19440 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.220410 19599 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.256700 19183 consensus_queue.cc:1059] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:18:40.228035 15743 raft_consensus.cc:1240] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.222606 19465 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:40.271380 19480 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:40.271729 16305 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:40.245002 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:40.240293 19447 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.246534 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:40.247371 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 177413us
I20260709 13:18:40.247445 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:40.277335 15750 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.208123 19377 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.243252 19111 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:40.245395 16310 raft_consensus.cc:614] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:40.246359 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.283459 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:40.284044 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.271273 19599 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.274485 15565 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:40.266891 15742 rpcz_store.cc:276] 0709 13:18:38.215121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.129709 (+914588us) service_pool.cc:224] Handling call
0709 13:18:39.130081 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:39.130536 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:39.130565 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:39.131161 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:18:39.573854 (+442693us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:39.573897 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:39.573975 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.259986 (+686011us) raft_consensus.cc:1685] finished
0709 13:18:40.260010 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.260162 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42653,"raft.queue_time_us":1319,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":33250,"thread_start_us":442299,"threads_started":1,"wal-append.queue_time_us":707628}
W20260709 13:18:40.278841 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 44643.4us
I20260709 13:18:40.248322 19600 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:40.250583 19319 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:40.288280 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.290305 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:40.290903 15745 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.293820 19201 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.293860 19462 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:40.287082 19111 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:40.226045 19501 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.295048 19111 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.272714 19454 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.296931 19454 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:40.298065 19577 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.655s	user 0.003s	sys 0.000s
I20260709 13:18:40.298645 19564 raft_consensus.cc:3055] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:40.299062 19564 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:40.301913 19377 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.301986 19598 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:40.302595 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 845) took 1101 ms. Trace:
I20260709 13:18:40.302898 19599 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.303467 19599 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.305312 15747 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:40.302969 15743 rpcz_store.cc:276] 0709 13:18:39.201461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.455690 (+254229us) service_pool.cc:224] Handling call
0709 13:18:39.456021 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.266400 (+810379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:40.302366 (+ 35966us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400303ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:40.302536 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774971136}
I20260709 13:18:40.292410 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:40.307888 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:40.311408 15745 raft_consensus.cc:2468] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:40.276461 19478 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.299924 19564 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:40.281054 19604 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:18:40.321224 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:40.275540 19593 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:40.326184 15747 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 6.
I20260709 13:18:40.272090 19517 consensus_queue.cc:260] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.357606 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:40.302570 19598 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.357774 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.359921 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:40.361897 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.367465 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.369021 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.369733 15673 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.371415 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.372336 15677 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:40.377578 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.392663 15596 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:40.394763 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.398988 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.399855 15668 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.331060 19278 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:40.330828 19562 raft_consensus.cc:2764] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:40.410894 15750 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:40.331506 19600 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:40.335291 19319 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:40.427906 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 106762us
W20260709 13:18:40.428165 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 151509us
W20260709 13:18:40.428951 15642 leader_election.cc:336] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.762s (SENT)
I20260709 13:18:40.424129 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.422283 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.423573 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.319072 19446 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:18:40.353148 19480 consensus_queue.cc:1059] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:18:40.402493 19514 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:40.443046 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.331650 19404 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:18:40.379772 19598 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:40.454813 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:40.429816 19610 log.cc:927] Time spent T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
W20260709 13:18:40.448956 15642 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.768s (SENT)
I20260709 13:18:40.458824 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:40.380434 19493 consensus_queue.cc:1059] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:18:40.415179 19564 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.443928 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:40.432150 19461 consensus_meta.cc:287] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.051s	user 0.013s	sys 0.000s
I20260709 13:18:40.465615 15600 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:40.470408 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.472623 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.463862 15673 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:40.504004 15593 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:40.505133 15668 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:40.469621 19565 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.513494 15593 raft_consensus.cc:1240] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:40.518431 19613 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:40.519220 19613 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.521835 19613 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:40.522927 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 286136us
I20260709 13:18:40.523291 19111 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.525890 19111 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:40.527046 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.527740 15599 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:40.528438 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.528713 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.529888 15600 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:40.546744 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 97808.4us
I20260709 13:18:40.503016 19500 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.551657 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:40.556077 15642 leader_election.cc:336] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.837s (SENT)
I20260709 13:18:40.485562 19461 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.571519 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:40.546980 19319 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.572862 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:40.610797 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:40.611469 16299 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:40.613732 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.614889 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:40.620393 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:40.621788 16310 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:40.595203 15486 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5433f0c9863e427d88ba5916819e28e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:40.646100 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:40.646313 15486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 136855us
I20260709 13:18:40.647358 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:40.646341 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 90291.5us
W20260709 13:18:40.650539 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.650774 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:40.650952 15642 connection.cc:256] RPC call timeout handler was delayed by -1.987286696999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3246s for a response
I20260709 13:18:40.651700 16302 raft_consensus.cc:2410] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:18:40.658366 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.669628 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:40.610340 19565 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:40.693331 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:40.607529 19593 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:40.572809 19183 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
W20260709 13:18:40.694972 15642 connection.cc:256] RPC call timeout handler was delayed by -1.8237254289999782s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29740000000000005s for a response
I20260709 13:18:40.547020 19607 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.697027 15597 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:40.658188 19556 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.378s	user 0.001s	sys 0.004s
I20260709 13:18:40.548086 19599 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:40.566299 19611 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:18:40.700727 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:40.694332 19619 log.cc:927] Time spent T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:18:40.657799 19578 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.717402 19578 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.554801 19613 consensus_queue.cc:1059] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.139s
I20260709 13:18:40.712383 19607 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:40.720016 19626 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:18:40.720889 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:40.721830 19629 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:18:40.721896 19607 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.724115 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2403) took 2578 ms. Trace:
W20260709 13:18:40.725380 19628 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:40.724519 15748 rpcz_store.cc:276] 0709 13:18:38.145871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:38.145996 (+   125us) service_pool.cc:224] Handling call
0709 13:18:38.171087 (+ 25091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:38.177745 (+  6658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:38.177791 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:38.186041 (+  8250us) log.cc:844] Serialized 26 byte log entry
0709 13:18:38.944970 (+758929us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:38.945042 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:38.945160 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:40.464702 (+1519542us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:40.723810 (+259108us) raft_consensus.cc:1685] finished
0709 13:18:40.723829 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:40.724054 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6130,"raft.queue_time_us":6886,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8904,"spinlock_wait_cycles":172313856,"thread_start_us":688391,"threads_started":1,"wal-append.queue_time_us":952898}
I20260709 13:18:40.726589 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:40.728029 15597 raft_consensus.cc:1240] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:18:40.729592 15597 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:40.732966 19599 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:40.733106 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0571927849998701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 13:18:40.733510 19599 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.734504 16310 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
W20260709 13:18:40.698573 19521 consensus_meta.cc:287] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:18:40.744057 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.745159 15673 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:40.719664 19578 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:40.751564 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:40.704146 19618 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 13:18:40.697166 19572 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.764103 15669 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:40.767089 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.551638 19600 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:40.781965 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.788046 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.788321 15673 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:40.788851 15669 raft_consensus.cc:2376] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7. Re-sending same reply.
W20260709 13:18:40.762143 19448 consensus_meta.cc:287] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.003s
I20260709 13:18:40.793414 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.795089 15668 raft_consensus.cc:2368] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8.
I20260709 13:18:40.792342 15674 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:18:40.796427 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.761147 19607 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.768054 19481 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:40.820943 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:40.844707 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:40.822515 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.865020 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:40.774797 19571 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:40.787137 19565 raft_consensus.cc:3055] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:40.785629 19599 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.705507 19593 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.783006 19587 consensus_queue.cc:1059] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:18:40.782222 19572 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:40.887292 15668 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:18:40.871065 19571 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:40.761459 19521 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:40.913156 15744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.015s	sys 0.048s
I20260709 13:18:40.876107 19565 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:41.008936 15744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.016s	sys 0.048s
I20260709 13:18:41.022287 15600 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:41.023814 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:41.027772 15673 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:41.029239 15597 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 13:18:41.028020 15675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.018s	sys 0.052s
W20260709 13:18:41.030006 15675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.018s	sys 0.052s
W20260709 13:18:41.036250 19586 log.cc:927] Time spent T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 1.081s	user 0.013s	sys 0.006s
I20260709 13:18:40.879370 19607 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.038995 19607 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:40.916409 19571 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:41.046885 19573 consensus_meta.cc:287] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.856s	user 0.006s	sys 0.005s
I20260709 13:18:41.064759 19461 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:41.106977 19637 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:18:41.108935 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.108938 15673 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:41.109867 15672 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:41.111495 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:41.120690 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.130220 15672 raft_consensus.cc:2393] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:41.131938 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:41.117558 19634 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:18:41.096902 19573 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:41.120781 19478 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.002s
I20260709 13:18:41.137889 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.142395 15671 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:41.143653 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 127751us
I20260709 13:18:41.211750 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.212584 15668 raft_consensus.cc:2368] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8.
W20260709 13:18:41.213956 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.214385 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.181299 19598 consensus_meta.cc:287] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
W20260709 13:18:41.237591 19638 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:41.244328 16310 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:18:41.095599 19565 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:41.239766 19644 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:18:41.255257 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.250053 19598 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.256048 16302 raft_consensus.cc:2393] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 7: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:41.256862 15596 raft_consensus.cc:2368] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:41.257270 16299 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:18:41.257668 19643 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:18:41.258370 19598 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.258850 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2435) took 1129 ms. Trace:
I20260709 13:18:41.259205 15744 rpcz_store.cc:276] 0709 13:18:40.129513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.292054 (+162541us) service_pool.cc:224] Handling call
0709 13:18:40.306574 (+ 14520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.306933 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.306960 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.317593 (+ 10633us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.015540 (+697947us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:41.015583 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.015663 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.258668 (+243005us) raft_consensus.cc:1685] finished
0709 13:18:41.258687 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.258798 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10551,"thread_start_us":697515,"threads_started":1,"wal-append.queue_time_us":727067}
I20260709 13:18:41.261090 19374 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:41.258345 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.266351 15593 raft_consensus.cc:1240] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:41.267342 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.268330 16306 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
W20260709 13:18:41.274796 15642 leader_election.cc:336] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.072s (SENT)
I20260709 13:18:41.275485 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:41.256525 19635 log.cc:927] Time spent T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:18:41.264557 19640 log.cc:927] Time spent T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:41.283268 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.281268 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.283908 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2428) took 1992 ms. Trace:
W20260709 13:18:41.286166 15642 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.974s (SENT)
I20260709 13:18:41.285840 15751 rpcz_store.cc:276] 0709 13:18:39.291436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.931608 (+640172us) service_pool.cc:224] Handling call
0709 13:18:39.947197 (+ 15589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.036949 (+ 89752us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.036995 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:40.037057 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:40.037107 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.283673 (+1246566us) spinlock_profiling.cc:243] Waited 89.5 ms on lock 0x7b54003ded54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:41.283734 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.283857 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205737344}
I20260709 13:18:41.286754 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.289390 15642 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:41.291023 15642 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.283349 19601 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.301020 19601 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.301294 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.307858 19481 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:41.308660 19481 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.291489 19607 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:41.308151 19375 consensus_meta.cc:287] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 1.053s	user 0.009s	sys 0.000s
I20260709 13:18:41.252714 19478 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:18:41.327008 19302 raft_consensus.cc:3055] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:41.327680 19302 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:41.328795 19302 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.330197 19302 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.331671 19304 raft_consensus.cc:3055] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:41.332208 19304 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:41.333388 19304 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.336828 19572 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.298974 19599 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:41.367689 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.370781 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.372820 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:41.377401 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 116637us
I20260709 13:18:41.379627 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:41.341821 19375 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.374841 19599 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.388511 19599 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.383435 19521 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.378409 19572 consensus_queue.cc:1059] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:18:41.387010 19375 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:41.394716 19479 consensus_meta.cc:287] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 1.427s	user 0.013s	sys 0.001s
I20260709 13:18:41.408586 19478 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:41.413923 16263 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:41.415478 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:41.416563 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:41.416875 19650 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:41.417307 19278 consensus_meta.cc:287] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.994s	user 0.006s	sys 0.007s
I20260709 13:18:41.417822 19278 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:41.418749 15601 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.420171 19392 raft_consensus.cc:993] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:18:41.421989 19375 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:41.422585 19375 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:41.422930 19642 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:18:41.423628 19447 consensus_meta.cc:287] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 1.142s	user 0.009s	sys 0.000s
I20260709 13:18:41.424616 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2292) took 1062 ms. Trace:
I20260709 13:18:41.425153 15675 rpcz_store.cc:276] 0709 13:18:40.362624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.363225 (+   601us) service_pool.cc:224] Handling call
0709 13:18:40.363546 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.383972 (+ 20426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:40.384023 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:40.384675 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.031429 (+646754us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:18:41.031469 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.031535 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.422224 (+390689us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:41.424267 (+  2043us) raft_consensus.cc:1685] finished
0709 13:18:41.424291 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.424519 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6822,"raft.queue_time_us":4174,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":34048,"spinlock_wait_cycles":4094848,"thread_start_us":577333,"threads_started":1,"wal-append.queue_time_us":705049}
I20260709 13:18:41.428728 16305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 866) took 1319 ms. Trace:
I20260709 13:18:41.428951 19649 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:41.429345 16305 rpcz_store.cc:276] 0709 13:18:40.109006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.114338 (+  5332us) service_pool.cc:224] Handling call
0709 13:18:40.114828 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.272204 (+157376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.428369 (+1156165us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54004376d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:41.428640 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360359808}
I20260709 13:18:41.430493 19649 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.412745 19607 raft_consensus.cc:3055] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:41.431533 19607 raft_consensus.cc:740] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:41.432415 19607 consensus_queue.cc:260] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.433748 19607 raft_consensus.cc:3060] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.434458 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2441) took 1302 ms. Trace:
I20260709 13:18:41.434846 15743 rpcz_store.cc:276] 0709 13:18:40.131717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.352166 (+220449us) service_pool.cc:224] Handling call
0709 13:18:40.352487 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.352733 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:40.382810 (+ 30077us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.433935 (+1051125us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b18004691e0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:41.434109 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.434160 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:41.434203 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.434272 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.434398 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13691,"prepare.queue_time_us":30890,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":9529,"spinlock_wait_cycles":12269824}
I20260709 13:18:41.437568 19218 raft_consensus.cc:3055] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:18:41.437991 19218 raft_consensus.cc:740] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:41.438863 19218 consensus_queue.cc:260] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.439874 19218 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:41.412765 19479 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.443264 19479 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:41.444059 16304 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:41.447347 19448 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:41.447875 19448 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.449035 15640 leader_election.cc:400] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:41.449379 15640 leader_election.cc:403] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:41.450965 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 865) took 1129 ms. Trace:
I20260709 13:18:41.451347 15745 rpcz_store.cc:276] 0709 13:18:40.321697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.525232 (+203535us) service_pool.cc:224] Handling call
0709 13:18:40.525545 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.525751 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:40.526079 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.450629 (+924550us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.450681 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:41.450731 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.450795 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.450908 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":924297,"prepare.queue_time_us":5648,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4718}
I20260709 13:18:41.453958 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2434) took 1324 ms. Trace:
I20260709 13:18:41.424065 19447 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.458097 15602 raft_consensus.cc:1240] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:41.428473 19564 consensus_meta.cc:287] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.954s	user 0.004s	sys 0.004s
I20260709 13:18:41.490701 19565 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.465775 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.493990 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.468659 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:41.494881 15596 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:41.495792 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.459470 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.462126 19573 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.469623 15597 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:41.478206 15676 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:41.501484 15743 raft_consensus.cc:2368] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:41.482003 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.460144 19448 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.484169 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.461609 19572 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.454540 15742 rpcz_store.cc:276] 0709 13:18:40.129288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.286864 (+157576us) service_pool.cc:224] Handling call
0709 13:18:40.287233 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:40.287697 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:18:40.343612 (+ 55915us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.439651 (+1096039us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.440240 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.440408 (+   168us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:41.440441 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.440511 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.453665 (+ 13154us) raft_consensus.cc:1685] finished
0709 13:18:41.453693 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.453886 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":947064,"prepare.queue_time_us":64057,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":950977,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":12788,"thread_start_us":65396,"threads_started":1,"wal-append.queue_time_us":141728}
I20260709 13:18:41.518421 15748 raft_consensus.cc:2368] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:41.519038 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:41.496169 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.469607 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.470372 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.497888 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:41.478324 15565 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:41.523643 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 45396.6us
I20260709 13:18:41.504937 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.484396 19583 raft_consensus.cc:1081] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:18:41.495429 19440 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.501153 19533 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:41.509579 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:41.501574 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2445) took 1325 ms. Trace:
I20260709 13:18:41.512753 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.525569 15750 raft_consensus.cc:2368] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:41.530300 15673 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:41.499567 19510 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.534952 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.550020 15751 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:41.546013 15743 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:41.545634 15749 rpcz_store.cc:276] 0709 13:18:40.176425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.447239 (+270814us) service_pool.cc:224] Handling call
0709 13:18:40.460531 (+ 13292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:40.460736 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:40.485694 (+ 24958us) log.cc:844] Serialized 14 byte log entry
0709 13:18:41.501236 (+1015542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:41.501293 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:41.501345 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.501407 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.501509 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":582231,"prepare.queue_time_us":29973,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":590825,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":12689,"thread_start_us":432945,"threads_started":1,"wal-append.queue_time_us":611990}
I20260709 13:18:41.509354 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:41.507982 19613 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:41.551324 15743 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:18:41.547859 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.554549 15744 raft_consensus.cc:2410] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:18:41.543258 15640 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:41.551282 15669 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:41.551700 15676 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:18:41.553552 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 137052us
I20260709 13:18:41.557163 16263 leader_election.cc:400] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8.
I20260709 13:18:41.501881 19573 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.540026 19278 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:41.532181 19515 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.566210 15751 raft_consensus.cc:1240] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:41.611847 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.597206 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.597786 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.607605 19650 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.565022 19601 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:18:41.608681 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.614477 15749 raft_consensus.cc:2393] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:41.615321 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.613742 15743 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:41.616295 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.618036 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.613238 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.619127 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:41.589145 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.620921 15749 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:41.613176 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.566727 15750 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:41.612319 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 54316.9us
I20260709 13:18:41.610459 19447 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.567214 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.619935 15676 raft_consensus.cc:2410] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:41.626338 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.628407 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.543853 19481 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.629588 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:41.630098 15668 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:41.630440 19481 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.631457 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 863) took 1357 ms. Trace:
I20260709 13:18:41.631852 15746 rpcz_store.cc:276] 0709 13:18:40.273641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.490297 (+216656us) service_pool.cc:224] Handling call
0709 13:18:40.508262 (+ 17965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:41.450577 (+942315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:41.450627 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:41.463619 (+ 12992us) log.cc:844] Serialized 26 byte log entry
0709 13:18:41.526398 (+ 62779us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:41.526466 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.526584 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:41.631259 (+104675us) raft_consensus.cc:1685] finished
0709 13:18:41.631277 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:41.631406 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":933181,"raft.queue_time_us":947291,"spinlock_wait_cycles":11987712,"thread_start_us":26875,"threads_started":1,"wal-append.queue_time_us":118335}
I20260709 13:18:41.633641 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.634719 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.635779 15593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1962) took 1107 ms. Trace:
I20260709 13:18:41.636006 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.636168 15593 rpcz_store.cc:276] 0709 13:18:40.528086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.543376 (+ 15290us) service_pool.cc:224] Handling call
0709 13:18:41.266186 (+722810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.267068 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:41.635592 (+368524us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b5400164250. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:41.635722 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615711104}
I20260709 13:18:41.637215 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:41.638302 15746 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:41.640889 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.639047 15749 raft_consensus.cc:2368] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:41.641479 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.642302 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.643522 15746 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:41.644223 15749 raft_consensus.cc:2410] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:18:41.645462 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.646577 15600 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:41.564281 19564 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:41.651860 15596 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:41.651892 15675 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.653786 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:41.654102 15600 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:41.654547 15593 raft_consensus.cc:2393] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:41.655579 19660 raft_consensus.cc:3055] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:41.655985 19660 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:41.656828 19660 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.657996 19660 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.559173 19513 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:41.666781 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.667106 15599 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:41.667321 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:41.638171 19597 raft_consensus.cc:3055] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:41.647091 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.554903 19533 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.557516 19510 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.666428 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:41.666783 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.662961 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.649574 19375 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:41.672006 19278 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:41.672547 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:41.650030 19564 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:41.742710 15642 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.552975 19440 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:41.673791 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.674099 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.674168 19513 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.678207 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.680740 19478 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:41.681454 19490 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:41.682404 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:41.682991 16305 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9f9791071f42759780d6353d07808d"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:41.766098 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.767242 15750 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:41.682960 19649 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:41.685360 15675 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:41.689965 19562 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.698534 19573 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:41.710403 19571 consensus_meta.cc:287] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.001s
I20260709 13:18:41.718725 15596 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:41.720158 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 99464.9us
I20260709 13:18:41.676280 19597 raft_consensus.cc:740] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:41.757172 19564 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:41.755071 19514 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.755769 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:41.625358 19515 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.766516 16305 raft_consensus.cc:606] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:41.685132 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.786021 16305 raft_consensus.cc:614] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:41.770253 15744 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:41.772207 15746 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:41.789711 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:41.773998 19302 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.772586 15751 raft_consensus.cc:2410] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:18:41.691932 19599 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.777599 15594 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:41.751995 15668 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:41.742259 19504 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.663771 19583 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:18:41.783159 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.783965 15749 raft_consensus.cc:2410] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:18:41.795483 15743 raft_consensus.cc:2393] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 6: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:41.802326 15676 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
W20260709 13:18:41.803592 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.799721 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 44049.1us
W20260709 13:18:41.804234 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.798301 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:41.804708 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.804847 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.805241 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.804752 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:41.805492 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.806041 15746 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:41.806382 15642 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.809155 15745 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:41.814106 15596 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:41.817255 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.818054 15642 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.818714 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:41.819497 15594 raft_consensus.cc:2368] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:41.821990 15743 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:41.799207 19573 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.838656 19427 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:41.775779 19661 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:18:41.839238 19427 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.842727 19440 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.816884 19278 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.843271 19597 consensus_queue.cc:260] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.845506 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.845556 19515 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:41.835073 19513 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.836027 19572 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:41.846680 19533 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.793967 19514 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.850337 19514 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:41.817201 19302 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.807699 19504 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.854319 19504 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.779898 19562 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.855350 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:41.855998 15670 raft_consensus.cc:2468] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:41.856894 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:41.858323 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.859087 19599 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.782123 19571 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:41.860812 15677 raft_consensus.cc:2368] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12.
I20260709 13:18:41.861878 19571 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.811908 19447 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.869747 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:41.870455 15594 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:41.871996 15674 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:41.872090 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 54120us
I20260709 13:18:41.872995 15642 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.874375 15746 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:41.803769 19516 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.875883 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.877633 15670 raft_consensus.cc:2410] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:41.879622 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:41.880266 15596 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:41.874122 19504 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.884505 19504 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.886658 19504 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:41.877837 19516 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:41.893940 19516 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:41.874672 19562 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:41.882927 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.894942 15746 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:41.896117 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.897281 15746 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:41.899335 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.900115 15750 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:41.900923 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.901379 19427 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:41.901981 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:41.902477 15750 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:41.906224 15746 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:41.907387 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.908747 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:41.900345 15594 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:41.883564 15642 leader_election.cc:400] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7.
I20260709 13:18:41.914883 15642 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.878657 19659 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.918640 15640 leader_election.cc:400] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:41.884014 19607 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:41.917519 15596 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:41.919098 15640 leader_election.cc:403] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:41.940646 15640 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:41.941861 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:41.944149 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:41.926894 15750 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:41.930141 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.958045 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.958474 15750 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48722
I20260709 13:18:41.959286 15750 raft_consensus.cc:606] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 13:18:41.954316 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:41.959697 15750 raft_consensus.cc:614] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:41.961150 15714 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.962906 15714 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.931289 19562 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.939867 19607 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.940115 19447 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:41.938669 19533 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:41.938640 19514 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:41.965133 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:42.002204 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:41.931453 19504 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.938431 19666 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:42.003389 19504 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.004369 19666 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.005995 19302 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:42.006664 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:41.938915 19516 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:41.917415 19427 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:41.955227 19513 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.956589 19660 raft_consensus.cc:2804] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:41.952983 19671 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 7. Current term is 8.
I20260709 13:18:41.940044 19404 consensus_queue.cc:1059] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:18:41.957801 19515 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:41.995119 19440 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.994249 19661 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:41.998250 19659 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:41.941419 19564 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:42.030433 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 67633.7us
I20260709 13:18:42.026883 19427 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.009410 19607 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.007949 19599 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.036156 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1785) took 1512 ms. Trace:
I20260709 13:18:42.011164 19302 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:42.009610 19447 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:42.008528 19571 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.044958 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 50130.4us
I20260709 13:18:42.042588 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:42.043051 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 109621us
I20260709 13:18:42.044238 15601 rpcz_store.cc:276] 0709 13:18:40.523309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.526290 (+  2981us) service_pool.cc:224] Handling call
0709 13:18:40.526592 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.419212 (+892620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.035804 (+616592us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b5400296dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:42.036073 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051258112}
I20260709 13:18:42.038344 19671 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:42.025969 19668 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.066416 15601 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:42.030839 19660 raft_consensus.cc:697] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:42.017339 19533 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.079962 19660 consensus_queue.cc:237] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.081913 19533 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.010445 19562 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.068826 19478 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:18:42.069268 19669 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:42.017066 19514 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.085386 19562 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.047698 19447 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.086644 19427 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:42.086963 19514 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.091449 19564 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.021720 19516 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.094378 19593 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.094468 19516 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.076799 19302 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:42.044656 19573 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.077762 19504 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:42.067404 19571 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.064991 19666 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.085031 19671 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:42.097941 19639 log.cc:927] Time spent T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.209s	user 0.004s	sys 0.000s
I20260709 13:18:42.098807 19571 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.044934 19513 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:42.099372 19671 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:42.100672 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 58175.1us
I20260709 13:18:42.100795 19513 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.101281 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.101524 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:42.102197 15673 raft_consensus.cc:2410] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:42.103096 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.103449 19504 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.103698 19666 consensus_queue.cc:1059] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:42.104728 19666 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:42.104997 19513 raft_consensus.cc:3055] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:42.106669 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:42.107501 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.108485 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:42.109074 15596 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.109014 19404 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:42.112785 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:42.114286 15677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 681) took 1379 ms (client timeout 1566 ms). Trace:
W20260709 13:18:42.114624 15677 rpcz_store.cc:269] 0709 13:18:40.735049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.736690 (+  1641us) service_pool.cc:224] Handling call
0709 13:18:42.114083 (+1377393us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540033fc54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.114203 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473727360}
I20260709 13:18:42.115644 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:42.116168 15677 raft_consensus.cc:2376] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9. Re-sending same reply.
I20260709 13:18:42.116907 19536 raft_consensus.cc:3055] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:42.117272 19536 raft_consensus.cc:740] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.118208 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:42.118839 15673 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:42.121217 15596 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
I20260709 13:18:42.124208 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:42.125792 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:42.123709 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:42.123862 15640 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:42.127714 15596 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:42.129525 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:42.107630 19513 raft_consensus.cc:740] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:42.110409 19666 consensus_queue.cc:1243] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:42.128973 19573 raft_consensus.cc:3060] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:18:42.117954 19514 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:18:42.138216 19514 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:42.129310 19564 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:42.138808 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:42.139452 19564 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.139894 19564 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.140559 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.133589 19465 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:42.149302 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:42.153422 15672 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:42.131254 19671 raft_consensus.cc:2804] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:42.142005 19571 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:42.155054 19671 raft_consensus.cc:697] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:42.148044 19513 consensus_queue.cc:260] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.156219 19513 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:42.156355 19671 consensus_queue.cc:237] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.153484 19465 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.154172 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:42.160264 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.159972 19465 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.161577 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.162231 15677 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:42.163537 15677 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:42.154611 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:42.122303 19593 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.143106 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1961) took 1615 ms. Trace:
I20260709 13:18:42.167838 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:42.138808 19514 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.175829 15599 rpcz_store.cc:276] 0709 13:18:40.527824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.529444 (+  1620us) service_pool.cc:224] Handling call
0709 13:18:40.529699 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:41.674698 (+1144999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.142784 (+468086us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002972d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:42.143017 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2610917248}
I20260709 13:18:42.178382 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:42.179198 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.180089 15598 raft_consensus.cc:2393] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:42.179648 15642 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:42.181177 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:42.181897 15750 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.181941 19666 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:42.182030 19571 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.182775 19666 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.185055 19666 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:42.187279 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:42.190626 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.178814 19489 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.196666 19478 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:42.197129 19478 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:42.197513 19478 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.198758 19510 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:42.194618 15750 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:42.200783 15642 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:42.200765 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:42.202778 15750 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:18:42.203217 15677 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:42.204535 15750 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:18:42.204053 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:42.221737 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.223523 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.227145 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.225486 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.217857 19571 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:42.209151 19677 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:42.232146 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.233824 15595 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:42.219348 19587 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:18:42.193053 19593 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.235116 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.204186 19573 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:18:42.237074 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.238337 15677 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:42.250404 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.251274 15673 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:42.234740 19571 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:42.256966 15747 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2438) took 2126 ms (client timeout 1508 ms). Trace:
I20260709 13:18:42.257086 15742 raft_consensus.cc:1240] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 5. Current term is 6. Ops: []
W20260709 13:18:42.257494 15747 rpcz_store.cc:269] 0709 13:18:40.130355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.149649 (+ 19294us) service_pool.cc:224] Handling call
0709 13:18:42.256786 (+2107137us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b540002b054. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.256903 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193291520}
I20260709 13:18:42.258652 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:42.259224 15747 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:42.259752 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.260679 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:42.262633 19438 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:42.263062 19438 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:42.263595 19438 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.262893 19564 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.256459 19571 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.231752 19666 consensus_queue.cc:1059] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:42.268383 19564 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.268967 19666 consensus_queue.cc:1243] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:42.269445 19427 raft_consensus.cc:3055] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:42.269901 19427 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:42.270692 15747 raft_consensus.cc:2468] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:42.270885 19427 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.272334 19427 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:42.273180 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:42.274443 15747 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.278210 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.278949 15600 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:42.280061 19514 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:42.276081 19478 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.281035 19607 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.280018 19571 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.284233 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:42.289582 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.292018 15747 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:42.298285 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.299008 15677 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:42.303992 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.305044 15673 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:42.251756 19677 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:42.312307 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.313735 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.314436 19517 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:42.314885 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.316293 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.316932 15673 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:42.317480 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.318248 15677 raft_consensus.cc:2393] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 9: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:42.320765 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.322592 19404 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:42.322044 19677 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.323115 19404 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.324889 19218 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.325395 19218 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.327235 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.328024 19218 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:42.328938 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.393384 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.393803 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:42.394637 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.395243 15597 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:18:42.396102 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.330138 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.330541 19593 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.330459 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 688) took 1568 ms. Trace:
I20260709 13:18:42.238314 19513 consensus_queue.cc:1059] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:18:42.397246 19462 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:42.397444 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.398422 16305 raft_consensus.cc:2393] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:42.398131 19462 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.399237 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.331583 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.397588 19513 consensus_queue.cc:1243] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:42.401420 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.400349 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.401764 19510 raft_consensus.cc:3055] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:42.332412 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.402184 19510 raft_consensus.cc:740] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:42.402679 16310 raft_consensus.cc:2393] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 13: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:42.333279 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.331681 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:42.403031 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:42.404150 15750 raft_consensus.cc:2393] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:42.331681 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:42.404673 15746 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:42.370373 19660 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.374752 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.375070 19573 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:42.383345 16307 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.387430 16265 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:42.391477 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.331158 16309 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:42.401602 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:42.337083 19447 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.347886 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.397316 15669 rpcz_store.cc:276] 0709 13:18:40.761982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.789682 (+ 27700us) service_pool.cc:224] Handling call
0709 13:18:42.330207 (+1540525us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54003aedd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.330383 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733666560}
I20260709 13:18:42.404626 15567 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:42.410826 15751 raft_consensus.cc:2393] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:42.436331 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:42.402679 19603 raft_consensus.cc:3055] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.437021 15673 raft_consensus.cc:1240] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:42.437943 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 50619.5us
W20260709 13:18:42.448294 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.463732 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.466001 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.403015 19510 consensus_queue.cc:260] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.308590 19607 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:42.476383 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:42.494269 16265 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:42.495249 15669 raft_consensus.cc:2376] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7. Re-sending same reply.
W20260709 13:18:42.454424 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 49887us
I20260709 13:18:42.488925 15751 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:42.489974 15672 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.491066 15673 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:42.409046 19571 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:42.492628 15601 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:42.497001 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.497901 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.498519 15595 raft_consensus.cc:2393] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 8: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:42.445926 19218 raft_consensus.cc:2804] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:42.500057 19600 consensus_queue.cc:1059] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:18:42.505262 19600 raft_consensus.cc:3055] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.411244 19660 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.505683 19600 raft_consensus.cc:740] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:42.493124 19461 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:18:42.503054 19375 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:42.507519 19660 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.507656 19375 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.449206 19603 raft_consensus.cc:740] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.490114 19501 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:42.480829 19504 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:42.510640 15751 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:42.517998 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.490732 19462 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.502305 19516 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:42.515404 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.495229 19564 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.519021 15601 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:42.511564 15673 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:42.520732 15751 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.435751 19573 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.532655 16308 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 6.
I20260709 13:18:42.493263 19581 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:42.536094 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2317) took 1034 ms. Trace:
I20260709 13:18:42.538214 15673 rpcz_store.cc:276] 0709 13:18:41.501820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.510930 (+1009110us) service_pool.cc:224] Handling call
0709 13:18:42.511228 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.535859 (+ 24631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.536042 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.517014 19218 raft_consensus.cc:697] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.542917 15751 raft_consensus.cc:1240] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 5. Current term is 6. Ops: []
I20260709 13:18:42.546815 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:42.551626 15673 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:42.553314 15673 raft_consensus.cc:1240] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:42.554698 15673 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.528712 19438 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.557505 15747 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:42.536510 19564 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.558632 19438 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.508569 19375 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.525379 19501 raft_consensus.cc:697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:42.559747 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:42.560711 15676 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:42.529495 19404 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:42.595546 15676 raft_consensus.cc:1240] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 13. Ops: []
I20260709 13:18:42.529594 19516 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:18:42.597537 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.538229 19490 raft_consensus.cc:2804] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:42.606700 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:42.606892 15669 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 11. Ops: []
I20260709 13:18:42.610285 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 2023) took 1093 ms. Trace:
I20260709 13:18:42.606874 16306 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:42.610991 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.610726 15669 rpcz_store.cc:276] 0709 13:18:41.517008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.546088 (+1029080us) service_pool.cc:224] Handling call
0709 13:18:42.606704 (+ 60616us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.609921 (+  3217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.610203 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:42.611793 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.601702 15751 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:42.563073 15673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:18:42.616820 15673 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:42.617395 15673 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.559783 19375 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.614447 19374 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.595093 19454 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:42.597754 19564 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.625826 15674 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:42.539130 19510 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.629390 15751 raft_consensus.cc:1240] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:42.628437 15489 maintenance_manager.cc:419] P c996756dd34f40be806bd3ad4744f303: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033401
W20260709 13:18:42.633383 19682 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:42.629832 19374 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.560626 19501 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.561164 19218 consensus_queue.cc:237] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.604818 19593 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:42.619035 19490 raft_consensus.cc:697] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.623096 19447 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:42.654686 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 160534us
I20260709 13:18:42.687242 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1718) took 1077 ms. Trace:
I20260709 13:18:42.687547 15747 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:18:42.687674 15744 rpcz_store.cc:276] 0709 13:18:41.609866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.612978 (+  3112us) service_pool.cc:224] Handling call
0709 13:18:42.687049 (+1074071us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400216954. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.687182 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347078400}
I20260709 13:18:42.692421 15668 raft_consensus.cc:1275] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:42.693351 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 706) took 1052 ms. Trace:
I20260709 13:18:42.693778 15668 rpcz_store.cc:276] 0709 13:18:41.640889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.691546 (+1050657us) service_pool.cc:224] Handling call
0709 13:18:42.691952 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.693005 (+  1053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.693279 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.696839 19597 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:42.698664 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 2309) took 1204 ms. Trace:
I20260709 13:18:42.699229 15675 rpcz_store.cc:276] 0709 13:18:41.494675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.497658 (+  2983us) service_pool.cc:224] Handling call
0709 13:18:42.698416 (+1200758us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400084dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.698575 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296029952}
I20260709 13:18:42.701175 19447 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.701882 19447 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.706703 15565 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:42.708968 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2313) took 1210 ms. Trace:
I20260709 13:18:42.709550 15674 rpcz_store.cc:276] 0709 13:18:41.498205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.328225 (+830020us) service_pool.cc:224] Handling call
0709 13:18:42.625652 (+297427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.626293 (+   641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.708665 (+ 82372us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b54000839d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.708874 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683251456}
I20260709 13:18:42.685173 15673 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.744275 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:42.746659 15598 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.747053 15598 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:42.735972 15673 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:42.739675 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.748890 15668 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:42.753768 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:48144 (request call id 2320) took 1127 ms. Trace:
W20260709 13:18:42.754272 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 256693us
I20260709 13:18:42.754293 15673 rpcz_store.cc:276] 0709 13:18:41.623611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.556445 (+932834us) service_pool.cc:224] Handling call
0709 13:18:42.748179 (+191734us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:42.731058 15548 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5433f0c9863e427d88ba5916819e28e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:18:42.761638 15548 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:18:42.758963 15598 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.767966 15598 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.769487 15595 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:18:42.763403 15548 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:18:42.749377 19319 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:42.666666 19516 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.781317 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:42.784483 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 709) took 1116 ms. Trace:
I20260709 13:18:42.787287 15601 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:42.734719 19489 consensus_queue.cc:1059] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:18:42.751610 19595 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:18:42.729019 19404 consensus_queue.cc:1059] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:42.791919 19516 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:42.790371 15668 rpcz_store.cc:276] 0709 13:18:41.643565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.694741 (+1051176us) service_pool.cc:224] Handling call
0709 13:18:42.746337 (+ 51596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.749357 (+  3020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.760161 (+ 10804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.777908 19304 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:18:42.793766 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.716527 19374 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:42.760270 19260 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:18:42.805927 15668 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:42.809840 19260 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:42.810243 19260 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:42.810405 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 718) took 1148 ms. Trace:
I20260709 13:18:42.731359 19517 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:42.787036 19319 raft_consensus.cc:697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:42.790534 19447 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:42.718786 19600 consensus_queue.cc:260] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.804869 15598 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
W20260709 13:18:42.806028 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.808830 15567 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:42.810768 15668 rpcz_store.cc:276] 0709 13:18:41.661735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.805298 (+1143563us) service_pool.cc:224] Handling call
0709 13:18:42.805676 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.810017 (+  4341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.810348 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.795476 19573 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:42.824139 15567 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:42.809211 19650 raft_consensus.cc:3055] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.771095 19490 consensus_queue.cc:237] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:42.833161 19683 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:18:42.836962 15671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48144 (request call id 2288) took 2475 ms (client timeout 1609 ms). Trace:
W20260709 13:18:42.837160 19427 consensus_meta.cc:287] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.005s
I20260709 13:18:42.837589 15676 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:42.837725 19603 consensus_queue.cc:260] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.838568 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1732) took 1188 ms. Trace:
I20260709 13:18:42.838933 19603 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.839322 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 910) took 1519 ms. Trace:
I20260709 13:18:42.839705 16306 rpcz_store.cc:276] 0709 13:18:41.319667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.321982 (+  2315us) service_pool.cc:224] Handling call
0709 13:18:42.839149 (+1517167us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400603454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.839239 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840327040}
I20260709 13:18:42.819597 19374 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:42.840787 19374 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.841215 16304 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 833) took 2800 ms. Trace:
I20260709 13:18:42.841609 16304 rpcz_store.cc:276] 0709 13:18:40.041007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.041261 (+   254us) service_pool.cc:224] Handling call
0709 13:18:42.841036 (+2799775us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54007602d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.841158 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3166653312}
I20260709 13:18:42.841701 19374 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:42.837416 15671 rpcz_store.cc:269] 0709 13:18:40.361392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.361557 (+   165us) service_pool.cc:224] Handling call
0709 13:18:42.836778 (+2475221us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400364f54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.836889 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777977088}
I20260709 13:18:42.844190 15671 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:42.844901 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 2037) took 1084 ms. Trace:
I20260709 13:18:42.844964 19319 consensus_queue.cc:237] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.843114 19374 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:42.845247 15671 rpcz_store.cc:276] 0709 13:18:41.760429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.843673 (+1083244us) service_pool.cc:224] Handling call
0709 13:18:42.844015 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.844579 (+   564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.844847 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.879945 15671 raft_consensus.cc:1240] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:42.838932 15749 rpcz_store.cc:276] 0709 13:18:41.650030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.666493 (+ 16463us) service_pool.cc:224] Handling call
0709 13:18:42.838373 (+1171880us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b540002b554. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.838515 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145475840}
I20260709 13:18:42.881439 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 2038) took 1120 ms. Trace:
I20260709 13:18:42.881923 15671 rpcz_store.cc:276] 0709 13:18:41.760859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.879303 (+1118444us) service_pool.cc:224] Handling call
0709 13:18:42.879705 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.880952 (+  1247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.881368 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:42.878165 19665 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:42.887818 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 63784.4us
I20260709 13:18:42.825476 19278 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:42.890771 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:42.890606 19665 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:42.895936 19465 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.896426 19595 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.890939 19448 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:42.826292 19650 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:42.887492 19427 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:42.911238 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2311) took 1416 ms. Trace:
I20260709 13:18:42.929147 15672 rpcz_store.cc:276] 0709 13:18:41.495147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.165246 (+670099us) service_pool.cc:224] Handling call
0709 13:18:42.165600 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.496579 (+330979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.910900 (+414321us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b5400081bd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:42.911155 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":745559424}
I20260709 13:18:42.920089 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48728 (request call id 1697) took 1452 ms. Trace:
I20260709 13:18:42.811115 19260 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:42.931764 15742 rpcz_store.cc:276] 0709 13:18:41.467247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.520405 (+ 53158us) service_pool.cc:224] Handling call
0709 13:18:42.256907 (+736502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.257613 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:42.919805 (+662192us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b540002b050. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:42.920001 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1692887424}
I20260709 13:18:42.905396 19564 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:42.907548 19465 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:42.980152 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 295702us
I20260709 13:18:42.908397 19595 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.006503 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2321) took 1366 ms. Trace:
I20260709 13:18:42.939246 19427 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:43.015066 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.007257 15669 rpcz_store.cc:276] 0709 13:18:41.639780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.626248 (+986468us) service_pool.cc:224] Handling call
0709 13:18:42.626657 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.626941 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:42.811764 (+184823us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.005992 (+194228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.006072 (+    80us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:43.006136 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.006248 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.006408 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":294524,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"thread_start_us":346849,"threads_started":2}
I20260709 13:18:42.978062 19260 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:42.975255 19478 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:43.027150 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:43.028193 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.030617 15716 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:43.032647 15669 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:18:43.035624 15742 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 11: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:43.036173 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.038684 19438 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:43.039424 19691 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:43.039554 19438 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:43.048691 15743 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:43.053794 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.054378 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2325) took 1141 ms. Trace:
I20260709 13:18:43.054795 15669 rpcz_store.cc:276] 0709 13:18:41.912842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.018844 (+1106002us) service_pool.cc:224] Handling call
0709 13:18:43.019290 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.034631 (+ 15341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.054316 (+ 19685us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:43.063194 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.062772 15743 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:43.016222 19649 consensus_queue.cc:1059] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:18:43.085844 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 705) took 1458 ms. Trace:
I20260709 13:18:43.037781 19564 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.086314 15676 rpcz_store.cc:276] 0709 13:18:41.627420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.607423 (+980003us) service_pool.cc:224] Handling call
0709 13:18:42.837264 (+229841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.837985 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.085634 (+247649us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400364f50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:43.085783 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527865728}
W20260709 13:18:43.088925 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.087808 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 93473.9us
W20260709 13:18:43.087159 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 197828us
I20260709 13:18:43.090651 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2327) took 1157 ms. Trace:
I20260709 13:18:43.091269 15676 rpcz_store.cc:276] 0709 13:18:41.933660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.089515 (+1155855us) service_pool.cc:224] Handling call
0709 13:18:43.089871 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.090052 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.090078 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.090116 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:43.090148 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.090203 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.090589 (+   386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:43.093658 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2328) took 1151 ms. Trace:
I20260709 13:18:43.001185 19650 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.095532 15567 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:43.094214 15676 rpcz_store.cc:276] 0709 13:18:41.942362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.092661 (+1150299us) service_pool.cc:224] Handling call
0709 13:18:43.093054 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:43.093250 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.093279 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.093333 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:43.093381 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.093455 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.093593 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:43.086483 19665 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:43.099434 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 65034.9us
I20260709 13:18:43.092155 19564 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:43.103047 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.103150 15716 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:43.103557 15676 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:18:43.105309 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.105901 16308 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:43.106137 15676 raft_consensus.cc:1240] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 9. Ops: []
I20260709 13:18:43.106491 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.107043 16307 raft_consensus.cc:3060] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:43.107087 15676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc"
dest_uuid: "7019261981c6431baddd6812c15ac678"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48120
I20260709 13:18:43.107838 15676 raft_consensus.cc:606] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 13:18:43.108127 15676 raft_consensus.cc:614] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:43.109368 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.110761 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:43.111239 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.111754 16304 raft_consensus.cc:3060] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:43.113404 15670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 708) took 1471 ms (client timeout 1708 ms). Trace:
W20260709 13:18:43.113767 15670 rpcz_store.cc:269] 0709 13:18:41.642062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.856649 (+214587us) service_pool.cc:224] Handling call
0709 13:18:43.113215 (+1256566us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5400363654. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:43.113349 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45788032}
I20260709 13:18:43.139953 15750 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.142081 16308 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:43.102124 19490 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.146888 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.147423 19489 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:43.161733 19564 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:43.162860 19595 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:43.148185 19695 log.cc:927] Time spent T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:43.112491 19597 raft_consensus.cc:2804] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:43.171864 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:43.153064 15742 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:43.165959 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.172641 15744 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:43.169802 16304 raft_consensus.cc:2468] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
I20260709 13:18:43.175874 16265 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:43.109457 19665 consensus_queue.cc:1059] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:18:43.179682 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.180547 16302 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:43.179461 19595 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:43.186686 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 716) took 1527 ms. Trace:
I20260709 13:18:43.187103 19595 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.187569 19595 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:43.189693 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.190778 19427 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:43.192405 16295 raft_consensus.cc:2410] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:43.187206 15673 rpcz_store.cc:276] 0709 13:18:41.659269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.764506 (+1105237us) service_pool.cc:224] Handling call
0709 13:18:42.764967 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.772735 (+  7768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.772768 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.773333 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.009434 (+236101us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:43.009493 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.009602 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.186441 (+176839us) raft_consensus.cc:1685] finished
0709 13:18:43.186467 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.186625 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7443,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7760,"thread_start_us":216446,"threads_started":1,"wal-append.queue_time_us":319015}
I20260709 13:18:43.193666 19375 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.194176 19665 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:43.194751 19665 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:43.194213 19375 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.205107 19218 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:18:43.209477 19536 consensus_queue.cc:260] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.225653 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:43.226554 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 47617.8us
I20260709 13:18:43.226711 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2451) took 1441 ms. Trace:
I20260709 13:18:43.227291 15746 rpcz_store.cc:276] 0709 13:18:41.784919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.918802 (+133883us) service_pool.cc:224] Handling call
0709 13:18:42.404340 (+485538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.405099 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.226456 (+821357us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400304dd0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:43.226643 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115905920}
I20260709 13:18:43.229039 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.229934 16304 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:43.226661 16308 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:43.211402 19536 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.195700 19665 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.238232 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.241676 19665 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.241473 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:43.247157 19697 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:43.251607 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2326) took 1330 ms. Trace:
I20260709 13:18:43.180143 19597 raft_consensus.cc:697] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:43.252101 15669 rpcz_store.cc:276] 0709 13:18:41.921220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.055560 (+1134340us) service_pool.cc:224] Handling call
0709 13:18:43.055923 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:43.056303 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.056326 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:43.069762 (+ 13436us) log.cc:844] Serialized 52 byte log entry
0709 13:18:43.145703 (+ 75941us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:43.179718 (+ 34015us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.179935 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.180009 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.251340 (+ 71331us) raft_consensus.cc:1685] finished
0709 13:18:43.251362 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.251536 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52457,"prepare.queue_time_us":36699,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":6365,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":1575,"spinlock_wait_cycles":20134272,"thread_start_us":50105,"threads_started":1,"wal-append.queue_time_us":161489}
W20260709 13:18:43.273362 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.232988 19572 raft_consensus.cc:3055] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:43.167423 19490 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:43.275856 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 344674us
W20260709 13:18:43.276240 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.231192 19573 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:43.233470 19447 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.264269 16302 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:43.285967 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:43.272938 19278 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:43.289036 19700 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:43.290282 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 194853us
I20260709 13:18:43.290460 19501 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:18:43.275734 19448 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:43.295328 15669 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:43.293991 15640 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:43.277405 19572 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:43.326696 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.328173 16307 raft_consensus.cc:2468] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:43.333304 16309 raft_consensus.cc:1275] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:43.330470 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 719) took 1668 ms. Trace:
I20260709 13:18:43.338034 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:43.341526 19462 consensus_queue.cc:1059] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:43.342033 19700 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:43.342725 19462 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:43.335850 15668 rpcz_store.cc:276] 0709 13:18:41.662375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.819139 (+1156764us) service_pool.cc:224] Handling call
0709 13:18:42.828312 (+  9173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.828546 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:43.098367 (+269821us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.179785 (+ 81418us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.245190 (+ 65405us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.330072 (+ 84882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.330133 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:43.330182 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.330257 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.330388 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80135,"prepare.queue_time_us":279328,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":136,"raft.queue_time_us":72865,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":13070,"thread_start_us":330147,"threads_started":3,"wal-append.queue_time_us":87887}
W20260709 13:18:43.344063 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.340162 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:43.350690 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2324) took 1574 ms. Trace:
I20260709 13:18:43.351459 15672 rpcz_store.cc:276] 0709 13:18:41.776381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.930521 (+1154140us) service_pool.cc:224] Handling call
0709 13:18:42.930852 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.931076 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:43.296410 (+365334us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.350205 (+ 53795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.350289 (+    84us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:43.350350 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.350449 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.350609 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":109487,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":414146,"threads_started":2}
I20260709 13:18:43.358632 15602 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:43.359109 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:43.360940 15596 raft_consensus.cc:1275] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:18:43.368453 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 74122.2us
I20260709 13:18:43.299510 19573 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:43.310114 19677 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:18:43.344575 19481 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:43.375485 15640 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:43.353377 19685 raft_consensus.cc:3055] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:43.309568 19447 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:43.388438 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.389017 19703 log.cc:927] Time spent T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:18:43.397838 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2323) took 1626 ms. Trace:
I20260709 13:18:43.414610 15671 rpcz_store.cc:276] 0709 13:18:41.771574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.883405 (+1111831us) service_pool.cc:224] Handling call
0709 13:18:42.883844 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.884148 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:18:43.109733 (+225585us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.397250 (+287517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:43.397322 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:43.397385 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.397568 (+   183us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.397759 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21310,"prepare.queue_time_us":131453,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":25909,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":15483,"thread_start_us":486764,"threads_started":3,"wal-append.queue_time_us":178908}
I20260709 13:18:43.429531 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 1990) took 1212 ms. Trace:
I20260709 13:18:43.398700 19685 raft_consensus.cc:740] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:43.418704 19601 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:43.414388 19677 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.414850 19461 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:43.377555 19319 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:18:43.393000 19448 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.422528 19665 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:43.454027 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 93485.8us
W20260709 13:18:43.461110 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 121047us
I20260709 13:18:43.413867 19481 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.366266 19597 consensus_queue.cc:237] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.452819 19601 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:43.462742 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:43.468713 15674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 713) took 1811 ms. Trace:
W20260709 13:18:43.463301 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.430150 15597 rpcz_store.cc:276] 0709 13:18:42.217530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.490074 (+272544us) service_pool.cc:224] Handling call
0709 13:18:42.510374 (+ 20300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:42.527312 (+ 16938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.529685 (+  2373us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:42.547284 (+ 17599us) log.cc:844] Serialized 52 byte log entry
0709 13:18:42.819653 (+272369us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:42.889186 (+ 69533us) log.cc:844] Serialized 14 byte log entry
0709 13:18:42.889538 (+   352us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.251254 (+361716us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b180002b0c0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:43.412330 (+161076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.412414 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.428688 (+ 16274us) raft_consensus.cc:1685] finished
0709 13:18:43.428848 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.429429 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":423615,"prepare.queue_time_us":73781,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":373495,"raft.run_cpu_time_us":448,"raft.run_wall_time_us":30134,"spinlock_wait_cycles":28333312,"thread_start_us":355448,"threads_started":2,"wal-append.queue_time_us":338655}
I20260709 13:18:43.469151 15674 rpcz_store.cc:276] 0709 13:18:41.656912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.710894 (+1053982us) service_pool.cc:224] Handling call
0709 13:18:42.922721 (+211827us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:42.923017 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:42.923512 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:42.923554 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:42.924175 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.056913 (+132738us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:43.057846 (+   933us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.058160 (+   314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.058245 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.290844 (+232599us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b48001d2458. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:18:43.468431 (+177587us) raft_consensus.cc:1685] finished
0709 13:18:43.468457 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.468636 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3561,"prepare.queue_time_us":674,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":14108,"raft.run_cpu_time_us":5631,"raft.run_wall_time_us":248012,"spinlock_wait_cycles":87370880,"thread_start_us":132411,"threads_started":1,"wal-append.queue_time_us":174842}
I20260709 13:18:43.457187 19501 raft_consensus.cc:697] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:43.412504 19278 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:43.490574 19490 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:43.499181 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.490031 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 114619us
I20260709 13:18:43.490847 19581 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:43.483453 19603 consensus_meta.cc:287] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.644s	user 0.002s	sys 0.011s
W20260709 13:18:43.525215 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.457191 19677 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:43.471618 19601 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:43.544088 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 81410.6us
I20260709 13:18:43.808342 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:43.480731 19685 consensus_queue.cc:260] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.546142 19501 consensus_queue.cc:237] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:43.462482 19665 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:43.553790 19716 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:18:43.815886 19454 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:43.606169 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.817323 19729 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:43.515142 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.817831 19665 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:43.815992 19504 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.818394 19665 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.818588 19504 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:43.818958 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.818852 19665 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:43.819669 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.541575 19465 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:43.821051 19685 raft_consensus.cc:3060] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:43.822063 19465 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.822829 19465 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:43.652127 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.617591 19715 log.cc:927] Time spent T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.149s	user 0.000s	sys 0.013s
I20260709 13:18:43.801888 19581 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:43.836963 19581 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:43.785912 19720 log.cc:927] Time spent T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.232s	user 0.006s	sys 0.008s
W20260709 13:18:43.799115 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 65533.9us
I20260709 13:18:43.542770 19510 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:43.816529 19454 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.820802 19504 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:43.692998 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.809083 19595 consensus_meta.cc:287] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.621s	user 0.017s	sys 0.006s
W20260709 13:18:43.827139 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 1.54073e+06us
I20260709 13:18:43.859560 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:43.544816 19490 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.833909 19677 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:43.848385 15671 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:43.869351 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:43.832252 19536 consensus_meta.cc:287] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.592s	user 0.020s	sys 0.011s
W20260709 13:18:43.870079 15714 connection.cc:256] RPC call timeout handler was delayed by -1.4618393610001021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 13:18:43.870129 15671 raft_consensus.cc:2410] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:18:43.870606 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.870955 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.871269 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:43.871567 15714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.855638 15669 raft_consensus.cc:1275] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:43.872291 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:43.873056 15599 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:43.873274 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:43.874505 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:43.875236 15669 raft_consensus.cc:2393] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:43.857015 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:43.860441 15672 raft_consensus.cc:2393] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:43.864640 15674 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:43.866178 15746 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:18:43.805191 19686 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:43.872263 15714 connection.cc:256] RPC call timeout handler was delayed by -1.0577393610001309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2635s for a response
I20260709 13:18:43.876757 15749 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:43.839602 19665 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:43.880857 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.883231 16306 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:43.885010 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:43.885908 15749 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:43.887269 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:43.856564 19573 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:43.890242 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:43.891296 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:43.894074 15593 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:43.896384 15599 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:43.898880 15675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 712) took 2242 ms. Trace:
I20260709 13:18:43.899490 15675 rpcz_store.cc:276] 0709 13:18:41.656095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.700317 (+1044222us) service_pool.cc:224] Handling call
0709 13:18:43.226365 (+526048us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:43.226551 (+   186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.226927 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.226955 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.252077 (+ 25122us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.328983 (+ 76906us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:43.355050 (+ 26067us) log.cc:844] Serialized 14 byte log entry
0709 13:18:43.420484 (+ 65434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.420569 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:43.898504 (+477935us) raft_consensus.cc:1685] finished
0709 13:18:43.898624 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:43.898793 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26050,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":52,"raft.queue_time_us":240,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":3902,"spinlock_wait_cycles":106773760,"thread_start_us":120773,"threads_started":2,"wal-append.queue_time_us":184271}
I20260709 13:18:43.865103 19481 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:43.903133 15597 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:18:43.906095 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:43.908063 15674 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:43.914031 19465 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:43.881701 19686 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:43.915072 15742 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:43.916200 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:43.857172 19510 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:43.887545 19447 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:43.867635 19595 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.911410 19504 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:43.927724 19504 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:43.931510 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.872857 19490 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.910851 19261 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:43.941329 19465 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:43.942293 19727 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:43.926859 19665 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:43.942009 19465 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.933611 19735 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:43.951546 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 143282us
I20260709 13:18:43.948012 15716 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:43.947845 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:43.954092 15749 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:43.957103 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:43.942551 19595 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:43.969695 15748 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:18:43.970348 15748 pending_rounds.cc:85] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 5
I20260709 13:18:43.970723 15748 pending_rounds.cc:107] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:18:43.971047 15748 raft_consensus.cc:2889] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.976441 16308 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:43.977995 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.979950 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:43.983224 15744 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:18:43.983796 15744 pending_rounds.cc:85] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 8
I20260709 13:18:43.984128 15744 pending_rounds.cc:107] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:18:43.985134 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.985836 15746 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:43.986140 16304 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:43.984448 15744 raft_consensus.cc:2889] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:43.988346 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:43.997994 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.998945 16304 raft_consensus.cc:2368] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:18:43.999204 15748 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:43.956634 19454 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:44.003232 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 129081us
I20260709 13:18:44.010039 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:44.007741 16307 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:44.009320 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:43.981901 19536 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:44.015492 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:44.016027 19490 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:44.016162 16310 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:43.958033 19404 consensus_queue.cc:1048] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:18:44.016558 19465 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:43.955796 19735 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:44.018488 16302 raft_consensus.cc:1240] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:44.019111 19735 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:44.019670 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:43.950246 19665 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:44.019685 19735 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.021239 19735 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:44.022193 19665 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:43.970180 19733 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:44.025935 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.035010 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:44.020238 19601 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:44.035607 15749 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:18:44.036504 15749 pending_rounds.cc:85] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 6
I20260709 13:18:44.036911 15749 pending_rounds.cc:107] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:18:44.037884 19601 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:44.035413 19581 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:44.038652 19733 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:44.039589 19733 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:44.043890 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:43.948736 19686 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:43.997490 19304 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:18:44.073642 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:44.037242 15749 raft_consensus.cc:2889] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:44.077286 19665 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:44.086956 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:44.088404 15593 raft_consensus.cc:1240] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:44.089993 19686 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:44.095225 15599 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 11: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:18:44.117807 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.124842 15600 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:18:44.162782 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.193140 19510 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:44.194068 19737 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:44.194643 19737 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:44.195067 19737 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:44.202353 19700 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:44.202975 19700 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:44.204955 19572 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:18:44.533421 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.534193 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 618007us
I20260709 13:18:44.535310 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:44.462281 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 103567us
W20260709 13:18:44.315780 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.428731 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51468 (request call id 1812) took 1083 ms. Trace:
I20260709 13:18:44.537264 15714 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:44.370544 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 392062us
I20260709 13:18:44.272832 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2456) took 1943 ms. Trace:
I20260709 13:18:44.433113 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36530 (request call id 918) took 1267 ms. Trace:
W20260709 13:18:44.469321 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.538429 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.539280 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:44.346268 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.379031 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.533319 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2335) took 1247 ms. Trace:
W20260709 13:18:44.540809 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.574074 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.541602 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:44.541887 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.331262 15743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2447) took 2548 ms (client timeout 1964 ms). Trace:
I20260709 13:18:44.538712 15747 rpcz_store.cc:276] 0709 13:18:42.329223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.558848 (+229625us) service_pool.cc:224] Handling call
0709 13:18:42.687226 (+128378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:42.687972 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.272490 (+1584518us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400216950. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:44.272733 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294560128}
I20260709 13:18:44.540278 15599 raft_consensus.cc:2393] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 13: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
W20260709 13:18:44.280946 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 333005us
I20260709 13:18:44.603202 19573 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.605402 19573 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:44.608068 19573 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:44.603320 19723 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.609318 19723 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:44.594379 19724 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.594442 19597 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.613270 19597 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:44.596289 15677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.015s
W20260709 13:18:44.615397 15677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.006s	sys 0.015s
I20260709 13:18:44.161247 19404 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.518272 19718 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:44.617287 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:44.600620 15743 rpcz_store.cc:269] 0709 13:18:41.783434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:41.845241 (+ 61807us) service_pool.cc:224] Handling call
0709 13:18:44.330959 (+2485718us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540026a7d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:44.331158 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765457792}
I20260709 13:18:44.331980 15746 raft_consensus.cc:1275] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:44.539016 16295 rpcz_store.cc:276] 0709 13:18:43.165454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.165623 (+   169us) service_pool.cc:224] Handling call
0709 13:18:44.432813 (+1267190us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54003cd554. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:44.433022 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43710208}
I20260709 13:18:44.594854 15676 rpcz_store.cc:276] 0709 13:18:43.286155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.286314 (+   159us) service_pool.cc:224] Handling call
0709 13:18:43.291185 (+  4871us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:43.302036 (+ 10851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.302082 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:43.316494 (+ 14412us) log.cc:844] Serialized 52 byte log entry
0709 13:18:43.437652 (+121158us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:43.450746 (+ 13094us) log.cc:844] Serialized 14 byte log entry
0709 13:18:44.481645 (+1030899us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b18003c4060. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:44.532751 (+ 51106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.532861 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.532929 (+    68us) raft_consensus.cc:1685] finished
0709 13:18:44.533038 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.533234 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12841,"prepare.queue_time_us":14608,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":1091423,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":12402,"spinlock_wait_cycles":4074880,"thread_start_us":79204,"threads_started":1,"wal-append.queue_time_us":144883}
I20260709 13:18:44.533821 19600 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:44.526154 19732 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.209472 19504 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:44.395944 19685 consensus_meta.cc:287] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
W20260709 13:18:44.687429 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.528151 19564 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.424037 19665 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:44.518878 19717 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.175s
I20260709 13:18:44.481885 19454 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.260s
I20260709 13:18:44.532461 19572 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:18:44.817627 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 281103us
I20260709 13:18:44.534901 19601 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.574007 19510 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:44.481688 19409 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:44.820616 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 176522us
W20260709 13:18:44.821645 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:44.720950 19726 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:44.808285 19735 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:44.831954 19732 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:44.736981 19718 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:44.643465 19438 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:44.591280 19581 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:44.594431 19447 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:44.819772 19723 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:44.807878 19375 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:44.820974 19665 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:44.372814 19461 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
W20260709 13:18:44.843623 19686 consensus_meta.cc:287] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.660s	user 0.012s	sys 0.000s
I20260709 13:18:44.695350 19677 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:44.853006 19438 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:44.537034 15594 rpcz_store.cc:276] 0709 13:18:43.345305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.345464 (+   159us) service_pool.cc:224] Handling call
0709 13:18:44.428389 (+1082925us) spinlock_profiling.cc:243] Waited 911 ms on lock 0x7b540012b454. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:44.428626 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2094842752}
W20260709 13:18:44.540271 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.012192 19375 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:44.977838 15598 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:44.979983 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 379649us
I20260709 13:18:45.015141 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:44.981032 15642 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.014s
I20260709 13:18:44.989998 15668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2342) took 1142 ms. Trace:
I20260709 13:18:44.694279 15674 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:44.872838 19597 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:44.839263 19601 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:44.873669 19461 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.028776 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 714) took 3371 ms. Trace:
I20260709 13:18:45.030683 19717 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:45.029426 15677 rpcz_store.cc:276] 0709 13:18:41.657521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.712276 (+1054755us) service_pool.cc:224] Handling call
0709 13:18:44.090118 (+1377842us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:44.090368 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.090631 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.090661 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.091188 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.615777 (+524589us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:45.003621 (+387844us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.027721 (+ 24100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.027881 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.027983 (+   102us) raft_consensus.cc:1685] finished
0709 13:18:45.028103 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.028453 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":353739,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":7139,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":363,"spinlock_wait_cycles":78999936,"thread_start_us":539638,"threads_started":2,"wal-append.queue_time_us":780426}
I20260709 13:18:44.915035 19700 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:45.033519 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:44.947791 19702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.021s	sys 0.050s
W20260709 13:18:45.034453 19702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.021s	sys 0.050s
I20260709 13:18:44.866739 19718 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:44.849558 19726 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:44.910553 19731 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 1.096s	user 0.010s	sys 0.004s
I20260709 13:18:44.918838 19732 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:44.939692 19737 consensus_meta.cc:287] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.744s	user 0.011s	sys 0.004s
I20260709 13:18:44.848516 19650 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:45.047365 15600 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:45.002452 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 465678us
I20260709 13:18:44.693425 19404 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.053054 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:45.053381 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.054047 15597 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.003814 19572 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:45.017508 19573 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:18:45.022723 19581 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:18:45.069236 19572 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:45.074057 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.075233 19572 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.069600 19723 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:18:45.067448 19375 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.078482 19375 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:45.083739 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.012838 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 892) took 1158 ms. Trace:
I20260709 13:18:45.014756 19510 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.021473 19491 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.022706 19685 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.022872 19438 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:44.836652 19564 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.017556 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.016563 15598 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
W20260709 13:18:45.016904 15642 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.000s	sys 0.015s
I20260709 13:18:45.004268 19763 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:45.031373 19461 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:44.874971 19677 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.114674 19677 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.116271 19685 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:45.116797 19763 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.119123 19564 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.119702 19763 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.033362 19700 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:45.124958 19491 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:44.612586 19724 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.036015 15594 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.019953 15668 rpcz_store.cc:276] 0709 13:18:43.847821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.847961 (+   140us) service_pool.cc:224] Handling call
0709 13:18:43.868088 (+ 20127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.526537 (+658449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:44.526579 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:44.527154 (+   575us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.988948 (+461794us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:44.989116 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.989269 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.989344 (+    75us) raft_consensus.cc:1685] finished
0709 13:18:44.989360 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:44.989718 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728570,"raft.queue_time_us":663175,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2363,"thread_start_us":460976,"threads_started":1,"wal-append.queue_time_us":359328}
I20260709 13:18:45.046579 19737 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:45.007236 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 469822us
I20260709 13:18:44.848879 19409 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.061031 19686 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:45.061453 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.060117 19601 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.061964 19767 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:44.861351 19447 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.062698 19404 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.064553 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:45.083554 15751 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2466) took 1115 ms. Trace:
I20260709 13:18:45.130574 19724 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.131062 15751 rpcz_store.cc:276] 0709 13:18:43.967563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.989807 (+ 22244us) service_pool.cc:224] Handling call
0709 13:18:43.990234 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:44.126027 (+135793us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:18:44.737556 (+611529us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.041129 (+303573us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.043281 (+  2152us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.080919 (+ 37638us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:45.080970 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.081080 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.083122 (+  2042us) raft_consensus.cc:1685] finished
0709 13:18:45.083138 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.083328 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":258903,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":280400,"raft.run_cpu_time_us":562,"raft.run_wall_time_us":25332,"thread_start_us":860229,"threads_started":3,"wal-append.queue_time_us":141240}
I20260709 13:18:44.983163 15595 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:45.133837 19737 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.133986 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 669) took 1001 ms. Trace:
I20260709 13:18:45.084470 19375 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.031824 19717 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.084514 16309 rpcz_store.cc:276] 0709 13:18:43.854114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.854286 (+   172us) service_pool.cc:224] Handling call
0709 13:18:43.863848 (+  9562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.864277 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.864305 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.864814 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:18:44.148758 (+283944us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:44.148818 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:44.148919 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:45.011985 (+863066us) raft_consensus.cc:1685] finished
0709 13:18:45.012043 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.012393 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2043,"raft.queue_time_us":935,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":283439,"threads_started":1,"wal-append.queue_time_us":948516}
I20260709 13:18:45.137071 19409 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.138718 15595 rpcz_store.cc:276] 0709 13:18:44.132860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.133028 (+   168us) service_pool.cc:224] Handling call
0709 13:18:44.982566 (+849538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.133662 (+151096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.133898 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:45.095649 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 900) took 1158 ms. Trace:
W20260709 13:18:45.103174 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.105906 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.040061 19726 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.109959 19510 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.128691 15596 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:45.207564 15594 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:18:45.211119 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 145545us
W20260709 13:18:45.189293 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.109997 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2336) took 1806 ms. Trace:
I20260709 13:18:45.214041 16309 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:45.203115 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:45.220803 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 672) took 1059 ms. Trace:
W20260709 13:18:45.221828 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.214993 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:45.223047 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 162488us
I20260709 13:18:45.223503 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:45.140487 19717 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.224428 19738 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:45.225312 19738 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.225736 19738 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.221879 15594 rpcz_store.cc:276] 0709 13:18:44.158307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.034766 (+876459us) service_pool.cc:224] Handling call
0709 13:18:45.035488 (+   722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.217064 (+181576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.217278 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:45.223531 16295 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:45.233248 19491 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.235098 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:45.236405 15597 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:45.237239 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 675) took 1056 ms. Trace:
I20260709 13:18:45.237371 19374 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.237725 15597 rpcz_store.cc:276] 0709 13:18:44.358233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.984038 (+625805us) service_pool.cc:224] Handling call
0709 13:18:45.237130 (+253092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:45.238034 19374 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.242781 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:45.243691 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.244737 15744 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:18:45.246843 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.243722 15751 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.247752 15745 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:45.240566 19374 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:45.253314 15640 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.938s (SENT) [suppressed 24 similar messages]
I20260709 13:18:45.253348 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.255359 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.261139 15745 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:45.259032 19304 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.267007 19304 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:45.259852 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.260313 15567 leader_election.cc:336] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Timed out: RequestConsensusVote RPC to 127.14.41.68:46739 timed out after 1.660s (SENT)
I20260709 13:18:45.241757 15596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 664) took 1165 ms. Trace:
I20260709 13:18:45.119567 19685 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:45.263495 15746 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:45.183224 19686 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:45.274333 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.274816 16302 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:45.269969 15596 rpcz_store.cc:276] 0709 13:18:44.073927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.074053 (+   126us) service_pool.cc:224] Handling call
0709 13:18:45.228930 (+1154877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68864}
W20260709 13:18:45.279652 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.279611 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:45.280328 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.280826 19650 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.208073 19438 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.282619 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:45.283367 16309 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:45.284873 19438 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.217228 15742 rpcz_store.cc:276] 0709 13:18:43.936924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.039613 (+1102689us) service_pool.cc:224] Handling call
0709 13:18:45.040448 (+   835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:45.041234 (+   786us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:45.062583 (+ 21349us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.093355 (+ 30772us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.095104 (+  1749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:45.095161 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:45.095219 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.095295 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.095431 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1582,"prepare.queue_time_us":20812,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":137,"raft.queue_time_us":1915,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":300,"thread_start_us":29889,"threads_started":1,"wal-append.queue_time_us":28747}
I20260709 13:18:45.272758 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:45.290339 15751 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
W20260709 13:18:45.292634 15498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 326) took 19507 ms (client timeout 15000 ms). Trace:
I20260709 13:18:45.294000 19772 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.294865 19772 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.296912 19773 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.297904 19770 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:45.300979 19461 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:45.297729 19773 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.302233 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:45.309511 19773 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:45.291150 15642 connection.cc:256] RPC call timeout handler was delayed by -1.0590010450000591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
I20260709 13:18:45.301740 19461 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.207463 19665 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.312636 15675 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:45.311643 16302 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:45.313210 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.302079 19772 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.333177 19772 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:18:45.318380 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.318625 19717 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.319059 19409 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:45.319779 19735 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.312582 19767 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.320971 15746 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:45.322197 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:45.322877 19686 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:45.326011 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.326182 19461 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.327684 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.361510 15747 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:45.219951 15673 rpcz_store.cc:276] 0709 13:18:43.303956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.310018 (+  6062us) service_pool.cc:224] Handling call
0709 13:18:43.310431 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:43.315791 (+  5360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:43.315823 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:43.316348 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:18:43.451133 (+134785us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:43.451989 (+   856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:43.452106 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:44.909779 (+1457673us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:45.055614 (+145835us) raft_consensus.cc:1685] finished
0709 13:18:45.089489 (+ 33875us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:45.109771 (+ 20282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4956,"raft.queue_time_us":34663,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":8109,"spinlock_wait_cycles":55954176,"thread_start_us":99548,"threads_started":1,"wal-append.queue_time_us":232557}
W20260709 13:18:45.314263 19448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.388s	user 0.011s	sys 0.015s
W20260709 13:18:45.362808 19448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.521s	user 0.011s	sys 0.016s
I20260709 13:18:45.309901 19304 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.335980 19726 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:45.385561 19600 consensus_meta.cc:287] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.006s
I20260709 13:18:45.385138 19767 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.386466 15497 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.388998 19735 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.391091 19319 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.391757 19319 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:45.392650 15640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.364006 19491 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:18:45.395074 19319 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.368495 19601 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:45.396162 19601 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.385159 19447 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.399694 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:45.400012 19447 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.400580 19447 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.401899 19686 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:45.402330 19686 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.402670 19686 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.403250 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.404944 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.406188 19665 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.406404 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:45.407199 16295 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.407266 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.409893 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.354211 19724 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:45.406411 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:45.375195 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:45.414706 15745 raft_consensus.cc:2376] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9. Re-sending same reply.
I20260709 13:18:45.415580 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.424202 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:45.424711 15601 raft_consensus.cc:1240] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:18:45.425413 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:45.427219 15672 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:45.428907 19510 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.432842 15675 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 7.
I20260709 13:18:45.433391 19702 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:45.434044 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:45.434674 19702 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:45.435452 19404 raft_consensus.cc:3055] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:45.435947 19218 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:45.436432 19218 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.436825 19218 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:45.435983 19404 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:45.438629 19404 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.370852 19461 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:18:45.442291 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.433437 19735 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:45.442544 19738 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.443125 15676 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:45.443568 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:45.444262 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:45.444932 19650 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.445392 19650 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.445515 19767 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:45.446004 19650 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.447510 19374 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.444522 16265 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:45.448549 19438 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.449177 19763 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:45.449262 19438 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.450080 19374 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.449885 19763 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:45.450559 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.374274 19726 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.392298 19717 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.469241 16295 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
W20260709 13:18:45.460934 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 171489us
I20260709 13:18:45.465600 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:45.458684 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 81382.1us
I20260709 13:18:45.462733 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.388535 15497 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:45.453202 16302 raft_consensus.cc:2368] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 13. Current term is 14.
I20260709 13:18:45.458490 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:45.445361 15676 raft_consensus.cc:2410] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:45.462145 16306 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:45.485980 15747 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:45.462435 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:45.293349 15498 rpcz_store.cc:269] 0709 13:18:25.796174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.825268 (+ 29094us) service_pool.cc:224] Handling call
0709 13:18:45.292215 (+19466947us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:37.292827 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:37.586638 (+293811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:37.594011 (+  7373us) write_op.cc:435] Acquired schema lock
0709 13:18:37.595443 (+  1432us) tablet.cc:662] Decoding operations
0709 13:18:37.942910 (+347467us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:37.942998 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:37.943023 (+    25us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:18:37.990685 (+ 47662us) tablet.cc:701] Row locks acquired
0709 13:18:38.028432 (+ 37747us) write_op.cc:260] PREPARE: finished
0709 13:18:38.028706 (+   274us) write_op.cc:270] Start()
0709 13:18:38.028915 (+   209us) write_op.cc:276] Timestamp: P: 1783603118028587 usec, L: 0
0709 13:18:38.028965 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.078482 (+ 49517us) log.cc:844] Serialized 8376 byte log entry
0709 13:18:39.675666 (+1597184us) op_driver.cc:464] REPLICATION: finished
0709 13:18:40.125276 (+449610us) write_op.cc:301] APPLY: starting
0709 13:18:40.125396 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:40.125985 (+   589us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:40.126172 (+   187us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:40.668741 (+542569us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:40.925251 (+256510us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:18:41.025098 (+ 99847us) write_op.cc:312] APPLY: finished
0709 13:18:41.105875 (+ 80777us) log.cc:844] Serialized 145 byte log entry
0709 13:18:41.292804 (+186929us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:41.292987 (+   183us) write_op.cc:454] Released schema lock
0709 13:18:41.293069 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:41.293521 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:41.293563 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":465,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":428785,"apply.run_cpu_time_us":35708,"apply.run_wall_time_us":1168262,"num_ops":21,"prepare.queue_time_us":533125,"prepare.run_cpu_time_us":34751,"prepare.run_wall_time_us":1243497,"raft.queue_time_us":360944,"raft.run_cpu_time_us":73292,"raft.run_wall_time_us":336066,"replication_time_us":1617176,"thread_start_us":1380974,"threads_started":5,"wal-append.queue_time_us":1012259,"wal-append.run_cpu_time_us":27542,"wal-append.run_wall_time_us":2779896}]]}
I20260709 13:18:45.498068 15671 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:45.462539 19597 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:45.461724 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:45.440544 19404 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.451576 19438 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:45.504062 16307 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:45.457958 19763 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.515743 15675 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
W20260709 13:18:45.518445 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 53071.7us
I20260709 13:18:45.502353 15669 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:45.501065 19447 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.526613 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.505952 19767 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.469859 19686 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.534018 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.491591 19650 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.514261 19738 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.462671 19724 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:45.547008 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 48053.6us
I20260709 13:18:45.545037 16309 raft_consensus.cc:2393] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 14: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:45.557747 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:45.535616 15497 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 9, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:45.568112 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.569654 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.570333 15676 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:45.572009 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:45.572661 15670 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:45.573952 15670 raft_consensus.cc:1275] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:18:45.574267 15670 pending_rounds.cc:85] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 7
I20260709 13:18:45.575965 19724 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.531977 19438 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:45.576948 19438 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.577723 19726 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.579210 19438 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:45.574496 15670 pending_rounds.cc:107] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:18:45.532922 19767 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.581281 15670 raft_consensus.cc:2889] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:45.580806 19601 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.596733 15675 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:45.557279 19409 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:45.612582 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:45.597288 19767 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.628075 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:45.631752 16307 raft_consensus.cc:2468] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:45.622561 19374 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:45.646495 19501 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:18:45.653735 19686 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.658017 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:45.659276 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 130999us
I20260709 13:18:45.640722 15497 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 9, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 9 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.665771 19319 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.666582 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.666431 19319 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:45.667011 19717 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.668038 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.668691 19319 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.669106 15597 raft_consensus.cc:2410] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:18:45.665087 15497 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 9, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 9 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.669555 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:45.669263 19319 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.670639 15497 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 6, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 6 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:45.671357 19319 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:45.676931 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.690265 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 53952us
W20260709 13:18:45.691514 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.618492 19409 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:45.690635 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 125416us
I20260709 13:18:45.700834 16307 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:45.704936 19718 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:45.705710 19718 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:45.706862 15497 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.709220 15497 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 11, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 11 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.710431 19501 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:45.677032 19374 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:45.711544 19374 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.711663 15567 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:45.673835 19319 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:45.669134 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.713546 19501 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:45.713945 19501 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:45.710994 15497 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:45.714367 19501 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:45.630749 19773 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:18:45.739549 19700 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:45.740831 19772 consensus_queue.cc:1059] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:45.741261 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 668) took 1609 ms. Trace:
I20260709 13:18:45.741148 15716 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:45.744493 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.769100 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 76108.5us
W20260709 13:18:45.769287 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.770586 15601 rpcz_store.cc:276] 0709 13:18:44.131789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:44.131934 (+   145us) service_pool.cc:224] Handling call
0709 13:18:44.132334 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.425207 (+1292873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.740915 (+315708us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001ca2d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:45.741179 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2831460224}
W20260709 13:18:45.699231 19781 log.cc:927] Time spent T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:18:45.767781 19501 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:18:45.788717 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 160651us
I20260709 13:18:45.792176 19438 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:45.792932 19438 raft_consensus.cc:697] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:45.793985 19438 consensus_queue.cc:237] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.706921 19718 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:45.818055 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.811805 15716 leader_election.cc:400] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 13. Current term is 14.
I20260709 13:18:45.818892 15716 leader_election.cc:403] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:18:45.822331 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:45.825243 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.821259 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:45.845640 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 62448.7us
I20260709 13:18:45.835652 15567 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:45.851481 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 60370.1us
I20260709 13:18:45.799389 19763 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:45.863152 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 200664us
I20260709 13:18:45.800731 19717 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:45.867801 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:45.872479 15601 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:45.875787 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.878615 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.886492 19375 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:45.886785 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:45.887564 15745 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:45.887195 19375 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.887807 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.887115 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.862538 19735 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.873667 15497 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 7, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 7 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:45.897838 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:45.902392 19650 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.904675 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:45.902477 15746 raft_consensus.cc:1240] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:45.893913 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.862222 19218 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.915023 19375 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:45.915948 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 97948us
I20260709 13:18:45.867756 19665 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:18:46.212280 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:45.924206 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.997459 19409 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:45.916394 19218 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:45.959218 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:46.277628 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:45.951485 15600 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:45.937815 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.312819 15596 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
W20260709 13:18:46.268055 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.320488 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.327782 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.086509 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:45.891947 19717 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:46.018972 19803 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
W20260709 13:18:46.237131 19784 log.cc:927] Time spent T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.277s	user 0.000s	sys 0.002s
W20260709 13:18:46.235756 19789 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.332s	user 0.001s	sys 0.001s
W20260709 13:18:46.198693 19796 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:18:46.349982 15745 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:45.960469 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:46.390779 15743 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:45.948123 15497 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:45.959527 19788 log.cc:927] Time spent T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:18:46.287669 19447 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:46.139688 19725 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:45.991207 19510 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:46.039660 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:45.971218 19597 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:46.382447 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:46.390007 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:46.335703 19735 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 13. Current term is 14.
I20260709 13:18:46.404860 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:45.919764 19501 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:46.405444 15742 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:46.398916 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 494414us
I20260709 13:18:46.392571 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.410580 15593 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:18:46.397318 15497 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 8, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 8 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:46.401146 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:46.173219 19702 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.403069 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:46.239070 19773 raft_consensus.cc:3055] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:46.412915 15599 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:46.346448 19404 consensus_queue.cc:1059] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:18:46.053378 19767 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.420679 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:45.905791 19763 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:46.420679 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:46.431730 15746 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:46.410389 19374 consensus_meta.cc:287] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.698s	user 0.011s	sys 0.000s
I20260709 13:18:46.404882 19772 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:46.440927 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.431993 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.442272 15596 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:46.451009 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.443256 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.455897 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:46.456795 15598 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:46.447961 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.460074 16310 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 11: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:46.424526 19773 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:46.460484 15669 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:46.428345 19510 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:46.441311 19772 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.477072 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:46.405411 19447 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:46.440105 19564 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:46.469305 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:46.469614 15593 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:46.487246 15593 raft_consensus.cc:1275] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:46.488766 15750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 910) took 1229 ms. Trace:
I20260709 13:18:46.489209 15750 rpcz_store.cc:276] 0709 13:18:45.255233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.267217 (+ 11984us) service_pool.cc:224] Handling call
0709 13:18:45.267674 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.268268 (+   594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.268306 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.268940 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.362350 (+ 93410us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:45.362385 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.362447 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.236391 (+873944us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:46.478688 (+242297us) raft_consensus.cc:1685] finished
0709 13:18:46.478717 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.484482 (+  5765us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1395,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":1815,"spinlock_wait_cycles":86014208,"thread_start_us":92931,"threads_started":1,"wal-append.queue_time_us":629354}
I20260709 13:18:46.481295 19772 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:46.436472 19702 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.474279 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:46.494812 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:46.495527 19702 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:46.446527 19374 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.498122 16306 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:46.499670 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 728) took 1057 ms. Trace:
I20260709 13:18:46.500664 19374 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:46.501256 19717 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:46.500137 15672 rpcz_store.cc:276] 0709 13:18:45.442163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.486305 (+ 44142us) service_pool.cc:224] Handling call
0709 13:18:45.513291 (+ 26986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.573086 (+ 59795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.573113 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.573643 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.823531 (+249888us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:45.845734 (+ 22203us) log.cc:844] Serialized 14 byte log entry
0709 13:18:45.845996 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.846110 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.288731 (+442621us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18003d0840. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:46.499380 (+210649us) raft_consensus.cc:1685] finished
0709 13:18:46.499481 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.499608 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29549,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":9010,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":172,"spinlock_wait_cycles":27277056,"thread_start_us":249438,"threads_started":1,"wal-append.queue_time_us":907139}
I20260709 13:18:46.502058 19510 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.467058 15599 raft_consensus.cc:2393] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:46.503553 19799 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:18:46.504243 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 605365us
I20260709 13:18:46.468461 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:46.475690 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 455560us
I20260709 13:18:46.492475 19763 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:46.507932 15497 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.517189 15746 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:46.483187 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:46.533907 15669 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:18:46.537088 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:46.537776 15673 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:46.539851 15567 leader_election.cc:400] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:18:46.540223 15567 leader_election.cc:403] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:46.534524 15669 pending_rounds.cc:85] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 3
I20260709 13:18:46.541635 15669 pending_rounds.cc:107] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:18:46.541903 15669 raft_consensus.cc:2889] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:46.531636 15497 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.547326 15596 raft_consensus.cc:3060] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:46.543915 19737 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:46.548689 19737 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:46.549110 19737 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.560163 15742 raft_consensus.cc:2468] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:46.540043 19725 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:18:46.570892 15497 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:18:46.582809 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 143309us
I20260709 13:18:46.584663 15497 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 4 to 8, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 8 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:46.591925 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:46.573700 19448 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:18:46.600848 16265 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:46.605002 15747 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 14.
I20260709 13:18:46.610374 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:46.611053 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:46.618155 15743 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 14.
I20260709 13:18:46.611395 19702 raft_consensus.cc:2804] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:46.605206 19447 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:46.621672 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:46.574488 19773 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.614308 19763 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.633479 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:46.634431 19807 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:46.635023 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:46.636057 19807 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:46.636469 19807 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:46.636758 19665 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:18:46.638253 19603 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:46.642699 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 906) took 1396 ms. Trace:
W20260709 13:18:46.643807 19801 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:18:46.643126 15744 rpcz_store.cc:276] 0709 13:18:45.246582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.260408 (+ 13826us) service_pool.cc:224] Handling call
0709 13:18:45.260969 (+   561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:45.261908 (+   939us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.261951 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:45.262531 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:18:45.499092 (+236561us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:45.499139 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:45.499220 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.641404 (+1142184us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b24003e7248. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb4899c4 00007faefb487acb 00007faefb642dc9 00007faefb642a55 00007faefb641fb0 00007faefe2b8488 00007faefe2b8be8 00007faefe290398 00007faefe28b76a 00007faefe28abb6
0709 13:18:46.642344 (+   940us) raft_consensus.cc:1685] finished
0709 13:18:46.642364 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.642618 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"spinlock_wait_cycles":24480000,"thread_start_us":236103,"threads_started":1,"wal-append.queue_time_us":505326}
I20260709 13:18:46.645689 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:46.648111 15598 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 14.
I20260709 13:18:46.649271 15596 raft_consensus.cc:2468] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 14.
W20260709 13:18:46.650861 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 68979.9us
I20260709 13:18:46.636883 19807 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:46.654101 19767 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:46.655578 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 122737us
W20260709 13:18:46.656725 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 99142.2us
I20260709 13:18:46.656235 19603 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:46.677438 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:46.680356 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:46.669229 19665 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:46.692974 19218 raft_consensus.cc:3055] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:46.693619 19218 raft_consensus.cc:740] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:46.694928 19218 consensus_queue.cc:260] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.696549 19218 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:46.693611 15714 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:46.728932 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 102986us
I20260709 13:18:46.732326 16265 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:46.699867 19798 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:18:46.689777 19773 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.687216 19665 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:46.751245 19374 raft_consensus.cc:2804] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:46.751891 19374 raft_consensus.cc:697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:46.762502 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:46.734393 19811 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:46.763257 15746 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:46.739310 19597 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:46.768755 16263 leader_election.cc:336] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.708s (SENT)
I20260709 13:18:46.745054 19665 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:46.776769 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 83321.5us
I20260709 13:18:46.758442 19814 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:46.779084 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 109032us
I20260709 13:18:46.779958 16310 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47962 (request call id 900) took 1147 ms. Trace:
I20260709 13:18:46.780328 16310 rpcz_store.cc:276] 0709 13:18:45.627677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.627853 (+   176us) service_pool.cc:224] Handling call
0709 13:18:46.775220 (+1147367us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54004a60d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:46.775408 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906680064}
I20260709 13:18:46.765647 19811 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:46.770493 19597 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:46.802560 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:46.808557 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 135501us
I20260709 13:18:46.806550 15565 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:46.796271 19806 log.cc:927] Time spent T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:18:46.793833 19597 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.790257 19814 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:46.794025 19811 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:46.823504 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 153431us
I20260709 13:18:46.826457 19737 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.829717 19510 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:46.830957 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:46.830989 19813 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:18:46.833564 19792 log.cc:927] Time spent T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.342s	user 0.001s	sys 0.002s
I20260709 13:18:46.771087 19374 consensus_queue.cc:237] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:46.853904 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 95603.4us
I20260709 13:18:46.811759 19702 raft_consensus.cc:697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:46.849401 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.859525 15746 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
W20260709 13:18:46.881559 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.779342 19603 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:46.895769 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:46.896375 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.902025 15567 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:46.911227 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:46.849980 19822 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:46.897701 19823 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:46.927258 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 105315us
W20260709 13:18:46.914142 19798 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:18:46.932824 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 109530us
I20260709 13:18:46.935568 15673 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
W20260709 13:18:46.963150 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 101036us
I20260709 13:18:46.930173 19823 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:46.938199 19822 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:46.968099 16265 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:46.979981 16265 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:46.978259 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 731) took 1535 ms. Trace:
W20260709 13:18:46.992918 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 138380us
W20260709 13:18:46.996922 19816 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:18:46.997031 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:46.998474 15747 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:46.998642 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:46.926434 19510 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:18:47.003850 19767 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:47.004722 19767 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:46.974620 19823 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:46.984429 15676 rpcz_store.cc:276] 0709 13:18:45.443218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.570992 (+127774us) service_pool.cc:224] Handling call
0709 13:18:45.571317 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.598018 (+ 26701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.598084 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.638235 (+ 40151us) log.cc:844] Serialized 52 byte log entry
0709 13:18:45.934041 (+295806us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:46.032378 (+ 98337us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.395070 (+362692us) log.cc:844] Serialized 14 byte log entry
0709 13:18:46.395426 (+   356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.395505 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.977985 (+582480us) raft_consensus.cc:1685] finished
0709 13:18:46.978012 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:46.978184 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15507,"prepare.queue_time_us":107123,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":82,"raft.queue_time_us":95239,"raft.run_cpu_time_us":533,"raft.run_wall_time_us":29712,"thread_start_us":268602,"threads_started":1,"wal-append.queue_time_us":878223}
W20260709 13:18:47.013092 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 223660us
I20260709 13:18:46.969720 19814 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:46.974792 19832 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:47.025257 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 67785.8us
W20260709 13:18:47.000941 19772 consensus_meta.cc:287] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.006s
I20260709 13:18:47.034511 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:47.025823 19409 raft_consensus.cc:2804] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:47.036616 15751 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.009737 19763 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:46.973743 19702 consensus_queue.cc:237] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.043660 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:47.047518 19819 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:18:47.048240 19820 log.cc:927] Time spent T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:18:47.048558 19510 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:18:47.045670 19805 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.553s	user 0.000s	sys 0.003s
I20260709 13:18:47.030212 19772 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.059414 19772 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:47.060034 19818 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 13:18:47.064956 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 68095us
I20260709 13:18:47.065233 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:47.065362 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1821) took 1372 ms. Trace:
I20260709 13:18:47.066390 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:47.066562 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:47.067243 19833 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:47.065948 15597 rpcz_store.cc:276] 0709 13:18:45.693395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:45.693605 (+   210us) service_pool.cc:224] Handling call
0709 13:18:45.821327 (+127722us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:45.838368 (+ 17041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:45.838446 (+    78us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:45.884357 (+ 45911us) log.cc:844] Serialized 52 byte log entry
0709 13:18:46.319621 (+435264us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:46.319674 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:46.319739 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:46.963040 (+643301us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:47.064874 (+101834us) raft_consensus.cc:1685] finished
0709 13:18:47.064916 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:47.065272 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3705,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":25342,"spinlock_wait_cycles":16734336,"thread_start_us":357194,"threads_started":1,"wal-append.queue_time_us":583694}
I20260709 13:18:47.068099 19822 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.069307 19827 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.069875 19835 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.070768 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:47.070600 19835 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:47.079982 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 69787.6us
I20260709 13:18:47.043526 19737 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:47.093000 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 94485us
I20260709 13:18:47.075701 19510 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:47.080157 19828 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:47.104723 19824 raft_consensus.cc:2804] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:47.104949 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:47.105257 19824 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:47.105666 19824 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.106005 19815 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:47.106240 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:47.083376 19717 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:47.113438 19717 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.121017 19837 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:47.091848 19735 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:47.139091 19835 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:47.101658 19510 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.142879 19501 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:18:47.146314 19438 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:47.146857 19438 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:47.148082 16307 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:47.103154 19828 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.149931 15642 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:47.151012 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:47.157164 15567 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:47.147687 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:47.153594 19828 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.164026 19830 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:18:47.164206 19844 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:47.169020 19839 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:47.169536 19839 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:47.169924 19839 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.169792 19836 consensus_queue.cc:1059] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:47.171205 19844 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:47.171752 19844 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:47.173519 19844 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.176254 19844 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:47.100531 19767 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.152880 19665 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:47.183844 19717 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:47.141207 19597 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.186911 19597 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:47.187217 19833 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:47.198109 15744 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.198798 19447 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.201509 19814 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:47.142446 19823 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:47.142423 19811 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:47.211438 19832 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:47.224182 15676 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:47.219004 16263 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:47.225179 19821 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:47.225595 19821 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:47.225940 19821 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:47.236524 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 116116us
I20260709 13:18:47.211562 19823 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:47.242197 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 85092.5us
I20260709 13:18:47.147969 19438 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.246973 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:47.286038 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 44014.9us
W20260709 13:18:47.286608 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 44584us
I20260709 13:18:47.214713 19814 raft_consensus.cc:697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:47.302814 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:47.227047 19832 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:47.227777 19811 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:47.311501 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:47.311524 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:47.310823 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:47.311098 15749 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:18:47.312103 15596 raft_consensus.cc:3060] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.239619 19409 raft_consensus.cc:697] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:47.248241 19773 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.325559 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.317536 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:47.327198 15675 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.321640 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:47.322517 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.323009 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.332288 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.332706 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.334317 15750 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:47.336835 15602 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:47.328060 15601 raft_consensus.cc:2376] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 14. Re-sending same reply.
W20260709 13:18:47.337987 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 49048.5us
I20260709 13:18:47.340994 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.331470 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:47.332979 15600 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:47.348917 15595 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:18:47.349896 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 245944us
W20260709 13:18:47.352963 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 113698us
I20260709 13:18:47.238898 19718 consensus_queue.cc:1059] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 13:18:47.358983 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72549.7us
W20260709 13:18:47.382313 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.394191 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 63920us
W20260709 13:18:47.397161 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.322609 19735 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:47.408310 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.414533 16307 raft_consensus.cc:1240] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:47.419442 15596 raft_consensus.cc:2468] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:47.421208 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.291654 19717 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:18:47.349480 19807 consensus_meta.cc:287] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.697s	user 0.011s	sys 0.004s
I20260709 13:18:47.422230 19735 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:47.450192 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:47.451020 15671 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.447511 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:47.460522 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:47.461413 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:47.466256 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.467783 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.470291 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:47.422865 19438 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.482714 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:47.471014 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:47.472757 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 148814us
I20260709 13:18:47.448678 19807 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:47.460480 19830 consensus_queue.cc:1059] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:18:47.338896 19773 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:47.446877 19665 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:47.487358 16307 raft_consensus.cc:2410] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:18:47.488626 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:47.498739 15748 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:47.512487 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:47.464131 19735 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.521982 16302 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:18:47.522439 16302 pending_rounds.cc:85] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Aborting all ops after (but not including) 7
I20260709 13:18:47.522666 16302 pending_rounds.cc:107] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:18:47.522881 16302 raft_consensus.cc:2889] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:47.525635 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:47.526435 16310 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:47.527721 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 65319.5us
W20260709 13:18:47.537642 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 127524us
I20260709 13:18:47.497709 19718 raft_consensus.cc:3055] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:47.544171 15745 raft_consensus.cc:1240] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:47.545877 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:47.572775 15675 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:47.546655 19763 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:47.550540 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.552493 19448 raft_consensus.cc:3055] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:18:47.574249 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.569346 15750 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:47.604975 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:47.605513 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:47.605845 15750 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.606225 15745 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.649869 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:47.653280 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 84043.4us
W20260709 13:18:47.621765 19856 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:47.568216 19718 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:47.575947 19448 raft_consensus.cc:740] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:47.464993 19814 consensus_queue.cc:237] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:18:47.685388 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 259524us
I20260709 13:18:47.526974 19828 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:47.688239 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:47.689289 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 139843us
I20260709 13:18:47.564839 19804 consensus_queue.cc:1048] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.435s
W20260709 13:18:47.704444 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 289598us
W20260709 13:18:47.708566 15488 thread.cc:641] dir /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.005s	sys 0.008s
W20260709 13:18:47.709403 15488 thread.cc:608] dir /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/master-0-root/data [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.005s	sys 0.008s
I20260709 13:18:47.497637 19832 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.511305 19409 consensus_queue.cc:237] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.752774 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:47.758453 15745 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:47.657845 19838 consensus_queue.cc:1059] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.420s
W20260709 13:18:47.768402 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:47.714314 19855 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:18:47.802868 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 100465us
I20260709 13:18:47.784797 19737 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:18:47.813321 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 105704us
I20260709 13:18:47.794335 19218 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:47.814502 15642 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:47.832366 19702 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.007s	sys 0.006s
W20260709 13:18:47.832875 19702 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.008s	sys 0.006s
I20260709 13:18:47.842216 15745 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:47.812282 19510 consensus_meta.cc:287] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.002s
I20260709 13:18:47.810182 19737 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:47.766736 19718 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.837638 19218 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:47.865610 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 171288us
W20260709 13:18:47.871929 19846 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
I20260709 13:18:47.873153 19853 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
W20260709 13:18:47.874526 19447 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.001s
I20260709 13:18:47.874748 19863 consensus_queue.cc:1048] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 13:18:47.876274 19842 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260709 13:18:47.877584 19857 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:47.878161 19857 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.880216 19857 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:47.881165 19864 consensus_queue.cc:1048] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.191s
W20260709 13:18:47.882778 19848 log.cc:927] Time spent T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 13:18:47.882987 15745 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:18:47.883347 19845 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.486s	user 0.001s	sys 0.000s
W20260709 13:18:47.884009 19850 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:18:47.884725 19837 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:47.885455 19868 log.cc:927] Time spent T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:18:47.885391 19837 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:47.886577 19851 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:18:47.875020 19447 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:47.892488 19866 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:18:47.892791 19843 log.cc:927] Time spent T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:18:47.787186 19448 consensus_queue.cc:260] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.897346 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:47.898687 19828 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:47.900781 19597 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:47.911706 19824 consensus_meta.cc:287] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.806s	user 0.003s	sys 0.005s
I20260709 13:18:47.897508 19807 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:47.900270 15714 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:47.925194 15750 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:47.926172 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 224254us
I20260709 13:18:47.934640 15565 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:47.935539 16310 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:47.935806 19857 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:47.852281 19773 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:47.945928 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:47.946352 19871 log.cc:927] Time spent T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:47.860292 19865 raft_consensus.cc:2804] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:47.948381 19865 raft_consensus.cc:697] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:47.949388 19865 consensus_queue.cc:237] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:47.851085 19510 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:47.951983 15671 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:47.897346 19448 raft_consensus.cc:3060] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:47.952807 19829 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:47.953176 19510 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:47.864040 19737 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:47.960330 15745 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:47.921211 19218 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:48.008759 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 78571.7us
W20260709 13:18:48.050655 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.064505 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:47.987450 19767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.024s	sys 0.039s
W20260709 13:18:48.129539 16265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.005s	sys 0.013s
I20260709 13:18:47.912245 19824 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:48.130004 15640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.003s	sys 0.013s
W20260709 13:18:48.213441 16263 leader_election.cc:336] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.508s (SENT)
W20260709 13:18:48.139273 16265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.005s	sys 0.013s
I20260709 13:18:48.213981 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:48.214416 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 883457us
W20260709 13:18:48.191721 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:48.213841 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 637196us
W20260709 13:18:48.295830 15744 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.018s	sys 0.016s
I20260709 13:18:47.939235 19857 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:48.296495 15744 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.018s	sys 0.016s
I20260709 13:18:47.959563 19597 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:48.307898 19738 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:48.063117 19855 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.138899 19767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.024s	sys 0.040s
W20260709 13:18:48.362742 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 462530us
I20260709 13:18:48.046263 19815 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:48.407287 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 326287us
W20260709 13:18:48.460879 15567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.016s	sys 0.047s
I20260709 13:18:48.461373 15750 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:18:48.461681 15746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.021s	sys 0.035s
W20260709 13:18:48.464977 15746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.021s	sys 0.035s
I20260709 13:18:48.465076 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.466071 16310 raft_consensus.cc:2410] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:18:48.473073 15567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.017s	sys 0.047s
W20260709 13:18:48.477255 15642 connection.cc:256] RPC call timeout handler was delayed by -3.6375141510000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:18:48.477898 15642 connection.cc:256] RPC call timeout handler was delayed by -3.627892139000096s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:18:48.482146 15751 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:48.485873 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:48.461464 19409 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.025s	sys 0.029s
I20260709 13:18:48.411311 19597 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:48.496212 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:48.467904 19855 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:48.508064 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.524959 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:48.474660 19847 log.cc:927] Time spent T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Append to log took a long time: real 1.015s	user 0.003s	sys 0.000s
I20260709 13:18:48.519573 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.531738 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.532608 16307 raft_consensus.cc:2368] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:48.537899 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.511294 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.458611 19837 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:48.510378 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.541939 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.575305 16310 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:48.540292 16307 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:48.515125 19839 consensus_meta.cc:287] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 1.345s	user 0.008s	sys 0.002s
W20260709 13:18:48.515137 19438 consensus_meta.cc:287] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.017s	user 0.010s	sys 0.000s
W20260709 13:18:48.519137 19448 consensus_meta.cc:287] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
I20260709 13:18:48.512636 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.551913 15671 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:48.551304 19821 consensus_meta.cc:287] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 1.312s	user 0.008s	sys 0.004s
I20260709 13:18:48.569126 16295 raft_consensus.cc:1240] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:48.545006 19878 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:48.503863 19409 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.025s	sys 0.030s
I20260709 13:18:48.577781 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.586210 16305 raft_consensus.cc:2410] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:48.534202 19884 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:18:48.474439 19815 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:48.538671 19597 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:48.599292 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.507972 19857 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:48.599267 19844 consensus_meta.cc:287] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 1.422s	user 0.014s	sys 0.002s
I20260709 13:18:48.596071 19438 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:48.621985 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:48.624904 15673 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.606273 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:48.606659 19898 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:48.651443 15673 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
W20260709 13:18:48.630378 19897 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:18:48.585345 19839 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:48.596747 19821 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:48.658627 19889 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:18:48.631266 19735 consensus_meta.cc:287] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 1.012s	user 0.005s	sys 0.006s
W20260709 13:18:48.655304 19886 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:18:48.600245 19878 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:48.684837 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 184778us
I20260709 13:18:48.685115 15598 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 11: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:48.616566 19900 consensus_queue.cc:1048] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:18:48.698553 16309 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: [8.10-8.10]
W20260709 13:18:48.703653 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 153070us
I20260709 13:18:48.680291 19824 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:48.715909 15642 connection.cc:256] RPC call timeout handler was delayed by -2.9193141509999805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2675s for a response
W20260709 13:18:48.716686 15642 connection.cc:256] RPC call timeout handler was delayed by -2.4927141509999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3149s for a response
W20260709 13:18:48.717087 15642 connection.cc:256] RPC call timeout handler was delayed by -2.2940674639999088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:18:48.717499 15642 connection.cc:256] RPC call timeout handler was delayed by -2.24546746399983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:18:48.717849 15642 connection.cc:256] RPC call timeout handler was delayed by -2.1932674639999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 13:18:48.718253 15642 connection.cc:256] RPC call timeout handler was delayed by -1.93316746399978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:18:48.718613 15642 connection.cc:256] RPC call timeout handler was delayed by -1.7027674639998622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
I20260709 13:18:48.692425 19823 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:48.726581 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.720235 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:48.680835 19735 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:48.722287 19737 consensus_meta.cc:287] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.765s	user 0.005s	sys 0.006s
I20260709 13:18:48.730301 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2496) took 1187 ms. Trace:
I20260709 13:18:48.735013 15745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2505) took 1039 ms. Trace:
W20260709 13:18:48.737776 19447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.009s	sys 0.009s
I20260709 13:18:48.742733 15743 rpcz_store.cc:276] 0709 13:18:47.542922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.546379 (+  3457us) service_pool.cc:224] Handling call
0709 13:18:47.546771 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.576793 (+ 30022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.576822 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.604929 (+ 28107us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.129431 (+524502us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.129489 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.129579 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.729989 (+600410us) raft_consensus.cc:1685] finished
0709 13:18:48.730024 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.730220 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29603,"raft.queue_time_us":72026,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":14100,"spinlock_wait_cycles":42368,"thread_start_us":493385,"threads_started":1,"wal-append.queue_time_us":942364}
I20260709 13:18:48.757481 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.758242 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:48.758874 15674 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:48.759610 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.749807 15745 rpcz_store.cc:276] 0709 13:18:47.696018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.883883 (+187865us) service_pool.cc:224] Handling call
0709 13:18:47.884233 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:47.960824 (+ 76591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.734668 (+773844us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b5400217354. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:48.734923 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174600576}
I20260709 13:18:48.728653 15673 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:48.668918 19898 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:48.848851 15676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2380) took 1619 ms. Trace:
I20260709 13:18:48.765425 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:48.819413 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.760274 15677 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:48.854185 15565 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:48.853911 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 378501us
W20260709 13:18:48.855576 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.857059 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.853389 15668 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:48.857924 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:48.757328 19447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.009s	sys 0.009s
I20260709 13:18:48.861052 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.849402 15676 rpcz_store.cc:276] 0709 13:18:47.229076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.229294 (+   218us) service_pool.cc:224] Handling call
0709 13:18:47.245484 (+ 16190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.245773 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.245810 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.286185 (+ 40375us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.845797 (+559612us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:47.845841 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.845924 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.654684 (+808760us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:48.744063 (+ 89379us) raft_consensus.cc:1685] finished
0709 13:18:48.744084 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.848768 (+104684us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48580992,"thread_start_us":496037,"threads_started":1,"wal-append.queue_time_us":681012}
I20260709 13:18:48.857064 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:48.868881 15599 raft_consensus.cc:1275] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:48.750916 19855 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:48.863652 15668 raft_consensus.cc:2468] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 6.
I20260709 13:18:48.873580 15673 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:48.874325 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.874495 15714 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:48.882624 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.730455 19823 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:48.893401 19895 log.cc:927] Time spent T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:18:48.884826 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:48.897089 15746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2498) took 1353 ms. Trace:
I20260709 13:18:48.888415 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.905354 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.905608 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:48.906236 15676 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:48.907804 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:48.908876 15673 raft_consensus.cc:2410] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:18:48.863294 19903 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.863322 19837 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:48.751685 19737 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:48.897459 15746 rpcz_store.cc:276] 0709 13:18:47.543578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.680920 (+137342us) service_pool.cc:224] Handling call
0709 13:18:47.701521 (+ 20601us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.764141 (+ 62620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.764193 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.796275 (+ 32082us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.465393 (+669118us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.465714 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.484647 (+ 18933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.484728 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:48.896861 (+412133us) raft_consensus.cc:1685] finished
0709 13:18:48.896881 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:48.897026 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18645,"prepare.queue_time_us":32116,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":36414,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":44815,"thread_start_us":622041,"threads_started":1,"wal-append.queue_time_us":806711}
I20260709 13:18:48.911769 15673 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:48.930958 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.937217 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:48.947630 15668 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:48.944656 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:48.945609 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:48.948437 15673 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:18:49.578454 15568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.014s	sys 0.020s
I20260709 13:18:49.623592 19898 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:49.624245 15568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.016s	sys 0.021s
I20260709 13:18:49.036181 19833 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:49.570820 19603 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:18:48.982348 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:49.542353 15595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.011s	sys 0.045s
I20260709 13:18:49.627193 15593 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
W20260709 13:18:49.627404 15595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.014s	sys 0.049s
W20260709 13:18:49.584426 19447 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.011s	sys 0.020s
W20260709 13:18:49.633360 19447 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.012s	sys 0.021s
I20260709 13:18:49.351019 19878 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:49.024835 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 61880.1us
W20260709 13:18:49.024992 19891 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 13:18:49.635725 15565 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:49.094676 19839 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:49.097267 19887 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.429s	user 0.000s	sys 0.002s
W20260709 13:18:49.520882 15566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.017s	sys 0.014s
W20260709 13:18:49.072337 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 135773us
W20260709 13:18:49.637574 15566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.020s	sys 0.014s
W20260709 13:18:49.639020 16263 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.679s (SENT)
I20260709 13:18:49.639468 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:48.960171 16308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:49.640311 16308 raft_consensus.cc:606] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:49.630825 19735 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:49.640759 16308 raft_consensus.cc:614] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:49.632809 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.182793 19892 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.483s	user 0.000s	sys 0.001s
I20260709 13:18:48.909951 19905 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:49.632251 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 757773us
I20260709 13:18:49.578792 19909 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:49.637466 15565 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:49.181018 19894 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.507s	user 0.000s	sys 0.002s
I20260709 13:18:49.638278 19839 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:49.625702 19833 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:49.631633 19824 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:48.896555 19815 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:49.649104 15748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2492) took 2119 ms. Trace:
I20260709 13:18:49.646770 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 909) took 2309 ms. Trace:
W20260709 13:18:49.618683 19924 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:18:49.642795 19835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.000s	sys 0.013s
I20260709 13:18:49.071126 19821 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:49.655421 15601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.002s	sys 0.011s
I20260709 13:18:48.950030 19597 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:49.024745 19837 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:49.618160 19910 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:49.665634 16306 rpcz_store.cc:276] 0709 13:18:47.329952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.330091 (+   139us) service_pool.cc:224] Handling call
0709 13:18:47.330423 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.330663 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.330686 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.337436 (+  6750us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.858081 (+520645us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:47.858193 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.858303 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.639350 (+1781047us) raft_consensus.cc:1685] finished
0709 13:18:49.639369 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.639499 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":397673,"threads_started":1,"wal-append.queue_time_us":1239516}
I20260709 13:18:49.663760 15748 rpcz_store.cc:276] 0709 13:18:47.521449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.521737 (+   288us) service_pool.cc:224] Handling call
0709 13:18:47.566314 (+ 44577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.807661 (+241347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.807695 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.846330 (+ 38635us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.056775 (+210445us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:48.410183 (+353408us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.415577 (+  5394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.415844 (+   267us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.640930 (+1225086us) raft_consensus.cc:1685] finished
0709 13:18:49.640949 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.641085 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34086,"prepare.queue_time_us":352847,"prepare.run_cpu_time_us":331,"prepare.run_wall_time_us":27211,"raft.queue_time_us":32379,"raft.run_cpu_time_us":596,"raft.run_wall_time_us":48804,"thread_start_us":295013,"threads_started":2,"wal-append.queue_time_us":710463}
W20260709 13:18:49.678646 15601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.003s	sys 0.012s
W20260709 13:18:49.680775 15674 consensus_meta.cc:287] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.830s	user 0.012s	sys 0.000s
I20260709 13:18:49.658303 19839 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:49.675617 15715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.012s	sys 0.011s
I20260709 13:18:49.682906 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:49.677098 19835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.000s	sys 0.013s
I20260709 13:18:49.686053 15674 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:49.688042 15749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2499) took 2144 ms. Trace:
I20260709 13:18:48.950287 19903 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:49.688046 15715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.012s	sys 0.012s
I20260709 13:18:49.675549 19737 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:49.693302 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.693670 15672 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:49.689946 15749 rpcz_store.cc:276] 0709 13:18:47.543843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.752295 (+208452us) service_pool.cc:224] Handling call
0709 13:18:47.770317 (+ 18022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.797505 (+ 27188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.797537 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.850726 (+ 53189us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.044929 (+194203us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:48.044984 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.045698 (+   714us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.687820 (+1642122us) raft_consensus.cc:1685] finished
0709 13:18:49.687838 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.687984 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25903,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":23412,"thread_start_us":146791,"threads_started":1,"wal-append.queue_time_us":765649}
W20260709 13:18:49.802605 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 163572us
I20260709 13:18:49.675768 19824 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:49.809275 16263 leader_election.cc:336] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.151s (SENT)
I20260709 13:18:49.690579 19839 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:49.809599 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 170709us
I20260709 13:18:49.801262 19597 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:49.658700 19909 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:49.816980 19918 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:18:49.818727 19909 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:49.822153 19920 log.cc:927] Time spent T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:18:49.823480 16302 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 940) took 1311 ms. Trace:
I20260709 13:18:49.823869 16302 rpcz_store.cc:276] 0709 13:18:48.511927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.546148 (+ 34221us) service_pool.cc:224] Handling call
0709 13:18:48.546567 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.713156 (+166589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.713225 (+    69us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.745909 (+ 32684us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.890274 (+144365us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:48.890310 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.890378 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.823229 (+932851us) raft_consensus.cc:1685] finished
0709 13:18:49.823254 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.823413 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4318,"raft.queue_time_us":77718,"raft.run_cpu_time_us":5939,"raft.run_wall_time_us":35935,"thread_start_us":178082,"threads_started":2,"wal-append.queue_time_us":333949}
I20260709 13:18:49.802117 19931 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:49.824452 19597 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:49.825636 19931 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:49.827085 19926 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:49.827760 19926 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:49.827960 19931 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:49.829543 19833 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:49.830344 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 701) took 1068 ms. Trace:
W20260709 13:18:49.832221 19888 log.cc:927] Time spent T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 1.276s	user 0.007s	sys 0.013s
I20260709 13:18:49.832773 19837 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:49.828132 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:49.813462 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:49.851927 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 178469us
I20260709 13:18:49.857632 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 702) took 1095 ms. Trace:
I20260709 13:18:49.857632 16309 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47962 (request call id 911) took 2527 ms. Trace:
I20260709 13:18:49.862499 16309 rpcz_store.cc:276] 0709 13:18:47.330607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.339706 (+  9099us) service_pool.cc:224] Handling call
0709 13:18:47.410145 (+ 70439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.699179 (+1289034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.857364 (+1158185us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540023bed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:49.857572 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2950536448}
I20260709 13:18:49.863883 15671 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:49.859375 15597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.002s	sys 0.009s
W20260709 13:18:49.814453 19912 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.346s	user 0.000s	sys 0.001s
I20260709 13:18:49.859215 15594 rpcz_store.cc:276] 0709 13:18:48.762172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.762347 (+   175us) service_pool.cc:224] Handling call
0709 13:18:48.762748 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.763188 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.763228 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.847404 (+ 84176us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.923438 (+ 76034us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:48.923492 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.923584 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.830127 (+906543us) raft_consensus.cc:1685] finished
0709 13:18:49.830146 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.830284 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6648,"raft.queue_time_us":2079,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6634,"thread_start_us":28308,"threads_started":1,"wal-append.queue_time_us":124271}
W20260709 13:18:49.867090 15597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.002s	sys 0.010s
I20260709 13:18:49.865681 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:49.873744 15671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 749) took 1129 ms. Trace:
I20260709 13:18:49.874353 15671 rpcz_store.cc:276] 0709 13:18:48.735780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.751124 (+ 15344us) service_pool.cc:224] Handling call
0709 13:18:49.827904 (+1076780us) spinlock_profiling.cc:243] Waited 979 us on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036b60a0 00007faf036b5984 00007faefcc306d4 00007faefcc30662
0709 13:18:49.865153 (+ 37249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251008}
I20260709 13:18:49.862412 15595 rpcz_store.cc:276] 0709 13:18:48.762440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.762542 (+   102us) service_pool.cc:224] Handling call
0709 13:18:48.862183 (+ 99641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.891745 (+ 29562us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:49.032036 (+140291us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.629559 (+597523us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.629902 (+   343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.629950 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:49.630004 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.857419 (+227415us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54001013d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:49.857463 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.857567 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":473,"prepare.queue_time_us":639274,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":870,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":165,"spinlock_wait_cycles":67371904,"thread_start_us":735187,"threads_started":2,"wal-append.queue_time_us":652781}
I20260709 13:18:49.862166 19821 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:49.874017 19763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.065s	user 0.008s	sys 0.020s
I20260709 13:18:49.904980 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
W20260709 13:18:49.914865 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 105611us
W20260709 13:18:49.916538 16263 leader_election.cc:336] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.189s (SENT)
I20260709 13:18:49.916971 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:49.911991 19218 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 1.612s	user 0.011s	sys 0.003s
W20260709 13:18:49.909427 19763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.103s	user 0.008s	sys 0.021s
W20260709 13:18:49.925737 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 60131.5us
W20260709 13:18:49.940668 16263 leader_election.cc:336] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.399s (SENT)
W20260709 13:18:49.942193 16263 leader_election.cc:336] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.446s (SENT)
I20260709 13:18:49.912393 19938 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:49.920425 19939 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:49.943444 19932 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:18:49.955117 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 76495.1us
I20260709 13:18:49.918210 19929 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:49.937633 19218 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:49.910015 19857 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:18:49.944514 19817 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:49.984319 15745 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:49.984933 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:49.985602 15677 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:49.923779 19926 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:49.986369 19218 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:49.973280 19939 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:49.988824 19909 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:49.988876 19737 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:49.989777 19737 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:49.990638 15567 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:49.992031 15567 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:49.989730 19909 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:49.994839 19824 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:49.994953 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1843) took 1215 ms. Trace:
I20260709 13:18:49.955044 19938 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:49.996549 19938 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:49.995967 15597 rpcz_store.cc:276] 0709 13:18:48.853836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.862803 (+  8967us) service_pool.cc:224] Handling call
0709 13:18:48.869484 (+  6681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.869704 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:49.064851 (+195147us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.975343 (+910492us) log.cc:844] Serialized 14 byte log entry
0709 13:18:49.994637 (+ 19294us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:49.994689 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:49.994730 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.994793 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.994900 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23657,"prepare.queue_time_us":474488,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":97,"raft.queue_time_us":47772,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":4877,"spinlock_wait_cycles":14251264,"thread_start_us":1058517,"threads_started":3,"wal-append.queue_time_us":842093}
W20260709 13:18:49.998080 19921 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:18:49.992056 19737 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:49.999639 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1841) took 1222 ms. Trace:
I20260709 13:18:50.000069 15600 rpcz_store.cc:276] 0709 13:18:48.777651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.778951 (+  1300us) service_pool.cc:224] Handling call
0709 13:18:48.865794 (+ 86843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.881007 (+ 15213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.881038 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.890868 (+  9830us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.012936 (+122068us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:49.012999 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:49.013104 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:49.997428 (+984324us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:49.999308 (+  1880us) raft_consensus.cc:1685] finished
0709 13:18:49.999331 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:49.999571 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41436,"raft.queue_time_us":45633,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":21990,"spinlock_wait_cycles":84111744,"thread_start_us":121566,"threads_started":1,"wal-append.queue_time_us":828144}
W20260709 13:18:50.004632 19881 log.cc:927] Time spent T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.530s	user 0.001s	sys 0.001s
I20260709 13:18:50.005434 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 741) took 1285 ms. Trace:
I20260709 13:18:50.005843 15670 rpcz_store.cc:276] 0709 13:18:48.720095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.732488 (+ 12393us) service_pool.cc:224] Handling call
0709 13:18:50.004591 (+1272103us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800120698. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb5cbb71 00007faefb5cba22 00007faf044e4c09 00007faf0363eee0 00007faf037080ab 00007faf03708131 00007faf036c9fc0 00007faf036b4929 00007faf036b43d2 00007faefcc2bbd4
0709 13:18:50.004818 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:50.005054 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.005078 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:50.005145 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:50.005216 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.005272 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.005376 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9489792}
I20260709 13:18:50.006713 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:49.978440 19597 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.021302 19597 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.007184 19828 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:50.022603 19828 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:50.023239 19893 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:50.023766 19597 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.007505 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.006870 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.007822 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.008181 19914 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:50.008553 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2490) took 2559 ms. Trace:
I20260709 13:18:50.031293 15749 raft_consensus.cc:2368] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:50.032325 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.033557 15750 raft_consensus.cc:2410] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:18:50.008668 15751 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 6. Current term is 8. Ops: [6.4-6.4]
I20260709 13:18:50.008960 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.009099 19909 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:50.008670 19824 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:18:50.013176 19903 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.015103 19939 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:49.954530 19910 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:49.968098 19929 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:50.017750 19875 raft_consensus.cc:3055] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.021652 19823 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.007606 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.024335 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:50.030387 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.055308 15743 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.030949 15742 rpcz_store.cc:276] 0709 13:18:47.449417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.449618 (+   201us) service_pool.cc:224] Handling call
0709 13:18:47.481170 (+ 31552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.576743 (+ 95573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:47.576781 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:47.651534 (+ 74753us) log.cc:844] Serialized 26 byte log entry
0709 13:18:47.826213 (+174679us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:47.826655 (+   442us) log.cc:844] Serialized 14 byte log entry
0709 13:18:47.826880 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:47.826975 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.003904 (+2176929us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:50.008250 (+  4346us) raft_consensus.cc:1685] finished
0709 13:18:50.008357 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.008492 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8611,"prepare.queue_time_us":729,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":80656,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":50470,"spinlock_wait_cycles":32392448,"thread_start_us":97997,"threads_started":1,"wal-append.queue_time_us":370662}
I20260709 13:18:50.039839 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:50.041997 15600 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:49.973460 19931 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:50.062618 19914 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:50.063069 19914 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:50.062969 19931 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.063623 19914 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.063710 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 758) took 1205 ms. Trace:
I20260709 13:18:49.974146 19833 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:50.064975 19833 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:50.066867 19913 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
I20260709 13:18:50.067440 19833 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.049801 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.068679 15745 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.068372 19839 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.070747 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 942) took 1558 ms. Trace:
I20260709 13:18:50.071177 16295 rpcz_store.cc:276] 0709 13:18:48.512545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.610402 (+ 97857us) service_pool.cc:224] Handling call
0709 13:18:48.621313 (+ 10911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.656730 (+ 35417us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:48.656760 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.657325 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.742849 (+ 85524us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:48.742901 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.742985 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.066044 (+1323059us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:50.070416 (+  4372us) raft_consensus.cc:1685] finished
0709 13:18:50.070439 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.070676 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13663,"raft.queue_time_us":35885,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":9555,"spinlock_wait_cycles":9878400,"thread_start_us":85101,"threads_started":1,"wal-append.queue_time_us":885255}
I20260709 13:18:49.979279 19945 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:50.064241 15672 rpcz_store.cc:276] 0709 13:18:48.857813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.889924 (+ 32111us) service_pool.cc:224] Handling call
0709 13:18:49.689216 (+799292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:49.703953 (+ 14737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.063484 (+359531us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54002cd650. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:50.063635 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837094272}
I20260709 13:18:50.072587 19914 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.072989 19945 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.024748 19893 consensus_queue.cc:1059] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:50.074013 19940 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.074416 19893 raft_consensus.cc:3055] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:50.074865 19893 raft_consensus.cc:740] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:50.074587 19940 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.077054 19940 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:50.078119 19914 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:50.056931 15748 raft_consensus.cc:2410] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:18:50.056401 15596 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.056137 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.080782 15751 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 6.
I20260709 13:18:50.084015 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:50.053779 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.058585 15749 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:50.052582 19875 raft_consensus.cc:740] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:50.059240 19882 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.060613 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:50.086218 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 945) took 1771 ms. Trace:
I20260709 13:18:50.086548 19882 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.086830 15747 rpcz_store.cc:276] 0709 13:18:48.315160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.341803 (+ 26643us) service_pool.cc:224] Handling call
0709 13:18:48.342237 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:48.406066 (+ 63829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.406095 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:48.406149 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:48.406189 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.085948 (+1679759us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b54003048d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:50.086007 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.086150 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55597312}
W20260709 13:18:50.062173 19937 log.cc:927] Time spent T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:18:50.089448 19925 consensus_queue.cc:1059] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:50.089902 19902 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:18:50.090723 19925 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:50.091142 19925 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:50.078496 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 694) took 2773 ms (client timeout 1641 ms). Trace:
W20260709 13:18:50.093719 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.093613 15598 rpcz_store.cc:269] 0709 13:18:47.304928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.310609 (+  5681us) service_pool.cc:224] Handling call
0709 13:18:50.078225 (+2767616us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540020bf54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:50.078392 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155477248}
I20260709 13:18:50.075961 19893 consensus_queue.cc:260] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.095532 19823 consensus_queue.cc:1059] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:18:50.096899 19916 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:50.097363 19953 raft_consensus.cc:3055] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.097852 19953 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:50.097492 19916 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.098496 19882 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.068030 19833 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.098685 19953 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.099592 19833 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.099961 19953 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.054085 19929 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:50.101765 19947 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:18:50.104219 19928 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:18:50.095562 19893 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.108171 15745 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:50.108815 15596 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:50.114665 15743 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
W20260709 13:18:50.116571 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.121366 16263 leader_election.cc:336] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.518s (SENT)
W20260709 13:18:50.122509 16263 leader_election.cc:336] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.927s (SENT)
I20260709 13:18:50.122996 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:50.089448 19935 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:18:50.129273 15746 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:50.173110 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:50.065526 19931 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:50.177464 16263 leader_election.cc:336] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.954s (SENT)
I20260709 13:18:50.186250 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:50.181104 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 260001us
W20260709 13:18:50.187968 16263 leader_election.cc:336] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 1.977s (SENT)
I20260709 13:18:50.189162 16263 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:18:50.190980 16263 leader_election.cc:336] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.044s (SENT)
W20260709 13:18:50.177469 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 67317us
I20260709 13:18:50.099998 19916 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.186611 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.120802 19773 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:50.198429 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.130765 19855 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.201423 15745 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:50.204066 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.217118 15747 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.217308 15748 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:50.204815 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.086247 19875 consensus_queue.cc:260] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:50.215417 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.905s (SENT)
I20260709 13:18:50.220444 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:50.218151 15750 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:50.215348 16305 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:50.229815 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.230908 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.184069 19833 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:50.194661 19930 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:50.240396 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.202389 19890 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:50.246970 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.240101 19875 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:50.257681 15746 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:50.261979 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.247534 15742 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:50.264657 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.091934 19925 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.241744 15743 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:50.258642 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:50.248857 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.265357 15751 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:50.246438 15747 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
W20260709 13:18:50.267423 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.267959 16263 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:50.269748 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.248250 19916 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:50.279789 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.240489 19958 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:50.281081 15747 raft_consensus.cc:2393] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:50.227013 19855 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.283702 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.285290 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:50.257822 19839 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:50.286928 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.233644 19931 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:18:50.287489 15743 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.254047 19903 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:18:50.289106 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.290125 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.290714 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.290730 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.271883 19940 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:50.296039 16302 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:50.293314 15751 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.280787 19910 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.294616 15746 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:50.284243 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.302487 15747 raft_consensus.cc:2410] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:18:50.300361 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.303207 15742 raft_consensus.cc:2393] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:50.304006 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.309355 19833 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:50.304744 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.322382 15746 raft_consensus.cc:2393] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:50.306046 15747 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:50.309774 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.310364 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.311993 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.327128 15750 raft_consensus.cc:2410] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:18:50.263242 19374 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:18:50.313553 16295 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:50.313661 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.304268 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:50.327445 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.333817 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.334671 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.301714 19910 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:50.338280 15488 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.390s	user 0.002s	sys 0.009s
I20260709 13:18:50.335469 15750 raft_consensus.cc:2393] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:50.343636 15743 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:50.347126 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.347458 15716 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:50.347980 16295 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:50.348778 19961 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:18:50.348785 19438 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.349542 19438 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.349587 19911 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
I20260709 13:18:50.350123 19438 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:50.353276 19908 log.cc:927] Time spent T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.346s	user 0.007s	sys 0.010s
I20260709 13:18:50.356992 15744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2491) took 2876 ms. Trace:
I20260709 13:18:50.357513 19957 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:50.357419 15744 rpcz_store.cc:276] 0709 13:18:47.480934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.497609 (+ 16675us) service_pool.cc:224] Handling call
0709 13:18:47.525798 (+ 28189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:47.613330 (+ 87532us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:47.946924 (+333594us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b4800150258. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf03619aa1 00007faf03610b37 00007faf036109ca 00007faf0370826f 00007faf03707f37 00007faf0371c55c 00007faf0371c508 00007faf0371c488 00007faf0371c443 00007faf0371b6ec 00007faf02645a96
0709 13:18:48.297085 (+350161us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.704283 (+407198us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.731133 (+ 26850us) log.cc:844] Serialized 26 byte log entry
0709 13:18:48.731375 (+   242us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:48.731688 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:18:48.732230 (+   542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:48.732337 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.085509 (+1353172us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18003615a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:50.352752 (+267243us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:50.356739 (+  3987us) raft_consensus.cc:1685] finished
0709 13:18:50.356766 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.356919 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28274,"prepare.queue_time_us":127845,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":81,"raft.queue_time_us":87939,"raft.run_cpu_time_us":2954,"raft.run_wall_time_us":311951,"spinlock_wait_cycles":63970304,"thread_start_us":823896,"threads_started":2,"wal-append.queue_time_us":388353}
I20260709 13:18:50.360522 15744 raft_consensus.cc:1240] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:50.361931 15744 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:18:50.350340 19901 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 1.641s	user 0.008s	sys 0.005s
I20260709 13:18:50.348883 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.282728 19916 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.373428 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36530 (request call id 941) took 1861 ms. Trace:
I20260709 13:18:50.380221 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:50.363241 19945 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.324530 19833 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:50.405992 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:50.324055 19939 consensus_queue.cc:1048] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
W20260709 13:18:50.429140 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 401439us
I20260709 13:18:50.472784 15751 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:50.571985 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.410575 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:50.414496 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.530993 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.364480 19910 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:50.487866 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.579696 16295 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
W20260709 13:18:50.576632 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 170671us
I20260709 13:18:50.447952 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:50.470057 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.387115 16299 rpcz_store.cc:276] 0709 13:18:48.512243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.580978 (+ 68735us) service_pool.cc:224] Handling call
0709 13:18:48.606685 (+ 25707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:48.619335 (+ 12650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:48.619366 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:48.630780 (+ 11414us) log.cc:844] Serialized 26 byte log entry
0709 13:18:49.825834 (+1195054us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b18003491e0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb603522 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:18:50.095769 (+269935us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b18003491e0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe2900d1 00007faefe6aba0f
0709 13:18:50.255316 (+159547us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:50.264949 (+  9633us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.265481 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.265576 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.373082 (+107506us) raft_consensus.cc:1685] finished
0709 13:18:50.373113 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.373334 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43417,"prepare.queue_time_us":11261,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2224,"raft.queue_time_us":36340,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8436,"spinlock_wait_cycles":33035136,"thread_start_us":159342,"threads_started":1,"wal-append.queue_time_us":1695908}
I20260709 13:18:50.582649 15567 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:50.580206 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:50.470633 19832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.003s
W20260709 13:18:50.586853 15643 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.411654 19903 consensus_queue.cc:1059] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.173s
I20260709 13:18:50.528859 19916 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.444867 19941 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:50.629648 15669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.011s	sys 0.011s
W20260709 13:18:50.630299 15669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.011s	sys 0.011s
I20260709 13:18:50.588927 15744 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:50.588239 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.582239 19904 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:50.433171 19945 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:50.564720 19855 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:50.639376 19941 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.618407 16299 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:50.444991 19833 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:50.618201 19832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.011s	sys 0.011s
I20260709 13:18:50.582849 16309 raft_consensus.cc:2393] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 11: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:50.640725 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.639533 19945 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:50.653649 15748 raft_consensus.cc:2393] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:50.578806 19958 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:18:50.588651 15750 raft_consensus.cc:1275] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:18:50.640564 19953 consensus_meta.cc:287] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.009s
I20260709 13:18:50.589689 19882 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:18:50.411588 19874 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.238s
I20260709 13:18:50.662781 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.646759 19837 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:50.697307 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.698122 19941 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.699817 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.671703 19904 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:50.700701 15744 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:50.704759 19833 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:50.707947 19960 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.451s	user 0.002s	sys 0.000s
W20260709 13:18:50.677181 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 93129us
I20260709 13:18:50.731792 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.732921 15744 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:50.411958 19929 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.654333 19954 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:50.735116 15567 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:50.657948 19945 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.745385 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.704803 19904 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:50.752144 19893 consensus_meta.cc:287] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.000s
I20260709 13:18:50.697372 19837 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:50.773633 16263 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.65:33667 timed out after 1.836s (SENT) [suppressed 28 similar messages]
I20260709 13:18:50.772974 15744 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:50.757647 19718 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.774379 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:50.741722 19954 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.760818 19438 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.742751 19968 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:50.744856 19938 consensus_meta.cc:287] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.746s	user 0.004s	sys 0.008s
W20260709 13:18:50.799487 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 219339us
I20260709 13:18:50.777925 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.742697 19941 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:50.810933 15642 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.013s	sys 0.052s
I20260709 13:18:50.815591 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.817353 15748 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:50.818552 19941 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.802541 19954 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:50.820778 19941 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:50.807250 19772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.000s	sys 0.027s
I20260709 13:18:50.836444 15748 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:50.815024 15642 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.013s	sys 0.053s
W20260709 13:18:50.839874 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 626195us
W20260709 13:18:50.841090 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:50.830859 19772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.000s	sys 0.028s
I20260709 13:18:50.816334 19968 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:50.852428 15642 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.591s (SENT)
I20260709 13:18:50.854692 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.855822 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:50.850955 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.856344 15744 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:50.837584 19929 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:50.863392 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:50.863770 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:50.816480 19938 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.870687 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.871928 15744 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
W20260709 13:18:50.875602 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 101996us
I20260709 13:18:50.875590 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:50.877576 15596 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:50.880201 15744 raft_consensus.cc:1240] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:50.871887 15669 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:50.881748 15676 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:50.885419 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:50.885605 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.886325 15674 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:50.886545 15748 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
W20260709 13:18:50.891773 15642 leader_election.cc:336] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.649s (SENT)
I20260709 13:18:50.892423 15642 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:50.897323 15600 raft_consensus.cc:1275] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:18:50.897912 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:50.897819 15600 pending_rounds.cc:85] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 8
I20260709 13:18:50.899456 15600 pending_rounds.cc:107] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:18:50.862246 19865 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:50.899828 15600 raft_consensus.cc:2889] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:50.918987 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:50.919925 15596 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:50.900657 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:50.905118 15749 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:50.925689 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.929399 15674 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:50.944898 15748 raft_consensus.cc:2368] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:50.865305 19945 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.946810 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40216 (request call id 762) took 1956 ms. Trace:
I20260709 13:18:50.955976 15673 rpcz_store.cc:276] 0709 13:18:48.990882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.361003 (+1370121us) service_pool.cc:224] Handling call
0709 13:18:50.361337 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.361741 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.361774 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.362285 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.459602 (+ 97317us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:50.517115 (+ 57513us) log.cc:844] Serialized 14 byte log entry
0709 13:18:50.946446 (+429331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:50.946533 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:50.946575 (+    42us) raft_consensus.cc:1685] finished
0709 13:18:50.946592 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:50.946744 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57192,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":17028,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":56089,"thread_start_us":525787,"threads_started":2,"wal-append.queue_time_us":334402}
I20260709 13:18:50.851851 19837 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:50.969149 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:50.970160 15598 raft_consensus.cc:2410] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:50.955380 19879 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:50.971979 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:50.972793 15748 raft_consensus.cc:2368] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
W20260709 13:18:50.962355 19966 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:18:50.973598 15600 raft_consensus.cc:1240] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:50.833124 15488 maintenance_manager.cc:643] P c996756dd34f40be806bd3ad4744f303: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.199s	user 0.206s	sys 0.081s Metrics: {"bytes_written":29231,"cfile_init":1,"dirs.queue_time_us":647927,"dirs.run_cpu_time_us":626,"dirs.run_wall_time_us":41985,"drs_written":1,"lbm_read_time_us":420,"lbm_reads_lt_1ms":4,"lbm_write_time_us":232913,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":21,"peak_mem_usage":0,"rows_written":63,"thread_start_us":674041,"threads_started":2,"wal-append.queue_time_us":370899}
I20260709 13:18:50.976962 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:50.976904 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:50.981019 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:50.970326 15596 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:50.897101 19930 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:18:50.984126 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:50.987404 19865 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:50.991048 19865 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:50.991515 19865 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:50.996335 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.996891 19879 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:51.002319 19865 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:50.988085 19438 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:51.005524 19865 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:51.007826 15489 maintenance_manager.cc:419] P c996756dd34f40be806bd3ad4744f303: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11090 bytes on disk
I20260709 13:18:51.008342 15598 raft_consensus.cc:1240] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:51.009298 19982 log.cc:927] Time spent T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:18:51.011341 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:51.014191 19925 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.015344 19448 raft_consensus.cc:2764] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:18:51.015739 19984 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:51.017035 19977 log.cc:927] Time spent T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:18:51.021274 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:51.022054 15602 raft_consensus.cc:2376] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9. Re-sending same reply.
I20260709 13:18:51.023846 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:51.024897 19914 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:51.025357 19914 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:51.025874 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:50.979727 19946 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:51.026266 19914 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:51.027753 19914 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:51.029091 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 48176.9us
I20260709 13:18:51.029844 15567 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:51.035614 19945 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:51.033250 19983 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:51.035365 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:51.038722 19828 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:51.039578 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:50.962091 19968 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:51.040980 19910 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.035282 15488 maintenance_manager.cc:643] P c996756dd34f40be806bd3ad4744f303: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.004s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":439,"lbm_reads_lt_1ms":4}
I20260709 13:18:51.041844 19938 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:51.042919 19986 log.cc:927] Time spent T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:51.043665 16299 raft_consensus.cc:606] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:51.043761 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:51.044116 16299 raft_consensus.cc:614] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:51.049041 16304 raft_consensus.cc:2368] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 11. Current term is 12.
I20260709 13:18:51.049484 19903 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:51.051147 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:51.052579 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 160814us
I20260709 13:18:51.056828 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.057766 15673 raft_consensus.cc:2410] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:51.057571 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.058070 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.050969 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:51.064618 19374 consensus_queue.cc:1059] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:51.064917 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.065090 16263 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:51.065807 19374 consensus_queue.cc:1059] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:51.066087 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.066314 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:51.066664 19374 raft_consensus.cc:3055] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:51.066998 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.067931 15671 raft_consensus.cc:2368] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11.
I20260709 13:18:51.067734 19855 raft_consensus.cc:3055] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:51.068567 19855 raft_consensus.cc:740] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
W20260709 13:18:51.069437 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.069785 19930 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:51.069578 19855 consensus_queue.cc:260] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.070349 19930 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:51.070848 15642 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:51.070874 19855 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.071318 19930 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.064824 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.067282 19952 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:51.074137 19952 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:51.075103 19952 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.076918 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:51.079046 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:51.079726 15748 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:51.066444 15673 raft_consensus.cc:1275] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:18:51.067044 19374 raft_consensus.cc:740] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:51.087993 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:51.096872 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.101963 16307 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:51.105651 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:51.114280 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.121030 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.124421 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:51.125334 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:51.125854 15675 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:51.125897 15602 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.127763 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:51.138135 15642 leader_election.cc:400] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:51.094897 19857 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:51.141263 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.148255 15642 leader_election.cc:403] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.152942 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:51.122243 19910 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:51.187529 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.188427 15673 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:18:51.190999 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 53091.5us
I20260709 13:18:51.191814 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:51.127308 19879 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.198683 19717 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:51.208719 16306 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:51.210479 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 101594us
I20260709 13:18:51.211266 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:51.217423 19717 consensus_queue.cc:1059] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:51.218348 19717 consensus_queue.cc:1243] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 398beb97ee4b40688f6279f18fa51ade log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:51.219466 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:51.220288 19989 raft_consensus.cc:3055] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:51.220933 19989 raft_consensus.cc:740] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:51.199003 19374 consensus_queue.cc:260] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.220283 15747 raft_consensus.cc:2393] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:51.223398 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.229172 15671 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:51.229729 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:51.230921 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.234275 15673 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:51.254746 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.265600 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.273562 15600 raft_consensus.cc:1240] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:51.199580 19879 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.296773 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.296722 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.302693 15671 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:51.221987 19989 consensus_queue.cc:260] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.277007 19988 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:51.308461 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.311446 15671 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:51.324076 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.325026 15671 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.338281 15671 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:51.342643 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.343631 15676 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:51.308430 19718 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:51.258181 19954 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.354084 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.300418 19979 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:18:51.338896 19828 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:51.385759 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 189782us
I20260709 13:18:51.307663 19448 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:18:51.429641 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.391376 19968 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.446318 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.449045 15746 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:51.394730 19828 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.478353 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.479265 15671 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:51.465698 19804 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:51.511232 15602 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:51.524940 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.445084 19968 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:51.498507 19956 log.cc:927] Time spent T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:18:51.530383 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:51.534433 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.535389 15671 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:51.549072 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:51.551517 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.552758 15671 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:51.557888 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 145600us
W20260709 13:18:51.577178 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.600311 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:51.608660 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 45060.5us
I20260709 13:18:51.614457 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:51.618556 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.624372 15671 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:51.526942 19804 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:51.642504 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 93504.4us
I20260709 13:18:51.644042 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:51.611958 19938 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:51.646124 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:51.671798 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:51.675182 15669 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:51.692873 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:51.695843 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:51.705073 19994 log.cc:927] Time spent T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.348s	user 0.004s	sys 0.000s
I20260709 13:18:51.705713 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:51.706604 15751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1763) took 1257 ms (client timeout 1669 ms). Trace:
W20260709 13:18:51.706962 15751 rpcz_store.cc:269] 0709 13:18:50.449096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.705414 (+1256318us) service_pool.cc:224] Handling call
0709 13:18:51.706543 (+  1129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:51.708298 15751 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:51.711469 15748 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:51.715884 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:51.716230 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:51.717424 16295 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:51.720551 20006 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:18:51.725787 19968 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:51.726152 19925 consensus_meta.cc:287] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.007s
W20260709 13:18:51.726990 20003 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:18:51.728446 20001 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:18:51.728646 16295 raft_consensus.cc:2468] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
W20260709 13:18:51.733285 20002 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:18:51.735227 20000 log.cc:927] Time spent T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:18:51.738562 19997 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
W20260709 13:18:51.741598 19995 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 13:18:51.742552 15674 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:18:51.750609 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.759064 19938 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:51.760363 19874 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:51.761242 19874 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.764997 19934 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.765412 19930 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:51.766042 19930 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.768347 19804 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:51.765887 19934 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.769151 19804 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:51.765059 19899 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.775764 15676 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:51.648667 19954 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:51.799371 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 187082us
W20260709 13:18:51.847097 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 224971us
I20260709 13:18:51.768374 19930 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:51.854346 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.855885 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:51.856745 15674 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:51.858168 15674 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:18:51.866058 15642 connection.cc:256] RPC call timeout handler was delayed by -1.6533212849999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2534s for a response
I20260709 13:18:51.802841 19934 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:51.823824 19874 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:51.798813 20005 consensus_queue.cc:1048] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.158s
W20260709 13:18:51.887347 19914 consensus_meta.cc:287] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: Time spent flushing consensus metadata: real 0.859s	user 0.016s	sys 0.000s
I20260709 13:18:51.894865 15565 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:51.872243 19865 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:51.823500 19899 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:51.882054 19934 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:18:51.908088 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 264136us
I20260709 13:18:51.907359 19934 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:51.892939 19925 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:18:51.909296 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:51.913020 15672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2424) took 1068 ms. Trace:
W20260709 13:18:51.911116 15675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40216 (request call id 757) took 3056 ms (client timeout 1927 ms). Trace:
I20260709 13:18:51.925572 15672 rpcz_store.cc:276] 0709 13:18:50.844494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.844692 (+   198us) service_pool.cc:224] Handling call
0709 13:18:51.911213 (+1066521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.911617 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.911657 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.911716 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:51.911770 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.911847 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:51.912795 (+   948us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000d8250. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:51.912947 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8378,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"spinlock_wait_cycles":2451687680}
W20260709 13:18:51.917078 19999 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.449s	user 0.002s	sys 0.000s
W20260709 13:18:51.927572 15675 rpcz_store.cc:269] 0709 13:18:48.855100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:48.858877 (+  3777us) service_pool.cc:224] Handling call
0709 13:18:51.910815 (+3051938us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54000d8254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:51.910987 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5156667136}
W20260709 13:18:51.925555 19952 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.016s
I20260709 13:18:51.924288 15669 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:51.932322 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 213772us
I20260709 13:18:51.920511 19914 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:51.955595 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:51.934207 19952 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.017s
I20260709 13:18:51.956921 16295 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:51.960500 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:51.978431 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:51.918684 19899 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:52.001639 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2427) took 1143 ms. Trace:
I20260709 13:18:51.913512 19934 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:52.003157 19934 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:52.002272 15677 rpcz_store.cc:276] 0709 13:18:50.857906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.858094 (+   188us) service_pool.cc:224] Handling call
0709 13:18:50.876015 (+ 17921us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:50.901706 (+ 25691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.901757 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:51.201036 (+299279us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b1800344380. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5d12a6 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefcfe9a11 00007faefcff9372 00007faefe72ba01 00007faefe6f043a
0709 13:18:51.698416 (+497380us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b2c00010828. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefcfe9a11 00007faefcff9372 00007faefe72ba01 00007faefe6f043a 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2
0709 13:18:51.699410 (+   994us) log.cc:844] Serialized 52 byte log entry
0709 13:18:51.871108 (+171698us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:51.871147 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.871239 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.001287 (+130048us) raft_consensus.cc:1685] finished
0709 13:18:52.001320 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.001556 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23252,"raft.queue_time_us":14964,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5394,"spinlock_wait_cycles":31915264,"thread_start_us":171196,"threads_started":1,"wal-append.queue_time_us":281917}
I20260709 13:18:52.004475 19725 raft_consensus.cc:3055] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:52.005021 19725 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:52.005906 19725 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:51.962239 20012 consensus_queue.cc:1048] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:18:52.008747 20022 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:52.009327 20022 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:52.011493 20022 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:52.012512 20010 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:18:52.017179 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 708) took 1142 ms. Trace:
I20260709 13:18:51.958814 16265 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:51.957233 19914 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:52.021916 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 112718us
I20260709 13:18:52.018453 15597 rpcz_store.cc:276] 0709 13:18:50.875253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.875369 (+   116us) service_pool.cc:224] Handling call
0709 13:18:50.882233 (+  6864us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:50.923749 (+ 41516us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:51.042981 (+119232us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18000eabe0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb5e5e07 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb600455 00007faf020e83c7 00007faefe6fa9a7 00007faefe70a0bf 00007faefe70a038
0709 13:18:51.271495 (+228514us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.009542 (+738047us) spinlock_profiling.cc:243] Waited 903 us on lock 0x7b18000eabe0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefe2984bc 00007faefb5e648b 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb602c02 00007faefe28a20b 00007faefe28fd23 00007faefe29023a
0709 13:18:52.009824 (+   282us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:52.010433 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 13:18:52.010620 (+   187us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:52.016374 (+  5754us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.016737 (+   363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.016846 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.016907 (+    61us) raft_consensus.cc:1685] finished
0709 13:18:52.016927 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.017116 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37920,"prepare.queue_time_us":511467,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":3648,"raft.queue_time_us":40360,"spinlock_wait_cycles":23683584,"thread_start_us":359776,"threads_started":2,"wal-append.queue_time_us":334475}
I20260709 13:18:52.021027 19903 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:52.023089 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:52.025413 15714 leader_election.cc:400] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11.
I20260709 13:18:52.025986 15714 leader_election.cc:403] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:52.026468 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 159670us
W20260709 13:18:52.026932 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 101220us
I20260709 13:18:51.931751 20018 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:18:52.033852 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 75131.2us
I20260709 13:18:52.039330 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:52.033473 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:52.025498 19914 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:52.039372 15642 connection.cc:256] RPC call timeout handler was delayed by -1.4679212850001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.274s for a response
I20260709 13:18:52.047778 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:52.048748 15746 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:52.054872 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:52.039742 20012 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:18:52.055589 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 155129us
I20260709 13:18:52.075610 15746 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:52.052109 20036 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:52.067296 20012 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.085016 15642 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:52.089411 15597 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:52.068066 20028 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.076071 20026 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:52.090608 19718 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:18:52.089900 20012 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:52.085667 19979 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.133373 19979 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:52.090952 20035 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11.
I20260709 13:18:52.105813 20036 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:52.105249 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:52.668440 15597 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
W20260709 13:18:52.669072 15597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2025) took 1253 ms (client timeout 1602 ms). Trace:
W20260709 13:18:52.669435 15597 rpcz_store.cc:269] 0709 13:18:51.415448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.104146 (+688698us) service_pool.cc:224] Handling call
0709 13:18:52.669007 (+564861us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.670558 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:52.673272 15674 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:52.104843 20028 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:52.678648 20028 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:52.076733 20030 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:18:52.682395 20030 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:52.682801 20030 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:52.683707 20030 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:52.512538 19448 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:52.699981 15670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48128 (request call id 2078) took 1412 ms. Trace:
I20260709 13:18:52.136380 19979 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:52.151487 19899 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:52.156276 20035 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.701472 19899 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:52.181993 20024 log.cc:927] Time spent T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:18:52.187481 20012 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:52.704010 19899 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:52.701599 20030 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:52.704802 20012 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:52.203603 19990 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.080s	user 0.003s	sys 0.000s
I20260709 13:18:52.220156 19914 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:52.708081 19914 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:52.260828 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.708995 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.265880 19981 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 1.344s	user 0.002s	sys 0.004s
I20260709 13:18:52.108207 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:52.412950 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 346342us
W20260709 13:18:52.711220 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 603094us
I20260709 13:18:52.711314 15716 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:52.712195 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:52.429504 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:52.714305 15593 raft_consensus.cc:2393] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 12: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:52.714203 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:52.714744 15593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2022) took 1397 ms (client timeout 1744 ms). Trace:
W20260709 13:18:52.391569 19993 log.cc:927] Time spent T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.782s	user 0.003s	sys 0.000s
W20260709 13:18:52.715150 15593 rpcz_store.cc:269] 0709 13:18:51.317149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.429164 (+1112015us) service_pool.cc:224] Handling call
0709 13:18:52.714687 (+285523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.716097 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:52.716226 15742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48744 (request call id 2517) took 2508 ms. Trace:
I20260709 13:18:52.470346 19989 raft_consensus.cc:3060] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:52.717115 20004 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:52.478689 19879 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:52.718261 19879 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:52.718405 20041 raft_consensus.cc:2804] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:52.719081 20041 raft_consensus.cc:697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:52.484843 19865 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.719973 19865 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:52.483712 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:52.722328 19865 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:52.716619 15742 rpcz_store.cc:276] 0709 13:18:50.208167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.328659 (+120492us) service_pool.cc:224] Handling call
0709 13:18:50.365030 (+ 36371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.365436 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.365476 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.366060 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:18:50.776786 (+410726us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:50.809678 (+ 32892us) log.cc:844] Serialized 14 byte log entry
0709 13:18:51.021786 (+212108us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b1800055d20. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb57dc0a 00007faf04cbd219 00007faefb605a40 00007faefb6004e4 00007faefb600455 00007faefe6e8060 00007faefe6fa716 00007faefe70b287 00007faefe70b208
0709 13:18:51.021969 (+   183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.022046 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.265162 (+1243116us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:52.716024 (+450862us) raft_consensus.cc:1685] finished
0709 13:18:52.716044 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.716169 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2813,"prepare.queue_time_us":34615,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":219812,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":28183,"spinlock_wait_cycles":23398912,"thread_start_us":323913,"threads_started":1,"wal-append.queue_time_us":439878}
I20260709 13:18:52.723026 15673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2440) took 1113 ms. Trace:
I20260709 13:18:52.723434 15673 rpcz_store.cc:276] 0709 13:18:51.609878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.610815 (+   937us) service_pool.cc:224] Handling call
0709 13:18:51.611183 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:51.615869 (+  4686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.615902 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:51.616362 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.929390 (+313028us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:51.929439 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.929508 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.722813 (+793305us) raft_consensus.cc:1685] finished
0709 13:18:52.722833 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.722968 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48226,"raft.queue_time_us":101630,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":115,"thread_start_us":256554,"threads_started":1,"wal-append.queue_time_us":404312}
I20260709 13:18:52.536343 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:52.725757 15601 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2023) took 1377 ms (client timeout 1777 ms). Trace:
W20260709 13:18:52.726231 15601 rpcz_store.cc:269] 0709 13:18:51.348817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.536022 (+1187205us) service_pool.cc:224] Handling call
0709 13:18:52.725693 (+189671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.727417 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:52.543603 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:52.729259 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2027) took 1261 ms. Trace:
I20260709 13:18:52.729743 15599 rpcz_store.cc:276] 0709 13:18:51.467669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.543246 (+1075577us) service_pool.cc:224] Handling call
0709 13:18:52.729177 (+185931us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.730964 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:52.720168 20041 consensus_queue.cc:237] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:52.647238 15497 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 215) took 16890 ms (client timeout 15000 ms). Trace:
I20260709 13:18:52.939929 15598 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
W20260709 13:18:52.940529 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2014) took 1758 ms (client timeout 1894 ms). Trace:
W20260709 13:18:52.940937 15598 rpcz_store.cc:269] 0709 13:18:51.182380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.483412 (+1301032us) service_pool.cc:224] Handling call
0709 13:18:52.940466 (+457054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.579919 19983 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.941910 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:52.942081 19983 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:52.942814 15598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2026) took 1501 ms. Trace:
I20260709 13:18:52.943141 15598 rpcz_store.cc:276] 0709 13:18:51.441175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.941624 (+1500449us) service_pool.cc:224] Handling call
0709 13:18:52.942763 (+  1139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.944038 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:52.944257 19983 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:52.581918 15641 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.597091 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:52.948015 19989 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:52.948232 15672 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:52.093416 20020 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:52.636755 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.963095 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:52.462004 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:52.154240 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 64210.9us
I20260709 13:18:53.001524 19952 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:53.002154 19952 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:52.879739 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 165592us
I20260709 13:18:52.645756 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:52.548409 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:52.719141 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 709) took 1835 ms. Trace:
I20260709 13:18:54.292639 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:52.658010 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:52.552977 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:52.621147 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:54.292888 15595 rpcz_store.cc:276] 0709 13:18:50.883382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.883613 (+   231us) service_pool.cc:224] Handling call
0709 13:18:50.913584 (+ 29971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:50.913833 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:50.913856 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:50.914311 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:18:51.257384 (+343073us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:51.257427 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:51.257699 (+   272us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.390859 (+1133160us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:18:52.718847 (+327988us) raft_consensus.cc:1685] finished
0709 13:18:52.718871 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.719083 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5913856,"thread_start_us":279684,"threads_started":1,"wal-append.queue_time_us":563627,"wal-append.run_cpu_time_us":29914,"wal-append.run_wall_time_us":2754167}
W20260709 13:18:54.297992 15600 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2021) took 3018 ms (client timeout 2016 ms). Trace:
W20260709 13:18:54.298513 15600 rpcz_store.cc:269] 0709 13:18:51.289073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.620768 (+1331695us) service_pool.cc:224] Handling call
0709 13:18:54.297892 (+1677124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.546710 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:54.300985 15594 raft_consensus.cc:2368] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 12. Current term is 13.
W20260709 13:18:54.301508 15594 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2016) took 3105 ms (client timeout 2000 ms). Trace:
W20260709 13:18:54.301940 15594 rpcz_store.cc:269] 0709 13:18:51.196198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.546402 (+1350204us) service_pool.cc:224] Handling call
0709 13:18:54.301429 (+1755027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.303285 15594 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:54.303968 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 2011) took 3223 ms. Trace:
I20260709 13:18:52.896399 15597 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:52.944723 15598 raft_consensus.cc:2393] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 11: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:18:54.304888 15597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2017) took 3096 ms (client timeout 2246 ms). Trace:
W20260709 13:18:54.304984 15598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2008) took 3225 ms (client timeout 3229 ms). Trace:
W20260709 13:18:54.305291 15597 rpcz_store.cc:269] 0709 13:18:51.208286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.670271 (+1461985us) service_pool.cc:224] Handling call
0709 13:18:54.304817 (+1634546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.948565 20060 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:54.306293 20060 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.308873 20060 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:52.728459 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2024) took 1363 ms. Trace:
I20260709 13:18:52.748311 15599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2009) took 1668 ms. Trace:
I20260709 13:18:54.304314 15594 rpcz_store.cc:276] 0709 13:18:51.080237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.302712 (+3222475us) service_pool.cc:224] Handling call
0709 13:18:54.303085 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.303688 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.303882 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:52.938380 15497 rpcz_store.cc:269] 0709 13:18:35.757359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.757670 (+   311us) service_pool.cc:224] Handling call
0709 13:18:52.647151 (+16889481us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:46.831338 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:46.831987 (+   649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:46.832048 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:18:46.832067 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:46.833597 (+  1530us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:46.833699 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:46.833727 (+    28us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:47.060398 (+226671us) tablet.cc:701] Row locks acquired
0709 13:18:47.060463 (+    65us) write_op.cc:260] PREPARE: finished
0709 13:18:47.072783 (+ 12320us) write_op.cc:270] Start()
0709 13:18:47.072982 (+   199us) write_op.cc:276] Timestamp: P: 1783603127072672 usec, L: 0
0709 13:18:47.073015 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:18:47.073837 (+   822us) log.cc:844] Serialized 6234 byte log entry
0709 13:18:49.558225 (+2484388us) op_driver.cc:464] REPLICATION: finished
0709 13:18:50.219165 (+660940us) write_op.cc:301] APPLY: starting
0709 13:18:50.234044 (+ 14879us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:50.304886 (+ 70842us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:50.305027 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:51.218240 (+913213us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:51.218666 (+   426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=32
0709 13:18:51.218713 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:51.219287 (+   574us) log.cc:844] Serialized 212 byte log entry
0709 13:18:51.219481 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:51.219666 (+   185us) write_op.cc:454] Released schema lock
0709 13:18:51.219733 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:51.269100 (+ 49367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:51.272313 (+  3213us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":30556,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":504756,"apply.run_cpu_time_us":40524,"apply.run_wall_time_us":1059413,"cfile_cache_hit":30,"cfile_cache_hit_bytes":31380,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":1,"lbm_read_time_us":85120,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":5,"num_ops":16,"prepare.queue_time_us":102675,"prepare.run_cpu_time_us":16244,"prepare.run_wall_time_us":332763,"raft.queue_time_us":471160,"raft.run_cpu_time_us":14680,"raft.run_wall_time_us":635506,"replication_time_us":2330245,"thread_start_us":449728,"threads_started":4,"wal-append.queue_time_us":214835,"wal-append.run_cpu_time_us":64325,"wal-append.run_wall_time_us":2587492}]]}
I20260709 13:18:54.309531 15601 rpcz_store.cc:276] 0709 13:18:51.364974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.727016 (+1362042us) service_pool.cc:224] Handling call
0709 13:18:52.728389 (+  1373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.760331 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:54.311425 15744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 976) took 1597 ms (client timeout 1903 ms). Trace:
W20260709 13:18:54.311780 15744 rpcz_store.cc:269] 0709 13:18:52.713827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.759927 (+ 46100us) service_pool.cc:224] Handling call
0709 13:18:54.311343 (+1551416us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.700486 15670 rpcz_store.cc:276] 0709 13:18:51.287160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.287333 (+   173us) service_pool.cc:224] Handling call
0709 13:18:51.293817 (+  6484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.680685 (+1386868us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b18003b8f60. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefe2984bc 00007faefb5e648b 00007faf04440ab9 00007faefb60269b 00007faefb60093f 00007faefb600455 00007faefe6e8060 00007faefe6e8bfb 00007faefe6f364b
0709 13:18:52.680866 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.680897 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:52.681467 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.698979 (+ 17512us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:52.699347 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:18:52.699556 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.699639 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:52.699682 (+    43us) raft_consensus.cc:1685] finished
0709 13:18:52.699764 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.699911 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1592,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":192546,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":15971,"spinlock_wait_cycles":4526464,"thread_start_us":214445,"threads_started":2,"wal-append.queue_time_us":3684}
I20260709 13:18:52.763999 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:54.314908 15742 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
W20260709 13:18:54.315372 15742 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 977) took 1554 ms (client timeout 1979 ms). Trace:
W20260709 13:18:54.315704 15742 rpcz_store.cc:269] 0709 13:18:52.761517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.763670 (+  2153us) service_pool.cc:224] Handling call
0709 13:18:54.315320 (+1551650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.762454 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:54.317728 15743 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:54.318203 15743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 978) took 1556 ms. Trace:
I20260709 13:18:54.318504 15743 rpcz_store.cc:276] 0709 13:18:52.761915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.762070 (+   155us) service_pool.cc:224] Handling call
0709 13:18:54.318152 (+1556082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.781514 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:54.323746 15748 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:18:54.324272 15748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44676 (request call id 979) took 1560 ms (client timeout 1530 ms). Trace:
W20260709 13:18:54.324652 15748 rpcz_store.cc:269] 0709 13:18:52.763458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.781107 (+ 17649us) service_pool.cc:224] Handling call
0709 13:18:54.324194 (+1543087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.430601 16299 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45146 (request call id 13) took 1860 ms. Trace:
I20260709 13:18:54.327910 16299 rpcz_store.cc:276] 0709 13:18:50.570175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.618220 (+ 48045us) service_pool.cc:224] Handling call
0709 13:18:52.430374 (+1812154us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54004826d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ea853 00007faf036b860a 00007faefcc3e7d4 00007faefcc3e762 00007faefcc3e691 00007faefcc3e60c 00007faefcc3d8c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:52.430499 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914940160}
I20260709 13:18:52.982486 16295 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:54.330749 16295 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36520 (request call id 884) took 1352 ms. Trace:
I20260709 13:18:54.331112 16295 rpcz_store.cc:276] 0709 13:18:52.980584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.981833 (+  1249us) service_pool.cc:224] Handling call
0709 13:18:52.982244 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.330460 (+1348216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.330687 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:52.221458 16304 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 868) took 1930 ms (client timeout 2163 ms). Trace:
W20260709 13:18:54.333076 16304 rpcz_store.cc:269] 0709 13:18:50.291034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.291698 (+   664us) service_pool.cc:224] Handling call
0709 13:18:52.221190 (+1929492us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54004826d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:52.221364 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1653590272}
I20260709 13:18:54.333655 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:52.489720 16306 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36520 (request call id 880) took 1381 ms. Trace:
I20260709 13:18:52.700448 19448 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.338788 19448 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:52.485455 19374 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:52.214926 19702 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.345908 19702 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:52.424618 19717 consensus_queue.cc:1059] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:54.350139 19717 consensus_queue.cc:1243] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:52.609655 19725 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:54.351728 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1848) took 3323 ms. Trace:
I20260709 13:18:54.352290 15595 rpcz_store.cc:276] 0709 13:18:51.028346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.298102 (+3269756us) service_pool.cc:224] Handling call
0709 13:18:54.298503 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.299105 (+   602us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:54.340070 (+ 40965us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.349579 (+  9509us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.350119 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.350256 (+   137us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.350290 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.350469 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.351493 (+  1024us) raft_consensus.cc:1685] finished
0709 13:18:54.351518 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.351657 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30589,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":206,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":171,"spinlock_wait_cycles":1408,"thread_start_us":49377,"threads_started":2,"wal-append.queue_time_us":9168}
I20260709 13:18:54.356498 20004 consensus_queue.cc:1059] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:54.358286 15669 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:54.358713 15669 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:54.359612 15669 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:53.012470 19767 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:52.643306 19828 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:52.859760 19929 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:53.048960 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.348443 19702 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:54.364869 19929 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.365710 15669 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:54.366707 19828 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:52.637396 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.004s	sys 0.002s
W20260709 13:18:54.369616 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.316s	user 0.006s	sys 0.002s
W20260709 13:18:54.370262 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 2.33087e+06us
I20260709 13:18:54.371038 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:53.814862 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:53.845280 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:54.372390 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:53.877280 19773 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:54.373178 19773 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.376037 19773 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:53.889333 16263 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.009s	sys 0.025s
W20260709 13:18:54.377045 16263 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.395s	user 0.009s	sys 0.026s
W20260709 13:18:54.377357 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 1.39541e+06us
W20260709 13:18:54.168406 14506 debug-util.cc:398] Leaking SignalData structure 0x7b080000fea0 after lost signal to thread 15714
I20260709 13:18:54.378351 19448 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.379035 19448 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:54.379900 15602 raft_consensus.cc:3060] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:54.203486 15642 leader_election.cc:400] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:54.380784 15642 leader_election.cc:403] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:18:54.381712 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 178390us
I20260709 13:18:54.382603 15642 leader_election.cc:400] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:54.382902 15642 leader_election.cc:403] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:54.207440 19939 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.209442 20066 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:54.384891 19939 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.217059 20067 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:54.386045 20067 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.387566 19939 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:54.211170 19930 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.385982 20004 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:54.218530 20068 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:54.388458 19930 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.388974 20004 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623) with higher term. Message: Invalid argument: T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:54.388868 20068 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.390348 20075 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.390733 19930 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:54.229384 20069 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:54.391111 20068 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.233289 19914 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:54.233181 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 1.58739e+06us
I20260709 13:18:54.391837 19914 raft_consensus.cc:697] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:54.391489 20069 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.249447 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:54.392771 19914 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.250320 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:54.393771 15745 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.238787 20070 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:54.394994 20070 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:54.397075 20070 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:52.948617 19989 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.408624 19989 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:52.579993 19945 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:54.410022 19945 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:53.034842 19952 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:53.893935 19979 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.413684 20070 consensus_queue.cc:1048] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:54.414484 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:54.414319 19979 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.416055 15714 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:52.088305 19984 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:54.421950 15672 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:54.422101 19984 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.423084 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.423381 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:54.423724 15673 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:54.424244 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:54.433122 15671 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:54.271049 15567 connection.cc:256] RPC call timeout handler was delayed by -2.1231422119999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2163s for a response
I20260709 13:18:54.270664 15500 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 9 to 10, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 10 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:52.965009 20030 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:52.701573 20035 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:52.716894 20013 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:54.251408 20020 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:54.438632 20035 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:54.276378 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:54.282644 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:54.439263 20035 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:54.439613 20035 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:54.305377 15598 rpcz_store.cc:269] 0709 13:18:51.079397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.943762 (+1864365us) service_pool.cc:224] Handling call
0709 13:18:54.304931 (+1361169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.439960 20035 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.310570 15594 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:54.440173 15743 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:54.440762 15594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 2013) took 3360 ms. Trace:
I20260709 13:18:54.334635 15744 raft_consensus.cc:2410] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:18:54.441201 15594 rpcz_store.cc:276] 0709 13:18:51.168385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.310075 (+3141690us) service_pool.cc:224] Handling call
0709 13:18:54.310396 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.440481 (+130085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.440703 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.335132 15742 raft_consensus.cc:1240] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:54.442052 19773 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.335184 16306 rpcz_store.cc:276] 0709 13:18:51.107827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.107981 (+   154us) service_pool.cc:224] Handling call
0709 13:18:52.489509 (+1381528us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5400600254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:52.489649 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87131008}
I20260709 13:18:54.309726 15599 rpcz_store.cc:276] 0709 13:18:51.079698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.730580 (+1650882us) service_pool.cc:224] Handling call
0709 13:18:52.748233 (+ 17653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.442598 19773 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.362818 19767 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.367202 19828 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:54.446115 19828 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:54.446645 19828 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:54.447088 19828 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.384958 20066 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:54.447762 20035 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.387660 19929 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.225646 16265 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:54.238436 19943 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.401504 15745 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:54.402726 19448 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:54.405397 20067 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:53.038385 19983 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:54.419538 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:54.420820 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:54.421775 20068 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:52.872375 20022 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:52.860462 20028 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.424803 20075 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:54.425233 15602 raft_consensus.cc:2468] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:54.425830 15673 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:54.426218 19979 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.412391 19945 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.426671 19984 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.393837 20069 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.430030 15595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51468 (request call id 1850) took 2809 ms. Trace:
I20260709 13:18:54.430766 15596 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:54.431533 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:54.434424 15567 connection.cc:256] RPC call timeout handler was delayed by -1.6233536039999308s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260709 13:18:54.434800 15500 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.435813 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.293648 15750 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:52.946121 15593 raft_consensus.cc:3060] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:54.539108 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 146616us
I20260709 13:18:54.544402 15600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 720) took 3485 ms. Trace:
I20260709 13:18:54.657868 15671 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
W20260709 13:18:54.524679 15623 debug-util.cc:398] Leaking SignalData structure 0x7b080022e3c0 after lost signal to thread 14501
I20260709 13:18:54.474789 15669 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:18:54.659170 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 434137us
W20260709 13:18:54.659193 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08000be5a0 after lost signal to thread 14504
W20260709 13:18:54.481932 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 104094us
I20260709 13:18:54.450714 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.671383 15674 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:54.671780 15670 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:54.674157 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2464) took 2025 ms. Trace:
W20260709 13:18:54.675391 15567 connection.cc:256] RPC call timeout handler was delayed by -1.5432536040000286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:18:54.675865 15567 connection.cc:256] RPC call timeout handler was delayed by -1.3623536039999635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 13:18:54.676627 15595 rpcz_store.cc:276] 0709 13:18:51.620252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.354240 (+2733988us) service_pool.cc:224] Handling call
0709 13:18:54.354617 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.428872 (+ 74255us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:54.428916 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.428971 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.429026 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.429732 (+   706us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b54002d7dd4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:54.429786 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.429946 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170131200}
W20260709 13:18:54.547219 15548 auto_rebalancer.cc:893] Removing replace marker failed: Replica 7019261981c6431baddd6812c15ac678 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:54.658419 15600 rpcz_store.cc:276] 0709 13:18:51.058503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.299388 (+3240885us) service_pool.cc:224] Handling call
0709 13:18:54.307056 (+  7668us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:54.307993 (+   937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.308029 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:54.308720 (+   691us) log.cc:844] Serialized 52 byte log entry
0709 13:18:54.321287 (+ 12567us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.330618 (+  9331us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.331138 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.331221 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.331275 (+    54us) raft_consensus.cc:1685] finished
0709 13:18:54.331287 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.544111 (+212824us) spinlock_profiling.cc:243] Waited 7.21 ms on lock 0x7b54002d73d0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:54.544314 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8726,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":374,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":190,"spinlock_wait_cycles":16585600,"thread_start_us":20939,"threads_started":2,"wal-append.queue_time_us":12487}
W20260709 13:18:54.680637 15602 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2004) took 3618 ms (client timeout 2191 ms). Trace:
W20260709 13:18:54.685384 15623 debug-util.cc:398] Leaking SignalData structure 0x7b080014bba0 after lost signal to thread 15534
W20260709 13:18:54.685909 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5c60 after lost signal to thread 15548
W20260709 13:18:54.687358 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb880 after lost signal to thread 15626
W20260709 13:18:54.687739 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8f60 after lost signal to thread 15627
I20260709 13:18:54.690308 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:54.691010 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 266824us
I20260709 13:18:54.691948 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:54.693538 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:54.695305 15714 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:54.696278 15623 debug-util.cc:398] Leaking SignalData structure 0x7b0800339ea0 after lost signal to thread 15701
W20260709 13:18:54.696709 15623 debug-util.cc:398] Leaking SignalData structure 0x7b0800337500 after lost signal to thread 15702
W20260709 13:18:54.697220 15596 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51472 (request call id 2019) took 3441 ms (client timeout 2088 ms). Trace:
W20260709 13:18:54.697623 15596 rpcz_store.cc:269] 0709 13:18:51.256168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.657698 (+1401530us) service_pool.cc:224] Handling call
0709 13:18:54.697042 (+2039344us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003192d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:54.697150 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232049024}
W20260709 13:18:54.698164 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb3e0 after lost signal to thread 15775
W20260709 13:18:54.698560 15623 debug-util.cc:398] Leaking SignalData structure 0x7b0800361de0 after lost signal to thread 15776
I20260709 13:18:54.674623 15669 rpcz_store.cc:276] 0709 13:18:52.667862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.670004 (+  2142us) service_pool.cc:224] Handling call
0709 13:18:52.670360 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.358178 (+1687818us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b540015b6a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe667dc0 00007faefe6f21c0 00007faefe6f3231 00007faefe6efd8f 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c
0709 13:18:54.673878 (+315700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.674096 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3877256448}
W20260709 13:18:54.699435 15623 debug-util.cc:398] Leaking SignalData structure 0x7b080038a820 after lost signal to thread 16299
W20260709 13:18:54.699790 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08003aeae0 after lost signal to thread 16304
W20260709 13:18:54.700088 15623 debug-util.cc:398] Leaking SignalData structure 0x7b080033b200 after lost signal to thread 16306
W20260709 13:18:54.701340 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8900 after lost signal to thread 16334
W20260709 13:18:54.681066 15602 rpcz_store.cc:269] 0709 13:18:51.061794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.552640 (+1490846us) service_pool.cc:224] Handling call
0709 13:18:54.680410 (+2127770us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b5400247f54. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:54.680538 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190889856}
W20260709 13:18:54.701819 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4900 after lost signal to thread 19374
W20260709 13:18:54.702127 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8b60 after lost signal to thread 19702
I20260709 13:18:54.702184 15597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51472 (request call id 2012) took 3621 ms. Trace:
W20260709 13:18:54.702417 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08003b89a0 after lost signal to thread 19717
W20260709 13:18:54.701499 16263 leader_election.cc:336] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Timed out: RequestConsensusVote RPC to 127.14.41.66:33941 timed out after 2.120s (SENT)
I20260709 13:18:54.707278 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:54.546867 20012 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:54.708884 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08003b8da0 after lost signal to thread 19725
I20260709 13:18:54.712000 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:54.467911 19828 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:54.715176 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 102629us
I20260709 13:18:54.499993 20066 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:54.706956 20075 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
W20260709 13:18:54.715695 15548 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:18:54.707846 20085 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.449477 19773 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.732719 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:54.717960 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:54.508937 19767 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:54.704506 19717 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:18:54.661056 20070 raft_consensus.cc:2764] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:18:54.719149 19945 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:54.719079 19989 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:54.723785 20067 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:54.713697 16299 raft_consensus.cc:2410] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:18:54.689188 19374 raft_consensus.cc:2804] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:54.721086 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.511582 20035 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.721762 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:54.684299 20069 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:54.724499 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:54.725003 16263 connection.cc:256] RPC call timeout handler was delayed by -1.4397328330001073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3215s for a response
I20260709 13:18:54.720940 20012 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.438912 20020 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.759163 19989 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.772670 20004 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.773510 20004 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.774559 20020 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.696221 20028 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.726440 19899 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.775377 15671 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:54.775662 19899 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.777112 15672 raft_consensus.cc:1275] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:54.728222 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:54.777851 15668 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.696106 20022 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:54.695899 19983 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:54.731535 15548 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:18:54.747301 19979 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:54.678840 19943 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.743914 15500 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 7, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:54.719461 15623 debug-util.cc:398] Leaking SignalData structure 0x7b08002403a0 after lost signal to thread 19828
I20260709 13:18:54.760203 16309 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:54.761556 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.762588 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.786037 15675 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:54.776300 20004 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.764875 15669 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:54.765868 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.702803 15597 rpcz_store.cc:276] 0709 13:18:51.080492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.306240 (+3225748us) service_pool.cc:224] Handling call
0709 13:18:54.680569 (+374329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.680924 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.680954 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.680995 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.681029 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.681104 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.702012 (+ 20908us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400247f50. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ef8ad 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:54.702132 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11370,"spinlock_wait_cycles":860021120}
I20260709 13:18:54.768635 20075 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:54.738726 20085 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:54.780966 16308 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:54.763990 15642 connection.cc:256] RPC call timeout handler was delayed by -1.260563558000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:18:54.805450 15642 connection.cc:256] RPC call timeout handler was delayed by -1.2146635579999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 13:18:54.793771 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 74119.8us
I20260709 13:18:54.795054 15593 raft_consensus.cc:2468] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
W20260709 13:18:54.806620 15593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34574 (request call id 721) took 3314 ms (client timeout 1999 ms). Trace:
W20260709 13:18:54.807073 15593 rpcz_store.cc:269] 0709 13:18:51.492016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.715835 (+1223819us) service_pool.cc:224] Handling call
0709 13:18:54.806550 (+2090715us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.806105 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:54.810366 15642 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:54.815330 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.774569 19989 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:54.776959 20060 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:54.780700 20013 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:54.829089 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 133856us
W20260709 13:18:54.832679 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 107681us
I20260709 13:18:54.835919 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:54.837723 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:54.779354 20069 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:54.830155 20020 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:54.844043 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:54.861276 15670 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:54.863040 15677 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:54.864514 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:54.846382 19374 raft_consensus.cc:697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:54.880016 19374 consensus_queue.cc:237] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.881402 20066 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:18:54.881682 20022 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:54.870678 19983 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:54.871085 20083 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:18:54.871614 19899 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:54.894939 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 58812.7us
I20260709 13:18:54.877319 20085 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:54.843847 20099 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:54.848433 20035 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:54.835902 20060 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:54.885181 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 59806.6us
I20260709 13:18:54.841813 19984 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:18:54.890431 15668 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:54.868140 20067 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:54.900241 15642 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:54.871676 20084 log.cc:927] Time spent T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:18:54.902869 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72134.4us
W20260709 13:18:54.912546 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.839110 20013 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:54.913631 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.902552 20035 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.903692 20004 raft_consensus.cc:2764] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:18:54.915017 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:54.920025 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:54.920254 15642 leader_election.cc:336] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.537s (SENT)
I20260709 13:18:54.921795 16309 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:54.922377 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:54.929621 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:54.929703 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:54.931536 16306 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:54.932312 19943 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:54.898028 20099 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:54.919482 20020 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:54.921096 20035 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:54.925729 20067 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:54.945041 15500 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:54.939733 20103 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:54.949390 19899 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.949995 19899 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:54.952307 19899 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:54.971967 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:54.971680 15500 catalog_manager.cc:5697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:54.953111 20069 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:54.973037 20066 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:54.938836 20099 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:54.942962 20020 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:54.987073 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 148464us
I20260709 13:18:54.979679 20060 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:18:54.991257 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 121983us
I20260709 13:18:54.993940 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.994657 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.994799 15668 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:54.995271 15670 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:54.997857 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:54.999841 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.000407 15673 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:55.001362 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.002215 15675 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:18:55.003263 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.004007 15674 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:54.989192 19983 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:55.006556 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.008041 20112 consensus_queue.cc:1059] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:55.008298 20101 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:54.984894 20104 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:55.009186 20104 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.009819 20104 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.009104 20067 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.010918 16263 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:55.014757 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:54.988103 20020 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.018868 16263 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:55.013795 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:18:55.023471 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:55.025530 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.026510 15668 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:18:55.029951 20096 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:18:55.029807 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 109585us
W20260709 13:18:55.033392 15642 leader_election.cc:336] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.877s (SENT)
I20260709 13:18:55.033783 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.020562 20101 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:54.979772 20066 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.032968 20075 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:55.037186 20075 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:55.058207 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:55.061247 16295 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.035728 20060 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.029726 20109 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:55.072384 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fa9cf9412ae412a8756d1fc1138ddce" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.081209 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:55.081210 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 47839.2us
W20260709 13:18:55.082522 15642 leader_election.cc:336] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.938s (SENT)
I20260709 13:18:55.082931 15642 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.039232 20101 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.070071 20069 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.095263 20066 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:55.095680 15642 leader_election.cc:336] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.158s (SENT)
I20260709 13:18:55.096266 15642 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.095929 20066 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.071560 20096 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:55.106009 20103 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:55.093334 20075 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:55.109265 20098 log.cc:927] Time spent T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:18:55.113392 16295 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:55.137435 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 144555us
W20260709 13:18:55.142191 15714 connection.cc:256] RPC call timeout handler was delayed by -2.7124339290000989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:18:55.142827 15714 connection.cc:256] RPC call timeout handler was delayed by -2.6602339290000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
W20260709 13:18:55.143286 15714 connection.cc:256] RPC call timeout handler was delayed by -2.6260339289999592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:18:55.143651 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 247663us
I20260709 13:18:55.143796 20125 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:55.144443 20125 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.145773 16265 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.088305 20111 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:55.156986 20111 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.090133 20101 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.159590 20111 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.101733 20069 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.160938 20110 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:55.161551 20104 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:55.151914 20128 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:55.162600 20069 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.111512 20114 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:55.152581 20013 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:55.165009 20096 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.167341 20104 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:55.154376 20030 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:55.149933 15714 connection.cc:256] RPC call timeout handler was delayed by -2.5369339290000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:18:55.171128 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:55.181180 15714 connection.cc:256] RPC call timeout handler was delayed by -2.5198339290000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:18:55.176064 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.177466 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.178158 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.182483 15746 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:55.182866 16295 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:55.174827 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:55.181674 15714 connection.cc:256] RPC call timeout handler was delayed by -2.5171339290000105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:18:55.163694 20100 consensus_queue.cc:1059] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:55.183545 15714 connection.cc:256] RPC call timeout handler was delayed by -2.49823392899998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:18:55.184129 15714 connection.cc:256] RPC call timeout handler was delayed by -2.468533928999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 13:18:55.184554 15714 connection.cc:256] RPC call timeout handler was delayed by -2.4289339290000953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 13:18:55.184975 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3839339290000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:18:55.185380 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3632339289999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 13:18:55.183583 15742 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
W20260709 13:18:55.185941 15714 connection.cc:256] RPC call timeout handler was delayed by -2.33893392899995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:18:55.186250 15714 connection.cc:256] RPC call timeout handler was delayed by -2.3326339289999396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
I20260709 13:18:55.185223 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:55.186653 15714 connection.cc:256] RPC call timeout handler was delayed by -2.2678339290000622s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 13:18:55.187170 15714 connection.cc:256] RPC call timeout handler was delayed by -2.2534339290000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 13:18:55.187474 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1886339289999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 13:18:55.187883 15749 raft_consensus.cc:2410] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:18:55.187848 15714 connection.cc:256] RPC call timeout handler was delayed by -2.1508339290001004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:18:55.188412 15714 connection.cc:256] RPC call timeout handler was delayed by -2.0959339290000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
W20260709 13:18:55.188836 15714 connection.cc:256] RPC call timeout handler was delayed by -2.0464339289999316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22460000000000002s for a response
W20260709 13:18:55.189224 15714 connection.cc:256] RPC call timeout handler was delayed by -1.7485339289999047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2577s for a response
W20260709 13:18:55.189631 15714 connection.cc:256] RPC call timeout handler was delayed by -1.5613339290000567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2785s for a response
W20260709 13:18:55.190001 15714 connection.cc:256] RPC call timeout handler was delayed by -1.1617339290000928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3229s for a response
I20260709 13:18:55.191093 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.191490 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.191685 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.192037 15745 raft_consensus.cc:2368] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:18:55.192505 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.192775 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:55.192795 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.194247 15746 raft_consensus.cc:2410] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:18:55.194393 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.195363 15747 raft_consensus.cc:2410] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:55.196201 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.196233 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.197830 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.198112 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.199108 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:55.200134 15747 raft_consensus.cc:2368] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:55.201318 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:55.202626 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 263417us
I20260709 13:18:55.203568 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.204459 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.205052 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.205456 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2d5bac8fb54783a1f420061d08067f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.205976 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.206475 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.207123 15742 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 7.
I20260709 13:18:55.207990 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.209113 15744 raft_consensus.cc:2393] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:55.209160 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.210075 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:55.169059 20085 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:55.211122 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.211865 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.212142 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.212539 15744 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:55.084236 20109 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.214186 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.207132 20100 consensus_queue.cc:1243] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer 5433f0c9863e427d88ba5916819e28e3 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:55.215487 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.215564 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.156296 20099 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.214593 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.233157 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:55.217957 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 122296us
I20260709 13:18:55.216317 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.230943 15714 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:55.229135 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.245877 15744 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:55.246948 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.247200 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.229732 20125 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.253309 15742 raft_consensus.cc:2410] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:55.248765 20109 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.263696 16304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.264196 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:55.262678 15743 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:18:55.265849 16302 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.266868 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.267477 15742 raft_consensus.cc:2393] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:55.268087 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.271113 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.271486 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.272423 20109 raft_consensus.cc:2764] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:18:55.272792 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.216497 20085 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:55.273867 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:55.275031 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8800 after lost signal to thread 14504
W20260709 13:18:55.275843 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45031.9us
W20260709 13:18:55.276327 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9380 after lost signal to thread 15534
I20260709 13:18:55.276681 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.276960 15747 raft_consensus.cc:2410] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:18:55.277477 20109 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:55.277643 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003ee9c0 after lost signal to thread 15626
I20260709 13:18:55.278841 15714 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.279069 20035 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:55.279417 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.279762 16302 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:55.279874 20109 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:55.280119 15747 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:55.274879 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.274978 20085 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:55.278844 15772 debug-util.cc:398] Leaking SignalData structure 0x7b080038c880 after lost signal to thread 15701
W20260709 13:18:55.282944 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003740e0 after lost signal to thread 15702
W20260709 13:18:55.284204 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003e2680 after lost signal to thread 15775
W20260709 13:18:55.284484 15772 debug-util.cc:398] Leaking SignalData structure 0x7b080020ffc0 after lost signal to thread 15776
W20260709 13:18:55.285804 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccd40 after lost signal to thread 16334
I20260709 13:18:55.285669 20099 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:55.286734 15772 debug-util.cc:398] Leaking SignalData structure 0x7b080038f8e0 after lost signal to thread 19945
W20260709 13:18:55.287014 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08002147c0 after lost signal to thread 19952
W20260709 13:18:55.287271 15772 debug-util.cc:398] Leaking SignalData structure 0x7b0800106800 after lost signal to thread 19983
W20260709 13:18:55.287484 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003f10e0 after lost signal to thread 19984
W20260709 13:18:55.287694 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5860 after lost signal to thread 19989
W20260709 13:18:55.287973 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003438c0 after lost signal to thread 20013
W20260709 13:18:55.288237 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7be0 after lost signal to thread 20022
W20260709 13:18:55.288503 15772 debug-util.cc:398] Leaking SignalData structure 0x7b080030e340 after lost signal to thread 20028
W20260709 13:18:55.288861 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003fe8e0 after lost signal to thread 20030
W20260709 13:18:55.289098 15772 debug-util.cc:398] Leaking SignalData structure 0x7b08003cda80 after lost signal to thread 20035
I20260709 13:18:55.289278 20012 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:55.289453 20066 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.276034 20020 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.292635 20020 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.295306 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.297719 15748 raft_consensus.cc:2368] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 11.
I20260709 13:18:55.281510 15714 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.288434 20101 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.316738 20101 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:55.318989 20035 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:55.319571 20028 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:55.326920 19939 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.006s	sys 0.005s
W20260709 13:18:55.327423 19939 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.006s	sys 0.006s
I20260709 13:18:55.333498 20110 raft_consensus.cc:3055] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:55.334043 20110 raft_consensus.cc:740] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:55.335026 20110 consensus_queue.cc:260] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.336450 20110 raft_consensus.cc:3060] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.251044 15596 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
W20260709 13:18:55.405257 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.405699 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.407585 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.407934 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.409475 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.405298 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.407992 15594 raft_consensus.cc:2368] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 12. Current term is 13.
W20260709 13:18:55.411751 15642 leader_election.cc:336] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.194s (SENT)
I20260709 13:18:55.412451 15668 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:55.412521 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:55.415158 15642 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.675s (SENT)
I20260709 13:18:55.415794 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.245282 15600 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:55.229508 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.405298 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:55.421768 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 140140us
I20260709 13:18:55.425357 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.426489 15672 raft_consensus.cc:2376] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10. Re-sending same reply.
I20260709 13:18:55.429318 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.429502 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.431051 15669 raft_consensus.cc:2410] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:18:55.431201 15675 raft_consensus.cc:2393] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 10: Already voted for candidate 558532223b984cf796cb6b98ddd6c9f2 in this term.
I20260709 13:18:55.428285 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.432273 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.432530 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:55.438325 15669 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:55.439029 15675 raft_consensus.cc:2376] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12. Re-sending same reply.
I20260709 13:18:55.439925 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:55.443028 15669 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.433379 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.444092 15601 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34574 (request call id 722) took 3951 ms. Trace:
I20260709 13:18:55.444968 15674 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 11: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:55.446115 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.446857 15674 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:55.447628 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.437705 15672 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:55.433291 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.451321 15668 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 8.
I20260709 13:18:55.440517 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.452883 15675 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:55.456687 15601 rpcz_store.cc:276] 0709 13:18:51.492483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.310410 (+2817927us) service_pool.cc:224] Handling call
0709 13:18:54.310713 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.824295 (+513582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.824323 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.824363 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:54.824397 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.443433 (+619036us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400164254. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f0e01 00007faefe6ef83e 00007faf036b4419 00007faefcc2bbd4 00007faefcc2bb62 00007faefcc2ba91 00007faefcc2ba0c 00007faefcc2acc2 00007faefca2b48c 00007faefca2a8c6
0709 13:18:55.443513 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.443819 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180682112}
I20260709 13:18:55.441087 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:55.467700 15751 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48744 (request call id 2550) took 1194 ms (client timeout 1507 ms). Trace:
W20260709 13:18:55.468317 15751 rpcz_store.cc:269] 0709 13:18:54.273189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.276148 (+  2959us) service_pool.cc:224] Handling call
0709 13:18:55.467181 (+1191033us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54002774d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:18:55.467462 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098639104}
W20260709 13:18:55.477473 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.485100 19717 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.486406 19717 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:55.498701 15750 raft_consensus.cc:1240] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:55.500452 20022 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.511163 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.519151 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.500589 20035 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.527544 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.528481 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.529316 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.507915 20125 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:55.533579 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:55.538303 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.539292 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.507282 20030 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:55.553257 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 92914.7us
I20260709 13:18:55.554874 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:55.548334 20085 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:55.558241 20085 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:55.558394 20066 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:55.559119 20066 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:55.559702 20066 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.561782 19767 raft_consensus.cc:3055] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:55.561535 20030 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.562402 19767 raft_consensus.cc:740] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:55.565886 20030 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:55.573022 15673 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:55.574609 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.574975 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.575559 15676 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:18:55.575700 15677 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
W20260709 13:18:55.577400 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:55.577929 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.579404 15748 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:18:55.580037 15748 pending_rounds.cc:85] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 9
I20260709 13:18:55.580878 15748 pending_rounds.cc:107] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:18:55.581171 15748 raft_consensus.cc:2889] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:55.560190 20085 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:55.583779 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "958e81841a784ee79fccc9f488562c59" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.585510 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.586872 15673 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:18:55.590690 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.564369 19767 consensus_queue.cc:260] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.593559 15675 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 11: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:55.593987 19767 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.601763 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.607882 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.627277 15749 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
W20260709 13:18:55.628995 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 74439.3us
I20260709 13:18:55.630052 15714 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.631495 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.632473 15748 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:55.635772 15743 raft_consensus.cc:1240] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:55.647135 15642 leader_election.cc:336] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 3.149s (SENT)
I20260709 13:18:55.649783 19930 consensus_queue.cc:1048] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:55.650687 19930 consensus_queue.cc:1243] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer 7019261981c6431baddd6812c15ac678 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:55.650823 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.651619 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:55.652573 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:55.651685 16299 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
W20260709 13:18:55.655299 15642 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 3.270s (SENT)
I20260709 13:18:55.666149 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:55.671182 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:55.673377 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.673949 19717 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:55.681703 15669 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 13.
I20260709 13:18:55.692093 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:55.692970 15746 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:55.697456 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 503032us
W20260709 13:18:55.700011 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 44815.2us
I20260709 13:18:55.701817 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:55.713637 20066 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.715044 15747 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:55.714644 20028 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.716691 20028 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.717175 20028 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.718493 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:55.722337 20066 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.728788 20030 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:55.730737 20105 consensus_queue.cc:1059] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:55.732231 16265 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:55.733604 19717 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:55.753926 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:55.754253 16299 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:55.754684 20004 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:55.755710 20105 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:55.754218 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:55.742584 19717 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:55.759708 20105 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.771653 15746 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:55.765106 19717 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.772784 15669 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.767916 15567 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.767272 20004 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:55.778960 20004 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:55.780108 20068 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:55.780583 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 107389us
I20260709 13:18:55.781597 20030 consensus_queue.cc:1059] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:55.770596 20105 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.781167 20099 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:55.801831 20152 log.cc:927] Time spent T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:18:55.804845 20099 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:55.794576 19702 raft_consensus.cc:3055] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:55.806945 19702 raft_consensus.cc:740] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:55.808187 19702 consensus_queue.cc:260] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.808751 16265 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:55.812518 20102 consensus_queue.cc:1059] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:55.800552 15744 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:55.823038 19773 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:55.823489 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.825927 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:55.828140 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 83301.6us
I20260709 13:18:55.832434 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.799321 20028 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.823395 20094 raft_consensus.cc:2804] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:55.821979 19702 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.841697 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.841935 20020 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:55.842067 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.842532 20020 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.842929 20020 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:55.843930 20030 raft_consensus.cc:3055] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:55.844468 20030 raft_consensus.cc:740] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:55.853765 19899 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:55.858717 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:55.861908 15673 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:55.839330 19930 raft_consensus.cc:3055] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:55.872072 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.874660 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.884362 20110 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:55.873066 20094 raft_consensus.cc:697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:55.890308 20094 consensus_queue.cc:237] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:55.892159 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 67058.8us
I20260709 13:18:55.893153 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.894775 15714 leader_election.cc:400] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 12. Current term is 13.
I20260709 13:18:55.894855 20105 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.895445 20066 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:55.899348 20030 consensus_queue.cc:260] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.903487 20105 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:55.895107 15714 leader_election.cc:403] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.905016 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.908865 20099 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.909431 20028 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:55.873368 19930 raft_consensus.cc:740] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:55.912714 19930 consensus_queue.cc:260] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:55.913996 20066 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:55.914222 19930 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.914841 20066 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:55.917835 20066 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:55.922518 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:55.924957 20066 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:55.927081 20066 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:55.921080 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.893180 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:55.931284 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:55.937069 20110 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:55.948920 15674 raft_consensus.cc:1240] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:55.950541 15673 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:55.950455 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:55.953410 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:55.957531 15671 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 7.
I20260709 13:18:55.959503 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:55.966210 15751 raft_consensus.cc:1240] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:55.967140 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:55.969292 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 44735.8us
I20260709 13:18:55.971905 15677 raft_consensus.cc:3060] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:18:55.972273 15746 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:55.983795 16299 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:55.991475 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.000443 19958 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:55.993908 15496 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 8 to 10, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 10 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.002233 15599 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:18:56.002740 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.003813 15600 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:56.001027 15742 raft_consensus.cc:1240] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:56.009704 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.007921 15672 pending_rounds.cc:85] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 7
I20260709 13:18:56.014655 15672 pending_rounds.cc:107] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:18:56.014899 15672 raft_consensus.cc:2889] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:56.017894 16265 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.018783 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.018777 20125 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.025034 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.020044 20020 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.016458 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.033404 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:56.037004 20156 log.cc:927] Time spent T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.145s	user 0.003s	sys 0.001s
I20260709 13:18:56.037847 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.037964 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.038811 15599 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:56.023994 20066 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:56.039448 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.040295 15599 raft_consensus.cc:1275] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:18:56.044579 15715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.050856 15669 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:56.053995 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.025883 20068 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.061457 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.060549 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.065109 15567 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:56.065299 20099 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 12. Current term is 13.
W20260709 13:18:56.065627 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 142731us
I20260709 13:18:56.066123 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.067754 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.069458 19773 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.070154 19773 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:56.081405 15600 raft_consensus.cc:2410] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade for term 13 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:18:56.093703 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.073338 15640 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.073346 20093 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:56.101204 15747 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:56.073004 20160 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:18:56.082681 20030 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:56.072974 20110 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.073815 19828 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.072552 19773 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:56.072794 20082 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:56.145372 16299 raft_consensus.cc:2468] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:56.107245 20093 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.147294 15601 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
W20260709 13:18:56.154968 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 158256us
I20260709 13:18:56.151328 20093 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:56.169843 20163 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
W20260709 13:18:56.171130 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 97955.6us
I20260709 13:18:56.153313 20028 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:56.158121 19773 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.193624 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:56.189489 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 121035us
I20260709 13:18:56.175101 19828 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:18:56.208314 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 140640us
I20260709 13:18:56.167730 20082 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.195475 20068 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.224299 20020 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:56.228111 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 88737.7us
I20260709 13:18:56.233202 15640 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:56.234032 20167 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:56.234956 15640 leader_election.cc:400] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 12. Current term is 13.
I20260709 13:18:56.235294 15640 leader_election.cc:403] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.236819 20004 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.237542 20004 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 12. Current term is 13.
W20260709 13:18:56.241166 20161 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:18:56.242152 20162 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:18:56.243076 15500 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 292) took 30627 ms (client timeout 15000 ms). Trace:
I20260709 13:18:56.243317 19717 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.246615 15496 catalog_manager.cc:5697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
W20260709 13:18:56.249866 20166 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:56.250016 16263 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.251366 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.042889 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:56.251729 20082 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:56.252797 20105 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:56.253240 20105 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.253573 20105 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:56.255591 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.256283 15595 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:56.256904 15674 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:56.257956 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 84511.9us
I20260709 13:18:56.260488 15747 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:18:56.251772 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:56.248081 15496 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 8, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 8 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:56.274722 15677 raft_consensus.cc:2468] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
W20260709 13:18:56.243498 15500 rpcz_store.cc:269] 0709 13:18:25.615680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.616130 (+   450us) service_pool.cc:224] Handling call
0709 13:18:56.242798 (+30626668us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:55.136838 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:55.137607 (+   769us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:55.137641 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:55.137658 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:55.138555 (+   897us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:55.138666 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:55.138707 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:55.139455 (+   748us) tablet.cc:701] Row locks acquired
0709 13:18:55.139476 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:55.139678 (+   202us) write_op.cc:270] Start()
0709 13:18:55.139823 (+   145us) write_op.cc:276] Timestamp: P: 1783603135139614 usec, L: 0
0709 13:18:55.139848 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:55.141935 (+  2087us) log.cc:844] Serialized 2064 byte log entry
0709 13:18:55.327968 (+186033us) op_driver.cc:464] REPLICATION: finished
0709 13:18:55.330961 (+  2993us) write_op.cc:301] APPLY: starting
0709 13:18:55.331052 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:55.340097 (+  9045us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:55.340244 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:55.345280 (+  5036us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:55.345838 (+   558us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 13:18:55.345913 (+    75us) write_op.cc:312] APPLY: finished
0709 13:18:55.346264 (+   351us) log.cc:844] Serialized 57 byte log entry
0709 13:18:55.346475 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.346599 (+   124us) write_op.cc:454] Released schema lock
0709 13:18:55.346647 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:55.347102 (+   455us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.347154 (+    52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10920,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":2690,"apply.run_cpu_time_us":10076,"apply.run_wall_time_us":16096,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25047,"num_ops":5,"prepare.queue_time_us":156681,"prepare.run_cpu_time_us":15473,"prepare.run_wall_time_us":179147,"raft.queue_time_us":2024,"raft.run_cpu_time_us":1789,"raft.run_wall_time_us":3068,"replication_time_us":187886,"thread_start_us":333166,"threads_started":4,"wal-append.queue_time_us":179026}]]}
W20260709 13:18:56.292744 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:56.295689 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.289099 15496 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.306059 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.257315 20094 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:56.308797 20085 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.311645 19717 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:56.305943 15642 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.550s (SENT)
I20260709 13:18:56.313068 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:56.317401 15565 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.318806 15565 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:56.319993 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.313231 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.326793 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:18:56.327109 15642 leader_election.cc:336] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.633s (SENT)
I20260709 13:18:56.327520 15642 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.328369 20020 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.347510 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:56.349932 15642 leader_election.cc:336] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.659s (SENT)
I20260709 13:18:56.350822 15642 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.353629 20097 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:56.354045 19828 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:56.357062 15496 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 8, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 8 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:56.345844 20030 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:56.367847 20093 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:56.369379 16265 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
W20260709 13:18:56.375018 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 55088.6us
I20260709 13:18:56.349392 19717 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.394479 15565 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.398509 19952 raft_consensus.cc:2804] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:56.380795 20110 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.383966 20094 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:18:56.390010 20097 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.408053 15496 catalog_manager.cc:5697] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 9, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:56.399484 20020 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:18:56.423102 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 127484us
W20260709 13:18:56.430943 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 93485.4us
I20260709 13:18:56.408864 20094 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:56.437489 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:18:56.439379 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 109771us
I20260709 13:18:56.422906 20082 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:56.444105 20176 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:56.411988 20097 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.444754 20176 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.432091 15496 catalog_manager.cc:5697] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:56.445406 20176 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.447104 15496 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 8, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 8 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:56.437482 20173 log.cc:927] Time spent T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.128s	user 0.001s	sys 0.001s
I20260709 13:18:56.437693 20093 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:56.450131 15714 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:56.457006 15642 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.663s (SENT)
I20260709 13:18:56.457625 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:56.459286 15642 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.668s (SENT)
I20260709 13:18:56.459694 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.460781 20020 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.460953 19717 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.459962 15496 catalog_manager.cc:5697] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 2 to 10, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 10 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:56.449568 20094 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.469658 20085 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.475227 20082 consensus_queue.cc:1059] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:56.475847 20177 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:18:56.488139 20093 raft_consensus.cc:3055] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:56.488655 20093 raft_consensus.cc:740] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:56.488965 20177 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:56.489456 20177 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:56.489670 20093 consensus_queue.cc:260] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:56.491039 20093 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.490670 20177 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.476411 20172 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:56.492858 20172 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:56.493403 20172 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:56.473421 20110 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.479579 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.504160 15496 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:56.504701 20093 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:56.506698 15565 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.561221 20093 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:56.561471 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 54891.4us
I20260709 13:18:56.561882 20093 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:56.507965 20028 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:56.514372 15642 leader_election.cc:336] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.669s (SENT)
I20260709 13:18:56.524477 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:56.562960 20093 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:56.565069 15642 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:56.566473 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52165.9us
W20260709 13:18:56.567499 15642 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.720s (SENT)
I20260709 13:18:56.526403 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:56.569454 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.571475 19989 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:56.536976 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 65635.4us
W20260709 13:18:56.538530 20179 log.cc:927] Time spent T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:18:56.530004 19702 consensus_meta.cc:287] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.000s
I20260709 13:18:56.505909 15496 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:56.538209 20097 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.576480 20097 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:56.482432 20169 log.cc:927] Time spent T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
I20260709 13:18:56.570279 20028 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.492398 20177 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.436048 20105 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.579592 16299 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:56.580981 20105 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:56.575518 15496 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 9, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:56.585695 15496 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 6 to 7, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:56.588347 15496 catalog_manager.cc:5697] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 8 to 10, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:56.590651 15496 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:18:56.594225 19773 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.594899 19773 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.598656 19773 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:56.601119 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:56.613147 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 212135us
I20260709 13:18:56.607887 15642 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:56.654284 16299 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:56.609107 19952 raft_consensus.cc:697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:56.657040 19717 raft_consensus.cc:2804] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:56.676204 15642 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.874s (SENT)
I20260709 13:18:56.679788 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.655838 15496 catalog_manager.cc:5697] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:56.688930 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:56.702088 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 259019us
I20260709 13:18:56.716218 20067 consensus_queue.cc:1059] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:56.717286 20067 raft_consensus.cc:3055] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:56.717774 20067 raft_consensus.cc:740] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:56.718766 20067 consensus_queue.cc:260] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.720115 20067 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:56.722654 19952 consensus_queue.cc:237] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.698974 20028 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:56.693661 19717 raft_consensus.cc:697] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:56.728953 19717 consensus_queue.cc:237] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.691190 20110 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:56.734968 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 58817.2us
W20260709 13:18:56.735805 15642 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.931s (SENT)
I20260709 13:18:56.736259 15642 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:56.737677 15642 leader_election.cc:336] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.943s (SENT)
I20260709 13:18:56.738134 15642 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.742482 19989 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.743271 19989 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:18:56.744036 20160 log.cc:927] Time spent T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:18:56.749486 15642 leader_election.cc:336] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 1.955s (SENT)
I20260709 13:18:56.750057 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.750980 20020 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:56.751259 20094 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.758850 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:56.758935 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:56.760591 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:18:56.782651 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 181232us
I20260709 13:18:56.806038 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:56.806854 16310 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.817520 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:56.828133 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 224268us
I20260709 13:18:56.785056 20085 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:56.727202 20176 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:56.743316 20172 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.849068 16308 raft_consensus.cc:1240] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:18:56.837634 20020 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:56.842840 20102 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:56.868733 19717 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.905782 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 100030us
I20260709 13:18:56.869712 20094 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:56.909991 19958 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:56.933188 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 96808.9us
I20260709 13:18:56.920329 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:56.920579 20102 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:56.921777 20172 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:56.924881 20176 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:56.927851 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:56.905164 20188 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:18:56.940189 19958 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.929337 20200 consensus_queue.cc:1059] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:56.910804 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.946076 19958 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:56.934484 19717 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.947902 20097 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:56.949090 19717 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:56.936463 16310 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:56.950093 15749 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:56.940495 20035 consensus_queue.cc:1059] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:18:56.946863 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.952782 20035 raft_consensus.cc:3055] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:18:56.953219 20035 raft_consensus.cc:740] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:56.953899 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:56.954217 19767 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:56.954092 20035 consensus_queue.cc:260] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:56.954599 19717 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:56.955408 20035 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:18:56.878647 20085 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:56.957765 20085 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:56.940903 20102 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:56.955188 19717 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:56.970777 15642 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.053s (SENT)
W20260709 13:18:56.972129 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 98541.6us
I20260709 13:18:56.973285 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:56.977545 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.979871 16263 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:56.963606 19958 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:56.984117 15565 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:56.972383 19952 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:56.986759 15749 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:56.979888 20199 raft_consensus.cc:3055] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:56.993382 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:56.994277 15744 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 12: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:56.997622 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:56.998204 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:57.000586 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:56.985900 20020 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:57.002039 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:57.017273 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:57.018151 15672 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:57.017064 15670 raft_consensus.cc:1240] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:57.016206 15677 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:18:57.014882 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:57.023937 15676 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:57.024103 15669 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:18:57.008538 20177 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:57.028439 20177 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:57.028457 15673 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.029481 20177 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:57.034215 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 54447.7us
I20260709 13:18:57.036978 15673 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:56.992306 20199 raft_consensus.cc:740] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:57.042894 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:57.002743 20094 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:57.048054 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:57.102109 16299 raft_consensus.cc:2368] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:18:57.050225 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:57.051790 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.052507 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:57.064559 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 101137us
I20260709 13:18:57.046346 19828 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:18:56.992048 19930 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:57.099643 20199 consensus_queue.cc:260] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.100687 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.104727 15597 raft_consensus.cc:2368] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 12. Current term is 13.
I20260709 13:18:57.110154 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:57.110697 19717 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:57.111441 16305 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:18:57.107818 15642 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.123s (SENT) [suppressed 38 similar messages]
I20260709 13:18:57.115213 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:57.122148 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:57.122776 15674 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.125290 16305 raft_consensus.cc:1240] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:18:57.125385 15640 leader_election.cc:400] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 12. Current term is 13.
I20260709 13:18:57.125980 15640 leader_election.cc:403] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.130452 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:57.131155 15676 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:57.152853 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
W20260709 13:18:57.156565 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 48778.8us
I20260709 13:18:57.159178 15594 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:57.155618 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:57.167743 15670 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.148427 20020 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:57.198625 15642 leader_election.cc:336] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.229s (SENT)
I20260709 13:18:57.199342 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.202258 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:57.203217 16305 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
W20260709 13:18:57.209043 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.209043 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.212759 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.217722 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.173309 20199 raft_consensus.cc:3060] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.225148 20028 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:57.229838 20028 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:57.230983 20208 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.134s	user 0.001s	sys 0.002s
I20260709 13:18:57.238689 19952 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:57.240168 16299 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:57.245724 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:57.247601 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:57.262020 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 86405.8us
W20260709 13:18:57.263093 15642 leader_election.cc:336] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.248s (SENT)
I20260709 13:18:57.263618 15642 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.264919 19717 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:57.266403 19989 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:57.268074 15642 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.248s (SENT)
I20260709 13:18:57.275467 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:18:57.279976 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 154674us
W20260709 13:18:57.290143 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 189573us
I20260709 13:18:57.291342 20066 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.291904 20066 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:57.291831 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.292426 20066 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:57.295133 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 156278us
W20260709 13:18:57.296857 16263 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.236387 20204 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:57.314463 15674 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:57.328815 16263 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.331141 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.310675 20068 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:57.315492 19989 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.344923 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:57.316691 20204 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:57.350303 15597 raft_consensus.cc:1240] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:57.338219 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.346621 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.349236 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.349435 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.353183 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.359014 15602 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:57.337545 20068 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:57.376133 20068 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.354660 20102 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.380656 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:57.381107 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 67848.1us
I20260709 13:18:57.381572 15594 raft_consensus.cc:2410] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:57.382158 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:57.384061 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:57.361542 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 93555.5us
I20260709 13:18:57.364537 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.390110 15745 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:57.370877 15567 leader_election.cc:400] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:18:57.370776 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.390892 15567 leader_election.cc:403] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:57.371410 19773 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:57.359334 20192 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.384981 19767 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:57.385105 20204 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.362993 15601 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:57.387943 20028 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:57.348920 20105 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:57.401427 15595 raft_consensus.cc:2410] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:18:57.393553 20067 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.405164 20067 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:57.405651 20067 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.408244 15670 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:18:57.408843 20192 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.411656 20192 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:57.412639 20085 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:57.413144 20085 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:57.413249 15714 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:57.413596 20085 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.414155 20035 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:57.401399 20066 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.414786 15714 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:57.439325 15601 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:57.443112 15745 raft_consensus.cc:1240] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:57.394893 19767 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:57.445564 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.421960 19702 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:57.424644 20028 raft_consensus.cc:493] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:18:57.456588 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.461869 19989 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:57.462556 16263 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.462755 19989 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.465523 20105 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.466075 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:57.466931 15601 raft_consensus.cc:3060] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:57.470393 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.472173 15597 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:18:57.444379 20035 raft_consensus.cc:2749] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:57.477901 15596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:57.518823 16309 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:18:57.519304 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 104608us
I20260709 13:18:57.429390 20192 consensus_queue.cc:1048] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:18:57.449906 19767 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:57.523010 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 58261.5us
W20260709 13:18:57.526013 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 63571us
W20260709 13:18:57.534097 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 52396.9us
I20260709 13:18:57.441926 20199 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:18:57.479836 19773 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:57.584018 15670 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:57.587730 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:18:57.592877 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:57.593326 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:57.519177 20188 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:57.620321 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 64965.6us
W20260709 13:18:57.620427 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 60977.2us
I20260709 13:18:57.466156 20105 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:57.627969 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 237946us
I20260709 13:18:57.628798 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:57.516188 20028 raft_consensus.cc:515] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.593042 19773 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:57.640347 15565 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.639151 19773 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.660133 15601 raft_consensus.cc:2468] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:18:57.672317 20035 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:57.672885 20035 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:57.673297 20035 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:57.664618 19828 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:57.677175 19828 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:57.677654 19828 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.661491 20028 leader_election.cc:290] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:57.681077 20102 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:57.649469 20191 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.689447 15748 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:18:57.655252 20220 log.cc:927] Time spent T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:18:57.655817 20221 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:57.696942 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
W20260709 13:18:57.704218 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 149813us
I20260709 13:18:57.653790 20223 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.698843 20231 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:57.713073 19989 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:57.713351 20231 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:57.713727 20231 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:57.680002 20068 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.694713 20082 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:57.656548 20216 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:18:57.748920 20204 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.750844 19773 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.707096 20110 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:57.753585 20082 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.753939 20110 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:57.754487 20215 log.cc:927] Time spent T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.285s	user 0.006s	sys 0.010s
I20260709 13:18:57.755892 20082 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:57.755896 20110 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:57.735553 19702 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:18:57.753549 19773 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:57.733982 20020 consensus_meta.cc:287] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.000s
I20260709 13:18:57.761544 19828 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.695345 20176 consensus_queue.cc:1059] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:18:57.719043 20229 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:57.736449 20066 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:57.773185 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:57.769615 20020 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 12. Current term is 13.
I20260709 13:18:57.720984 20223 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.788172 19767 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:57.806422 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 286158us
I20260709 13:18:57.785259 20229 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:57.791802 20102 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:57.818149 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 189438us
W20260709 13:18:57.819443 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 179157us
I20260709 13:18:57.824059 15567 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:57.828385 15565 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.830885 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:57.834065 20068 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:57.834887 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.836001 19989 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:57.836457 19989 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:57.837090 19989 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:57.840516 15565 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.841989 20235 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:57.842163 20105 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:57.842547 20235 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:57.843482 20235 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.846527 20228 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:57.850565 20172 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:57.832068 19773 raft_consensus.cc:3055] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:57.831809 20229 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.861896 19773 raft_consensus.cc:740] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:57.862715 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:57.863549 15748 raft_consensus.cc:2393] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 12: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:57.864890 19828 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:57.832360 20227 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.852007 20110 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:57.852875 15714 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:57.840327 19930 consensus_queue.cc:1059] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:18:57.855831 20223 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:57.855376 20067 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.856833 20231 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.830885 20206 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:57.868443 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:57.872455 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:57.874907 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:57.836844 19767 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:57.890353 15714 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:57.907071 16309 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:18:57.904575 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:57.905293 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:57.862914 19773 consensus_queue.cc:260] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.893667 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:57.909422 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 61271.2us
I20260709 13:18:57.923365 16310 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:57.905135 20110 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:57.910712 19828 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:57.930539 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:57.934216 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:57.927865 15670 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:57.875453 20227 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:57.924422 20085 consensus_meta.cc:287] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: Time spent flushing consensus metadata: real 0.510s	user 0.004s	sys 0.008s
I20260709 13:18:57.936985 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.942730 15599 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:57.943048 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:57.934921 15672 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.939129 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:57.943737 15597 raft_consensus.cc:2376] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11. Re-sending same reply.
I20260709 13:18:57.954754 15751 raft_consensus.cc:3055] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:57.956518 16299 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:18:57.955174 15751 raft_consensus.cc:740] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:57.963500 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:57.955942 20066 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:57.934863 20035 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:57.962391 15751 consensus_queue.cc:260] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.963220 20232 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:57.971089 15751 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:57.949175 20085 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:57.965085 19773 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:57.981710 16310 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:57.987547 20035 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:57.989570 20085 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:57.984838 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:57.992713 20225 raft_consensus.cc:3055] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:57.993180 20225 raft_consensus.cc:740] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:57.994082 20225 consensus_queue.cc:260] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:57.995460 20225 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:57.996912 15747 raft_consensus.cc:1240] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:57.997586 20231 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.001281 20067 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:58.001518 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:58.002727 20234 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:58.003315 20234 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.004307 20227 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:58.012741 15751 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:18:58.016197 15751 pending_rounds.cc:85] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 6
I20260709 13:18:58.016644 15751 pending_rounds.cc:107] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:18:58.016988 15751 raft_consensus.cc:2889] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.020217 15672 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:18:58.033288 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 81027.8us
W20260709 13:18:58.036824 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 166135us
W20260709 13:18:58.038466 15716 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.043325 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:58.044210 15602 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
W20260709 13:18:58.048518 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 158238us
I20260709 13:18:58.049335 15714 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.049423 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.050153 15751 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:58.050194 20250 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:58.050603 15714 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.051448 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:58.043049 15640 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:58.062342 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.063060 15743 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 10.
I20260709 13:18:58.063459 15599 raft_consensus.cc:1275] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:58.064154 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.065338 16265 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:58.066466 16265 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:18:58.066658 19930 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:58.067142 19930 raft_consensus.cc:493] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.067480 19930 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:58.067566 20191 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:18:58.065361 15750 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.075893 15640 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:57.980980 20110 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.090432 15596 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:58.067869 19767 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:58.092530 15750 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
W20260709 13:18:58.095080 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 44552.3us
W20260709 13:18:58.104534 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.087541 20020 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:58.097751 19717 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:58.088232 20232 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:58.111191 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:58.108552 20020 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:58.117092 20243 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:18:58.116763 19989 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.099546 19767 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.116390 20020 raft_consensus.cc:3060] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.148257 15750 raft_consensus.cc:1240] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:58.154572 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.154599 15567 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.108402 20172 consensus_queue.cc:1059] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:58.141100 19767 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.156378 15565 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.182600 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.140432 19717 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:58.158450 15749 raft_consensus.cc:1240] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.185544 19989 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.188730 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.192256 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.157522 20231 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:18:58.213999 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.182207 20199 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:58.219039 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:58.219072 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.221709 15742 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:18:58.223419 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:58.225780 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 69470.7us
I20260709 13:18:58.226733 20249 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:18:58.156283 20232 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:18:58.242441 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:58.247645 15743 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:18:58.250594 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 96071.1us
I20260709 13:18:58.251523 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.252765 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.211403 20234 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:58.255728 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.260489 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.269558 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.255614 20177 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:18:58.271555 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 376989us
I20260709 13:18:58.257817 19828 raft_consensus.cc:2749] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:58.240895 20191 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:18:58.283257 20256 log.cc:927] Time spent T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:18:58.283383 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.284382 15749 raft_consensus.cc:2393] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:58.283304 20207 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:58.277518 19717 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.274727 20248 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.290881 20248 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:58.291288 20248 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:58.306388 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.253958 20199 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.327749 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1e65bafed7145eb85b802c6c68a9129" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.330303 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.331173 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.332033 15676 raft_consensus.cc:2393] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 12: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:58.332258 20176 raft_consensus.cc:3055] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:58.326545 20251 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.332679 20176 raft_consensus.cc:740] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:58.333164 20251 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.333731 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.333628 20176 consensus_queue.cc:260] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.334965 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.335556 15669 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:58.335680 20251 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.326560 20234 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.336683 15548 auto_rebalancer.cc:629] Failed to schedule move for tablet 97765616b2ca49eca1b5b2c90a10c9a3: Illegal state: Replica 7019261981c6431baddd6812c15ac678 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:58.336947 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.337517 15675 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:58.336712 20234 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.340108 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:58.341190 20234 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:18:58.341802 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 89110us
I20260709 13:18:58.342826 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.343484 15676 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:58.344812 20200 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.345007 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.346006 15672 raft_consensus.cc:1275] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:58.346467 15671 raft_consensus.cc:1240] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:58.348863 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 114880us
I20260709 13:18:58.349231 15670 raft_consensus.cc:1240] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:58.351051 15596 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:58.351902 15596 raft_consensus.cc:606] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.354127 20207 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:58.355386 20177 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:58.355165 20207 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.356395 20177 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.357148 16307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:18:58.357230 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.357825 16307 raft_consensus.cc:606] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.359856 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.360514 15674 raft_consensus.cc:3060] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.361824 20097 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:58.362720 15642 leader_election.cc:336] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Timed out: RequestConsensusVote RPC to 127.14.41.67:40623 timed out after 2.037s (SENT)
I20260709 13:18:58.368986 15749 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.369933 15674 raft_consensus.cc:2468] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:58.336491 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.381156 15669 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:58.388736 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.389781 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.374733 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
W20260709 13:18:58.394809 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 50311.5us
I20260709 13:18:58.392768 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:58.410089 15673 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:18:58.410920 15675 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 9.
I20260709 13:18:58.412771 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:58.364348 19989 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:18:58.410743 16263 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:58.329864 20229 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:58.416422 16263 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.417932 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:58.419385 15742 raft_consensus.cc:2393] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:58.421880 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:58.422540 15601 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:58.422847 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:58.424945 15595 raft_consensus.cc:2393] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:58.430949 20240 consensus_queue.cc:1048] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:18:58.413381 20227 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:58.420320 20200 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.421663 20105 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.454319 20200 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.426165 19958 raft_consensus.cc:2804] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:58.446137 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.446203 15599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:18:58.462131 15599 raft_consensus.cc:606] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.462466 15600 raft_consensus.cc:1275] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:18:58.453541 20199 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.462898 15600 pending_rounds.cc:85] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 8
I20260709 13:18:58.463486 15600 pending_rounds.cc:107] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:18:58.463792 15600 raft_consensus.cc:2889] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.439286 20227 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.468881 15598 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.470474 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:58.472803 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.473076 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:58.474107 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 49877.1us
I20260709 13:18:58.421012 20248 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.426420 20229 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.476327 15595 raft_consensus.cc:1275] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:18:58.428426 20251 consensus_queue.cc:1059] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:18:58.473341 20227 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.481149 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.486351 20172 consensus_queue.cc:1059] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:58.487542 20172 raft_consensus.cc:3055] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:58.487886 20172 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:58.492209 20176 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.479051 20028 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.494906 20028 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:58.495317 20028 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.498091 19930 raft_consensus.cc:515] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:58.497779 20265 log.cc:927] Time spent T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:58.502306 20251 raft_consensus.cc:3055] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:58.502774 20251 raft_consensus.cc:740] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:58.504981 15751 raft_consensus.cc:1240] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:58.506309 20248 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:58.510651 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.514933 20020 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.481865 15595 pending_rounds.cc:85] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Aborting all ops after (but not including) 11
I20260709 13:18:58.481719 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:58.541932 15595 pending_rounds.cc:107] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:18:58.542261 15595 raft_consensus.cc:2889] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.481096 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:58.484588 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.475821 20232 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.469372 19958 raft_consensus.cc:697] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:58.516551 20199 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.564890 20199 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.565289 19958 consensus_queue.cc:237] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.567862 20199 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.516981 19930 leader_election.cc:290] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:58.521003 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:58.569973 20260 consensus_queue.cc:1059] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:58.570827 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:58.571146 20260 raft_consensus.cc:3055] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:58.526407 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:58.571628 20260 raft_consensus.cc:740] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:58.571970 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 45667.8us
I20260709 13:18:58.528481 20229 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.465860 20200 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.575098 15600 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:58.480579 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:18:58.535313 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 142608us
W20260709 13:18:58.550324 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 66281.1us
I20260709 13:18:58.590544 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:58.552368 15601 raft_consensus.cc:2468] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:58.554911 20020 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:58.559316 20227 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.523813 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:58.601824 15742 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:58.604048 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.609323 15597 raft_consensus.cc:2468] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:18:58.610333 15642 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.606577 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.613425 16263 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.617650 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:58.618705 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:58.620209 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.622014 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fd98191b2d04d05b9a41afba67ac044" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.622817 15668 raft_consensus.cc:3060] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:18:58.575709 20229 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:58.503679 20251 consensus_queue.cc:260] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.629635 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.631556 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.638689 16307 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:58.644061 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:18:58.647096 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 166587us
I20260709 13:18:58.648211 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.648342 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.572574 20260 consensus_queue.cc:260] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.620163 20097 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.653512 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.656358 20271 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.625415 20105 raft_consensus.cc:2749] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.632467 20248 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:58.589251 19767 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.633046 20229 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.578438 19717 consensus_queue.cc:1048] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:18:58.664011 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.576155 20172 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.631485 19702 consensus_queue.cc:1048] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:58.642089 20176 consensus_queue.cc:1059] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:18:58.636972 20216 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:18:58.680553 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 59794.1us
I20260709 13:18:58.661187 20067 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:58.683794 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.687428 20097 consensus_queue.cc:1059] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:58.676079 20223 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:58.690485 15671 raft_consensus.cc:1240] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:18:58.694404 15565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.724965 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.664525 19989 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.671665 20260 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.672266 20229 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.669998 20244 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:58.703919 15714 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:58.654714 20246 consensus_queue.cc:1059] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:18:58.689652 20227 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:58.728947 15677 raft_consensus.cc:1240] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:18:58.719722 20172 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.727770 20193 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:18:58.801013 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 97158.5us
I20260709 13:18:58.767204 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.754571 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.706214 20251 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.752411 20273 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:18:58.785164 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 136874us
I20260709 13:18:58.787446 20188 raft_consensus.cc:993] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
W20260709 13:18:58.797425 20274 log.cc:927] Time spent T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:58.824920 20248 consensus_queue.cc:1048] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:58.827117 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 72351.7us
I20260709 13:18:58.829134 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:58.829272 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:58.829867 16306 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:58.830884 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:58.757138 20272 log.cc:927] Time spent T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:58.833297 20188 raft_consensus.cc:1081] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:18:58.833820 20193 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:58.809473 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.834630 15600 raft_consensus.cc:3060] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.834828 20193 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.776885 19952 raft_consensus.cc:3055] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:18:58.815682 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.815711 15597 raft_consensus.cc:2468] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:18:58.717476 20020 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:18:58.764847 20206 raft_consensus.cc:3055] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:58.752550 19989 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.821762 20231 consensus_queue.cc:1059] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:58.810433 15642 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:58.780290 20232 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:58.850911 15742 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:18:58.879902 15600 raft_consensus.cc:2468] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:18:58.836422 20028 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.881392 19767 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:58.887249 20028 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.842317 19952 raft_consensus.cc:740] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:58.889153 19952 consensus_queue.cc:260] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:18:58.889847 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.890575 19952 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.891184 20235 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.891713 20235 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.892055 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:58.892140 20229 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:58.843426 20273 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:58.896944 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 47912.7us
I20260709 13:18:58.897089 15744 raft_consensus.cc:1240] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:58.897744 20273 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:58.838860 20223 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:18:58.845041 20206 raft_consensus.cc:740] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:58.899319 20241 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:58.899858 20241 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:58.899689 20259 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:18:58.900249 20241 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:58.899390 20206 consensus_queue.cc:260] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:58.901954 20206 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.899400 15565 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:18:58.900342 20191 raft_consensus.cc:993] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
W20260709 13:18:58.906211 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 86129.9us
W20260709 13:18:58.850730 20279 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:18:58.906322 20231 consensus_queue.cc:1243] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Peer 558532223b984cf796cb6b98ddd6c9f2 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:18:58.907100 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 96739.6us
I20260709 13:18:58.913744 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:58.866451 20232 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:18:58.920958 20232 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:58.917922 15642 leader_election.cc:304] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.914731 20207 raft_consensus.cc:3055] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:58.914780 20191 raft_consensus.cc:1081] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:18:58.893867 20235 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.922737 15714 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:58.925757 15668 raft_consensus.cc:2468] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:18:58.926375 20020 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:58.928956 15642 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.929731 15642 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:58.932734 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.933319 15669 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:58.934188 20234 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:58.935449 20236 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:58.933314 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:58.938943 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:58.938805 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:58.939698 16263 leader_election.cc:304] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:58.927610 15714 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:58.941875 15670 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:58.942962 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:58.944868 16309 raft_consensus.cc:2368] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:58.945430 16307 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:58.950170 15669 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:58.951601 15675 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:18:58.941399 16263 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:58.907548 19989 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:58.961808 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:58.964175 15668 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 12: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:18:58.944382 15640 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:58.965377 16263 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:58.939680 20273 raft_consensus.cc:2749] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:58.925305 20207 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:59.007050 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:59.009887 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:58.956893 19773 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:59.015589 15598 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:59.009547 19930 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.017213 19930 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.018467 20232 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.018870 20207 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:18:59.019485 19930 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:58.963037 20240 raft_consensus.cc:2804] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.012243 20191 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:59.013119 20282 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.013597 20269 raft_consensus.cc:2804] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:59.023536 15599 raft_consensus.cc:2393] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:59.024669 15602 raft_consensus.cc:2393] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:58.977293 20234 raft_consensus.cc:2804] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:59.043635 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 116109us
I20260709 13:18:59.045246 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:59.045617 15749 raft_consensus.cc:1240] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:59.045933 15594 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:59.011533 20227 raft_consensus.cc:2804] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:59.048974 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.049259 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.045563 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:59.050418 15747 raft_consensus.cc:2393] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:59.046726 20223 raft_consensus.cc:2804] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.051348 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.048979 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.048372 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.046653 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.065405 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:59.066171 16306 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:18:59.068065 15743 raft_consensus.cc:3055] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:59.069630 15746 raft_consensus.cc:3055] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:59.070046 15746 raft_consensus.cc:740] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:59.068663 15743 raft_consensus.cc:740] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:59.080782 15749 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:59.082438 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.082443 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.084643 20223 raft_consensus.cc:697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:59.085100 20292 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.085644 20292 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.085759 20223 consensus_queue.cc:237] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.089305 15751 raft_consensus.cc:2410] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:18:59.090302 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:59.091341 15744 raft_consensus.cc:2393] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:59.041350 20240 raft_consensus.cc:697] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:59.082481 15743 consensus_queue.cc:260] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.103610 15743 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.082638 15746 consensus_queue.cc:260] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.095155 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.057857 20269 raft_consensus.cc:697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:59.113575 20269 consensus_queue.cc:237] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.029551 20273 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:18:59.118714 15746 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.100673 20284 raft_consensus.cc:2804] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.101287 16308 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:59.083195 20227 raft_consensus.cc:697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:59.071920 20234 raft_consensus.cc:697] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:59.136500 15674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:18:59.137872 20229 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.138109 15674 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:59.138520 15674 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.140995 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
W20260709 13:18:59.142174 15548 auto_rebalancer.cc:629] Failed to schedule move for tablet 7b872b4d6b684a548289e080316a1b94: Illegal state: Replica 7019261981c6431baddd6812c15ac678 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:59.107992 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e80fb58800714a47b47ac1e701a9400f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:59.146131 15742 raft_consensus.cc:2393] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 11: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:59.108325 20283 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.110005 20240 consensus_queue.cc:237] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.088649 20232 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.041174 20200 consensus_queue.cc:1059] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:18:59.128119 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:59.119261 20292 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.136479 20227 consensus_queue.cc:237] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.140374 15642 leader_election.cc:400] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:59.155622 15642 leader_election.cc:403] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:18:59.155180 20251 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:18:59.160430 15746 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:18:59.161156 15746 pending_rounds.cc:85] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 4
I20260709 13:18:59.161442 15746 pending_rounds.cc:107] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:18:59.161742 15746 raft_consensus.cc:2889] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.152556 15674 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.138124 20234 consensus_queue.cc:237] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.168695 15748 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:59.169147 15748 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:59.169895 15748 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.171077 15748 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.154825 20283 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.115978 20241 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.174695 20244 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 10. Current term is 11.
I20260709 13:18:59.176035 15672 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:59.177631 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:59.178802 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:59.179600 20282 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.179899 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:59.180244 20282 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.180742 20244 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:18:59.182444 15674 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:59.187104 15642 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:59.188474 15642 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:59.189971 20283 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:59.190725 20283 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:18:59.191298 15642 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:59.191521 20283 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.192131 20244 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.193651 15642 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:59.103199 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.198625 20207 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.205530 19717 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.209614 20241 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.210011 15748 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:18:59.210456 15748 pending_rounds.cc:85] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 6
I20260709 13:18:59.210677 15595 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:59.215862 15674 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:59.218261 15743 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:18:59.218777 15743 pending_rounds.cc:85] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 4
I20260709 13:18:59.219054 15743 pending_rounds.cc:107] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:18:59.219341 15743 raft_consensus.cc:2889] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.221856 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:59.221949 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:59.227834 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:59.219419 15640 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:59.210672 15748 pending_rounds.cc:107] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 13:18:59.230834 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.231700 15748 raft_consensus.cc:2889] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:59.249094 15594 raft_consensus.cc:1275] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:59.259006 16308 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:18:59.245064 20246 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:18:59.247453 20067 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:18:59.275368 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:59.279313 15599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:59.280256 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:59.280391 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:59.281210 15602 raft_consensus.cc:3055] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:59.281587 15602 raft_consensus.cc:740] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:18:59.282522 15602 consensus_queue.cc:260] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:18:59.251938 20231 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:18:59.247223 20271 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.246694 19952 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:59.285205 15717 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.286803 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:59.285270 15602 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.290985 19952 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.229760 20206 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:18:59.295073 15599 raft_consensus.cc:2468] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:18:59.296092 19952 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.248663 19930 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:18:59.290954 20235 raft_consensus.cc:493] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:59.260922 20204 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:18:59.284356 20241 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:18:59.275354 20216 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:18:59.334640 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:59.304191 20284 raft_consensus.cc:697] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:59.296591 19717 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:18:59.339403 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:59.338238 20235 raft_consensus.cc:515] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.351091 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:59.338888 20287 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.316989 20082 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:59.360963 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:59.365346 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:59.369786 15743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:44676
I20260709 13:18:59.370095 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:59.370646 15743 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:59.371222 15743 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.354256 19773 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:59.352167 20248 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:59.346829 20199 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:18:59.422634 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 57328.1us
I20260709 13:18:59.437886 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:59.438566 15749 raft_consensus.cc:3060] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:59.374842 20283 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:59.439409 20283 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.441702 20283 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.355274 20284 consensus_queue.cc:237] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.389230 20288 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:59.356279 20271 consensus_queue.cc:1059] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:59.448431 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:59.448612 20232 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:59.449141 16305 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.450178 20234 raft_consensus.cc:3055] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:59.450433 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:18:59.451305 16308 raft_consensus.cc:2393] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 8: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:59.450573 20234 raft_consensus.cc:740] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:18:59.453480 20234 consensus_queue.cc:260] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.454495 20234 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.455282 20282 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:18:59.458261 20290 log.cc:927] Time spent T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:18:59.461875 20105 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.462502 20105 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.469123 15744 raft_consensus.cc:1240] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:59.475080 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:18:59.475888 15743 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.477753 15750 raft_consensus.cc:1240] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 6. Current term is 7. Ops: []
I20260709 13:18:59.482170 20287 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.490374 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:59.490394 20235 leader_election.cc:290] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.491179 15672 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:18:59.494796 15672 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:18:59.496011 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 133151us
I20260709 13:18:59.502287 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:18:59.505254 15602 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:59.514993 15714 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:18:59.536424 16305 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:59.543659 16308 raft_consensus.cc:1240] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:18:59.551494 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:18:59.552675 15742 raft_consensus.cc:3060] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.553748 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:18:59.554512 16305 raft_consensus.cc:3055] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:18:59.554877 16305 raft_consensus.cc:740] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:59.516155 20281 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:59.591377 15716 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:59.492200 19702 consensus_queue.cc:1048] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:18:59.603789 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:18:59.603852 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:59.604646 15600 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.605042 15742 raft_consensus.cc:2468] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:59.606386 20296 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.606935 20296 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.591822 20251 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:59.610311 20251 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.606113 15749 raft_consensus.cc:2468] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:18:59.613730 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.558759 16305 consensus_queue.cc:260] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.614353 15742 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:59.614480 16305 raft_consensus.cc:3060] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:18:59.592285 20248 raft_consensus.cc:2804] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:59.622293 15640 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:59.612349 20251 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:59.630586 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.631494 20105 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:18:59.636520 16305 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:59.637751 15600 raft_consensus.cc:2468] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:59.528432 19930 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:18:59.597210 20028 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.629292 15742 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:18:59.629158 20288 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:59.550133 19952 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.641729 20248 raft_consensus.cc:697] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:59.665349 19773 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:18:59.667043 20294 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.670575 15743 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.672487 20303 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
W20260709 13:18:59.679071 20295 log.cc:927] Time spent T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.242s	user 0.011s	sys 0.002s
I20260709 13:18:59.706205 16309 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:59.682127 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.650620 20251 raft_consensus.cc:2804] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.652158 20232 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:59.653527 20028 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.722787 19952 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:18:59.716761 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 75059.6us
I20260709 13:18:59.704622 19773 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.708230 20248 consensus_queue.cc:237] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.710121 20303 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.709189 20294 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.742188 15567 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
W20260709 13:18:59.745813 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 125188us
I20260709 13:18:59.724568 20296 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.748577 20251 raft_consensus.cc:697] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:18:59.770558 20302 log.cc:927] Time spent T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.333s	user 0.001s	sys 0.001s
I20260709 13:18:59.764742 20206 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:59.780081 15749 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
W20260709 13:18:59.780320 15548 auto_rebalancer.cc:629] Failed to schedule move for tablet dbde144556724eb39acadbe99d8a1de3: Illegal state: Replica 558532223b984cf796cb6b98ddd6c9f2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:18:59.783301 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:59.784264 15670 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:18:59.776263 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:18:59.781395 15714 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:18:59.789422 20251 consensus_queue.cc:237] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.792685 20273 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.792889 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:59.793198 20273 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:59.793597 20273 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.799069 20293 raft_consensus.cc:2804] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:18:59.799881 20293 raft_consensus.cc:697] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:18:59.801787 20028 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.804279 20294 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.805425 20206 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
W20260709 13:18:59.770558 20300 log.cc:927] Time spent T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260709 13:18:59.806321 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.807348 15599 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:59.809702 15594 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:18:59.793551 15595 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:18:59.807405 15745 raft_consensus.cc:2393] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 12: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:18:59.796262 20303 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.821978 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:18:59.825047 16264 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.825701 15640 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:59.826196 15750 raft_consensus.cc:1275] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:18:59.822708 16308 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
I20260709 13:18:59.823146 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:18:59.829348 15745 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:18:59.831156 15642 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:59.833317 20244 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:59.833734 20244 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:59.834084 20244 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:59.836958 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:59.818672 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:59.837781 15671 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 12.
I20260709 13:18:59.840032 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:59.840665 15676 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:18:59.842032 20294 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:59.843588 20294 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.843977 20294 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.827497 20232 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.847911 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:18:59.850277 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 285065us
I20260709 13:18:59.848631 15598 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
W20260709 13:18:59.852257 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 250203us
I20260709 13:18:59.849386 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:18:59.842360 20028 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:59.844190 19773 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.848003 20232 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.804385 20293 consensus_queue.cc:237] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.832001 20229 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:59.806384 20206 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.863077 20028 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.878516 19773 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:18:59.878743 20273 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.884375 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:18:59.885790 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:59.891558 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:59.865938 20287 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:59.902192 15598 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:18:59.908280 20273 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:59.898764 20271 consensus_queue.cc:1048] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:18:59.918533 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.898336 19767 consensus_queue.cc:1059] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:59.925824 20311 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:18:59.926417 20311 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:18:59.903538 20287 raft_consensus.cc:493] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.928267 20287 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:59.929010 19767 raft_consensus.cc:3055] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:59.928910 20251 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:59.929528 19767 raft_consensus.cc:740] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:18:59.930451 19767 consensus_queue.cc:260] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.931794 19767 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:59.900847 20028 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:59.932402 20311 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:18:59.942083 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:18:59.942129 15599 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:59.950050 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:18:59.953678 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:18:59.961161 20277 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:59.958393 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:18:59.970141 20234 consensus_meta.cc:287] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.005s
I20260709 13:18:59.978404 15672 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:59.931771 20294 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:18:59.969074 20244 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:00.008319 15594 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:59.983260 20191 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:18:59.979193 20273 consensus_queue.cc:1059] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:19:00.015972 20277 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.028679 20277 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.031111 20277 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:00.015403 20191 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.033404 20244 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:00.034732 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
W20260709 13:19:00.035322 20299 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.612s	user 0.001s	sys 0.003s
I20260709 13:19:00.042183 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:00.042992 16305 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:19:00.043134 15593 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:19:00.045082 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:00.045255 15640 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:00.045765 16309 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:19:00.046092 20273 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:00.046600 20273 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:00.047547 20273 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:00.052772 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:00.043928 20232 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.076702 15744 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:19:00.089133 20287 raft_consensus.cc:515] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.091531 20294 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:00.098382 15672 raft_consensus.cc:3060] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.101051 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:00.101771 15673 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.102001 19952 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:19:00.110239 20289 log.cc:927] Time spent T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.769s	user 0.000s	sys 0.007s
I20260709 13:19:00.113377 15747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48728 (request call id 1837) took 1015 ms. Trace:
I20260709 13:19:00.113739 15751 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:00.113821 15747 rpcz_store.cc:276] 0709 13:18:59.097739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.102612 (+  4873us) service_pool.cc:224] Handling call
0709 13:19:00.112177 (+1009565us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b54003965a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe667dc0 00007faefe6f3e18 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6
0709 13:19:00.113162 (+   985us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540026b1d4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6f42fa 00007faf036b5b17 00007faefcc306d4 00007faefcc30662 00007faefcc30591 00007faefcc3050c 00007faefcc2f7c2 00007faefca2b48c 00007faefca2a8c6 00007faefca2a26f
0709 13:19:00.113284 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848212608}
I20260709 13:19:00.115379 15677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2567) took 1172 ms. Trace:
I20260709 13:19:00.115779 15677 rpcz_store.cc:276] 0709 13:18:58.942543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.009058 (+ 66515us) service_pool.cc:224] Handling call
0709 13:18:59.013126 (+  4068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.013498 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.013536 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.014094 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.257819 (+243725us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:59.257866 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.258114 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.109617 (+851503us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:19:00.115068 (+  5451us) raft_consensus.cc:1685] finished
0709 13:19:00.115090 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.115297 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7437,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":5325056,"thread_start_us":243324,"threads_started":1,"wal-append.queue_time_us":286143}
I20260709 13:19:00.125022 20241 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:00.129863 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "534cd68adf1a448ba243ff66d1dcd5da" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:00.130187 16305 raft_consensus.cc:1240] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Rejecting Update request from peer 7019261981c6431baddd6812c15ac678 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:19:00.131767 20229 raft_consensus.cc:3055] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:19:00.132321 20229 raft_consensus.cc:740] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:00.133256 20229 consensus_queue.cc:260] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.134464 20229 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.135427 20232 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:00.136845 15676 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:00.138206 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:00.138973 16309 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:19:00.140992 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:00.141731 16309 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 12: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:19:00.143879 20287 leader_election.cc:290] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:00.145622 20191 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:00.148013 15500 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:00.149771 15500 catalog_manager.cc:5697] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 10, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 10 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:00.151177 15500 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:59.629951 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:00.152576 15500 catalog_manager.cc:5697] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 6, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 6 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:00.158427 15749 raft_consensus.cc:1275] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:00.162580 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:00.172531 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:00.157011 15748 raft_consensus.cc:1275] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:00.173207 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:00.214015 16306 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.189025 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:00.192206 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:00.193419 15642 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:00.196308 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaf7f7575314c29a12eedde1fe321a7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:00.217249 16305 raft_consensus.cc:3060] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:00.218284 15742 raft_consensus.cc:2393] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 12: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:00.215286 15500 catalog_manager.cc:5697] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 12 to 14, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 14 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:00.213759 15567 leader_election.cc:304] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:00.242316 16305 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:19:00.244500 15567 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:00.226877 15500 catalog_manager.cc:5697] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 10, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 10 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:00.204167 15672 raft_consensus.cc:1275] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:19:00.191692 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:00.242107 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:19:00.211105 15673 raft_consensus.cc:2468] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:19:00.245857 15567 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:00.249848 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:00.248267 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:00.250842 15714 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:00.217478 20235 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.257675 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:00.249266 19773 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.290402 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e1ddbbc3cce4edcbe5c245fb2d8ed29" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:00.291360 15676 raft_consensus.cc:3060] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:19:00.175316 20082 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:19:00.293591 15714 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:00.247810 20248 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.247663 20177 raft_consensus.cc:2749] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.163268 20028 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.253302 20309 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:00.303061 15673 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:00.257182 19930 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.305965 15642 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade
I20260709 13:19:00.256925 20303 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.307596 20309 raft_consensus.cc:493] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.243793 20277 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:00.290902 20232 raft_consensus.cc:2804] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:00.253155 20293 consensus_queue.cc:1048] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:19:00.317391 15642 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:00.249912 19717 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.409029 15676 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
W20260709 13:19:00.534652 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 217347us
W20260709 13:19:00.385584 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 89415.6us
I20260709 13:19:00.254755 19767 consensus_queue.cc:1048] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:19:00.412647 15673 raft_consensus.cc:3060] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.295425 20235 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:19:00.306785 20296 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:00.390470 15668 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 14: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:00.299772 20310 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:19:00.253212 19952 consensus_queue.cc:1048] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:19:00.305675 20248 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.416384 16306 raft_consensus.cc:2468] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:19:00.558502 20235 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:00.389789 20309 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:00.560099 19773 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.561002 20273 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:00.561537 20273 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
W20260709 13:19:00.529618 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 275002us
I20260709 13:19:00.536273 15642 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:00.538430 15714 leader_election.cc:304] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:00.572817 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:00.572988 15744 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:00.573953 15742 raft_consensus.cc:2393] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 9: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:00.576735 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:19:00.543329 20334 log.cc:927] Time spent T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:19:00.544050 20244 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:00.538095 20311 raft_consensus.cc:2764] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:19:00.563622 20273 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:00.604307 20303 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.637136 20303 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:00.612974 20339 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 13:19:00.639326 15676 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:19:00.639776 15676 pending_rounds.cc:85] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Aborting all ops after (but not including) 9
I20260709 13:19:00.615240 15670 raft_consensus.cc:1275] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:00.639401 20303 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:00.622588 16263 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:00.578218 20229 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.591054 19773 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:19:00.644423 20240 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:00.644680 20232 raft_consensus.cc:697] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:00.578697 20296 raft_consensus.cc:2804] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:00.646147 20296 raft_consensus.cc:697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:00.646844 20193 raft_consensus.cc:3055] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:19:00.647291 20193 raft_consensus.cc:740] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:00.647059 20296 consensus_queue.cc:237] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:00.649595 20336 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.476s	user 0.000s	sys 0.005s
I20260709 13:19:00.653494 15750 raft_consensus.cc:1240] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 13:19:00.640017 15676 pending_rounds.cc:107] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:19:00.654966 15676 raft_consensus.cc:2889] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:00.656108 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:00.656723 15676 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 8.
I20260709 13:19:00.659787 15672 raft_consensus.cc:3060] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:00.661865 15594 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:00.661865 16305 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:19:00.665251 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:00.665921 15594 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:19:00.676545 20232 consensus_queue.cc:237] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.679208 15742 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:00.628149 20309 raft_consensus.cc:515] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:00.678876 20216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.008s	sys 0.009s
I20260709 13:19:00.648141 20193 consensus_queue.cc:260] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.699931 20288 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:00.699272 20216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.009s	sys 0.009s
I20260709 13:19:00.718649 15672 raft_consensus.cc:1275] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:00.719493 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:00.719975 15673 raft_consensus.cc:1275] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:00.726725 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:00.727358 15673 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:19:00.705243 20097 consensus_queue.cc:1059] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:19:00.719825 20244 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:19:00.739197 20309 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:00.722889 19773 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:00.723474 20229 raft_consensus.cc:493] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.800514 15565 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:00.723090 20206 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:19:00.790678 19773 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.802371 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 79192.9us
I20260709 13:19:00.725965 20271 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 13:19:00.806120 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 127436us
I20260709 13:19:00.811592 15670 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:19:00.812162 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 142051us
I20260709 13:19:00.813838 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:00.814479 15593 raft_consensus.cc:3060] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:00.809338 20310 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.794313 20235 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:00.830698 15593 raft_consensus.cc:2468] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 14.
I20260709 13:19:00.808308 20259 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:00.848203 20244 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:00.819829 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:00.810317 19773 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:00.855321 15668 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 14: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:00.793219 20293 consensus_queue.cc:1048] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:19:00.796329 20349 consensus_queue.cc:1048] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:19:00.860342 20244 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:00.871799 20360 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.871999 20244 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:00.872463 20360 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.875221 20360 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:00.877153 20296 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:00.877734 20296 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.879753 20028 leader_election.cc:290] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:00.879906 20296 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:00.885874 20329 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.793s	user 0.000s	sys 0.009s
I20260709 13:19:00.891959 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:00.892975 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:00.894752 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:00.895210 15598 raft_consensus.cc:1275] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:00.823570 20288 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:19:00.897671 20349 raft_consensus.cc:493] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:00.898260 20349 raft_consensus.cc:515] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.895601 15668 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 11: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:00.802572 20229 raft_consensus.cc:515] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:00.910030 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 99141.2us
I20260709 13:19:00.817672 20310 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.903142 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:00.854843 20259 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.922428 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:00.923661 15742 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:19:00.924191 15640 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:00.835903 20082 consensus_queue.cc:1059] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:19:00.932960 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:00.933854 16305 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:00.941907 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:00.943117 16305 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 14: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:19:00.857338 20235 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:00.923138 20259 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:00.951121 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fc66402c5e04df38b56e6d8d4d7731d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:00.952265 15593 raft_consensus.cc:2393] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 14: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
W20260709 13:19:00.961751 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 147763us
I20260709 13:19:00.932962 20361 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:00.938932 20244 consensus_queue.cc:1048] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:19:00.954039 15640 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:00.966249 15716 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:19:00.984177 20273 raft_consensus.cc:2749] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:19:00.995625 20351 log.cc:927] Time spent T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:19:00.993268 20288 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:00.966113 20342 consensus_queue.cc:1048] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:19:01.001849 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.011652 19773 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:19:01.012094 20235 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:01.013396 20354 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:19:01.038182 15600 raft_consensus.cc:2368] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:19:01.038669 20310 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:01.034865 20361 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.039645 20361 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.040406 19773 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:01.042474 20361 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:01.031719 20348 log.cc:927] Time spent T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:19:01.021462 20288 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:19:01.054481 20333 log.cc:927] Time spent T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.752s	user 0.001s	sys 0.003s
I20260709 13:19:01.057941 15598 raft_consensus.cc:1275] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:19:01.060552 15597 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:01.065047 20288 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:01.094694 15567 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbc6f003381b434b92d3b262155935c7. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:01.095450 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 839597us
I20260709 13:19:01.067836 20349 leader_election.cc:290] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:01.140465 16266 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.130956 19773 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:19:01.153728 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:01.154672 16306 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:01.143329 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:01.120286 20259 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.157297 15744 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 9.
I20260709 13:19:01.160970 15749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:01.162391 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:01.162985 15743 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.163899 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.164548 15674 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:19:01.163901 15742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:01.165760 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:01.166217 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:01.167236 15748 raft_consensus.cc:2393] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:01.168279 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16817d3f588f45019ebd19d0c1915814" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:01.173728 15674 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:01.168166 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:01.177474 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:01.180681 15745 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:19:01.185156 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:01.184909 15716 leader_election.cc:304] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.185976 16308 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:19:01.156612 20248 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:01.198861 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 207461us
I20260709 13:19:01.188220 20350 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:01.226074 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.226811 15602 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:19:01.193420 20296 raft_consensus.cc:2749] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.202260 20244 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:01.231846 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.197988 20284 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:01.237651 15743 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:19:01.241108 15674 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:19:01.195561 20349 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:19:01.224467 20350 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.243031 20244 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.259228 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.257948 20350 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:01.310575 20355 log.cc:927] Time spent T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:01.300408 20244 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:01.320757 20366 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:01.325894 20294 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:01.326545 20294 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.328137 20193 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.331883 20294 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:01.350809 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.354250 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.250816 20284 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:01.371376 20381 log.cc:927] Time spent T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:19:01.373741 20294 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:01.374372 20294 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.375499 20284 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:01.376904 20324 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 1.286s	user 0.004s	sys 0.008s
I20260709 13:19:01.351269 20248 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:01.380326 20248 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.382507 20248 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:01.356137 20231 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:01.393507 20259 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:01.393646 20231 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.394227 20294 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:01.395951 20231 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:01.398599 20244 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.402153 19773 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59268 (request call id 1) took 1594 ms. Trace:
I20260709 13:19:01.379215 20288 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.404305 15674 raft_consensus.cc:2393] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 12: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:01.406057 20288 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:01.407855 15496 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46324 (request call id 315) took 19273 ms (client timeout 15000 ms). Trace:
I20260709 13:19:01.408094 15749 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:19:01.408946 15500 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 10, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.410635 15500 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.413362 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:01.413045 15500 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.414044 15668 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:19:01.415062 20370 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:01.408351 15496 rpcz_store.cc:269] 0709 13:18:42.134711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.134893 (+   182us) service_pool.cc:224] Handling call
0709 13:19:01.407766 (+19272873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:57.179343 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:57.180244 (+   901us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:57.180311 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:18:57.180339 (+    28us) tablet.cc:662] Decoding operations
0709 13:18:57.184276 (+  3937us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:57.184409 (+   133us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:57.184455 (+    46us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:18:57.186418 (+  1963us) tablet.cc:701] Row locks acquired
0709 13:18:57.186508 (+    90us) write_op.cc:260] PREPARE: finished
0709 13:18:57.186749 (+   241us) write_op.cc:270] Start()
0709 13:18:57.186939 (+   190us) write_op.cc:276] Timestamp: P: 1783603137186664 usec, L: 0
0709 13:18:57.186968 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:57.293343 (+106375us) log.cc:844] Serialized 6289 byte log entry
0709 13:18:57.848199 (+554856us) op_driver.cc:464] REPLICATION: finished
0709 13:18:57.962489 (+114290us) write_op.cc:301] APPLY: starting
0709 13:18:57.967516 (+  5027us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:58.308123 (+340607us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:58.308256 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:58.565193 (+256937us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:58.565554 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:18:58.565609 (+    55us) write_op.cc:312] APPLY: finished
0709 13:18:58.567051 (+  1442us) log.cc:844] Serialized 148 byte log entry
0709 13:18:58.568169 (+  1118us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.568341 (+   172us) write_op.cc:454] Released schema lock
0709 13:18:58.568418 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:58.631735 (+ 63317us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:58.644741 (+ 13006us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3270893,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":99088,"apply.run_cpu_time_us":27421,"apply.run_wall_time_us":649454,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71071,"num_ops":16,"prepare.queue_time_us":146873,"prepare.run_cpu_time_us":23693,"prepare.run_wall_time_us":392897,"raft.queue_time_us":100179,"raft.run_cpu_time_us":24646,"raft.run_wall_time_us":61244,"replication_time_us":661066,"thread_start_us":424859,"threads_started":4,"wal-append.queue_time_us":349900,"wal-append.run_cpu_time_us":18240,"wal-append.run_wall_time_us":1898477}]]}
I20260709 13:19:01.415107 15500 catalog_manager.cc:5697] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 8 to 12, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 12 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.421195 15500 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.432526 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.426321 15500 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:01.445003 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 231461us
I20260709 13:19:01.445776 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:01.442384 15500 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 11, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.450736 15743 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:19:01.454123 15751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:01.457882 15668 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
I20260709 13:19:01.458390 15751 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:01.457584 15500 catalog_manager.cc:5697] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 7, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 7 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.459820 15500 catalog_manager.cc:5697] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 9, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 9 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.461364 15500 catalog_manager.cc:5697] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 11, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 11 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.464010 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:01.464951 16308 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 10.
W20260709 13:19:01.444429 20200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.305s	user 0.012s	sys 0.025s
W20260709 13:19:01.471652 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 117990us
I20260709 13:19:01.471232 15500 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 10, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.475225 15500 catalog_manager.cc:5697] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 10, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 10 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.477293 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.459273 20110 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:01.459317 20193 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.471729 20200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.013s	sys 0.025s
I20260709 13:19:01.482205 16263 leader_election.cc:304] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.485332 15500 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.489658 15500 catalog_manager.cc:5697] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.491582 15500 catalog_manager.cc:5697] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.494637 15500 catalog_manager.cc:5697] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.498535 15500 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.483366 20352 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.499775 15500 catalog_manager.cc:5697] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 5 to 6, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 6 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:01.522220 20323 log.cc:927] Time spent T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 1.346s	user 0.009s	sys 0.000s
I20260709 13:19:01.486780 20193 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.485024 20244 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:01.497197 20360 raft_consensus.cc:2804] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:19:01.547511 20383 log.cc:927] Time spent T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:01.547967 20352 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.522933 16263 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:19:01.499805 15668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:01.569169 15668 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:01.570531 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 47693.4us
I20260709 13:19:01.557288 15500 catalog_manager.cc:5697] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 11 to 13, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 13 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.560935 15751 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:19:01.561120 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:01.550020 20350 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.567292 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.567631 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:19:01.553655 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 69435.5us
I20260709 13:19:01.572116 15743 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:01.576455 16308 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:01.582213 15668 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 558532223b984cf796cb6b98ddd6c9f2 in term 11.
I20260709 13:19:01.574124 15500 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:01.583608 15500 catalog_manager.cc:5697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 10, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.402676 19773 rpcz_store.cc:276] 0709 13:18:59.807485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.807633 (+   148us) service_pool.cc:224] Handling call
0709 13:18:59.838985 (+ 31352us) log.cc:844] Serialized 499 byte log entry
0709 13:19:00.057604 (+218619us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800290b00. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:19:00.119800 (+ 62196us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b54000a71a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe669142 00007faefe649eaa 00007faefe650d53 00007faefe650cd9 00007faefe650c69 00007faefe650c31 00007faefe64fdfd 000000000038f354 000000000038f199 00007faefb603475
0709 13:19:01.375941 (+1256141us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:19:01.402044 (+ 26103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13279,"raft.queue_time_us":25133,"raft.run_cpu_time_us":3105,"raft.run_wall_time_us":204222,"spinlock_wait_cycles":103431680,"thread_start_us":130804,"threads_started":1,"wal-append.queue_time_us":216918}
I20260709 13:19:01.586463 15500 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 10, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.591727 15743 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:19:01.572333 20206 raft_consensus.cc:493] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:01.597924 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.599949 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.600499 15500 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 8 to 10, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:01.600981 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.572819 20360 raft_consensus.cc:697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:01.623202 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.628590 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:01.629786 15673 raft_consensus.cc:2368] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12.
I20260709 13:19:01.588032 20379 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:01.646956 20379 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.647408 20379 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:01.636449 20396 log.cc:927] Time spent T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:19:01.636965 20394 consensus_queue.cc:1048] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:01.637126 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 43736.3us
I20260709 13:19:01.653919 20352 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:01.639031 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.642740 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:01.657907 20199 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:01.658473 20199 raft_consensus.cc:697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:01.659345 20199 consensus_queue.cc:237] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:19:01.661062 20229 leader_election.cc:290] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:01.661602 20193 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:01.663955 15565 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:01.643373 20350 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:01.667752 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.667973 19773 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:01.668653 19773 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Becoming Leader. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:01.645444 20082 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:19:01.669296 20082 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:01.669682 19773 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.670135 20082 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.674785 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.680369 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48144 (request call id 2594) took 1860 ms. Trace:
I20260709 13:19:01.684643 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:01.685349 16308 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:01.674744 20377 log.cc:927] Time spent T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.565s	user 0.003s	sys 0.001s
I20260709 13:19:01.681001 15669 rpcz_store.cc:276] 0709 13:18:59.820241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.820397 (+   156us) service_pool.cc:224] Handling call
0709 13:18:59.820801 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.832116 (+ 11315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.832146 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.836879 (+  4733us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.982155 (+145276us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:18:59.982198 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.982271 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.443041 (+1460770us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefe28b86e 00007faefe28abb6 00007faefe28a7d8 00007faefe294221 00007faefe2941d9 00007faefe294169
0709 13:19:01.626274 (+183233us) raft_consensus.cc:1685] finished
0709 13:19:01.626307 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.680264 (+ 53957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21739,"raft.queue_time_us":11392,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":4930,"spinlock_wait_cycles":72972032,"thread_start_us":144909,"threads_started":1,"wal-append.queue_time_us":188954}
I20260709 13:19:01.703186 15640 leader_election.cc:400] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:19:01.703632 15640 leader_election.cc:403] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:01.700263 15669 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:19:01.674939 20067 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
W20260709 13:19:01.725509 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 50789.2us
I20260709 13:19:01.726366 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.679370 20232 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:01.737110 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.740581 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.713474 20251 raft_consensus.cc:2749] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667) with higher term. Message: Invalid argument: T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 for earlier term 9. Current term is 10.
I20260709 13:19:01.607241 20206 raft_consensus.cc:515] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.744863 15714 leader_election.cc:400] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12.
I20260709 13:19:01.748344 15714 leader_election.cc:403] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:19:01.754336 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:01.755228 15674 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.759124 15670 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:01.753422 15642 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:01.763949 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:01.766382 16265 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.767285 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.739513 20067 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.744004 20232 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.769093 20391 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:01.763320 20360 consensus_queue.cc:237] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.770733 20067 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:01.770789 20232 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:01.776337 20394 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:01.779635 20399 ts_tablet_manager.cc:933] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
I20260709 13:19:01.743578 20288 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:01.743458 20352 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:01.783243 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "581e4945d85a47ba97ce48f4027aeade" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:01.786254 16305 raft_consensus.cc:1275] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:01.795033 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.758600 20231 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:01.798964 15674 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:19:01.800155 16308 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:19:01.804368 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.767248 20273 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:01.812254 16308 raft_consensus.cc:1275] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:19:01.772591 20294 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 11. Current term is 12.
I20260709 13:19:01.815315 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:01.815984 15593 raft_consensus.cc:3060] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.816591 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.781689 20067 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:01.819871 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:01.820529 15600 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:19:01.804678 20193 raft_consensus.cc:2764] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:19:01.832366 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:01.843237 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:19:01.837956 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 181521us
I20260709 13:19:01.783990 20248 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:19:01.860807 20404 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:19:01.835985 20400 log.cc:927] Time spent T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:19:01.863701 20358 log.cc:927] Time spent T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:01.798336 20394 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:01.866991 20394 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:01.870544 20206 leader_election.cc:290] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:01.852226 16305 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:19:01.874296 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:01.885983 15593 raft_consensus.cc:2468] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:19:01.818516 20240 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:01.888203 15716 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:01.892750 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:01.830420 20273 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:01.901862 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:01.898105 20294 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:01.919667 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:01.925397 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:01.913314 20082 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:01.898172 20067 consensus_queue.cc:1048] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:19:01.930368 15677 raft_consensus.cc:2393] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 13: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:01.917708 20294 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.926448 20391 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:01.951418 20294 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:01.914529 20402 consensus_queue.cc:1048] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:19:01.978669 20353 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:01.979481 20408 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:19:01.979300 20353 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.961015 20273 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:01.981837 20353 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:01.994267 15670 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:19:01.995508 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:01.996558 20402 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.004739 15642 leader_election.cc:304] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:02.006844 20229 raft_consensus.cc:2749] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:02.011406 15714 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:02.018815 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:02.026568 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:02.027359 16307 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
W20260709 13:19:02.046806 15567 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.031816 20191 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.048409 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:02.056202 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c0bf08b91c244659abe8cb87e64f8cd" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:02.032773 20067 raft_consensus.cc:2804] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:02.066704 20067 raft_consensus.cc:697] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:02.068182 20067 consensus_queue.cc:237] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.078055 20234 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:02.079017 20234 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:02.078451 20397 log.cc:927] Time spent T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.354s	user 0.000s	sys 0.004s
I20260709 13:19:02.098155 20234 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.061829 15642 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:02.100730 20370 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:02.101181 20370 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.101557 20370 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:02.110611 15568 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.117605 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 66808.5us
I20260709 13:19:02.140332 16307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:02.141889 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:02.141273 16307 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:19:02.144847 15744 raft_consensus.cc:2393] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:02.110718 20370 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.010767 20379 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.150944 15567 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:02.152940 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:02.153043 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:02.187706 20216 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.188226 20216 raft_consensus.cc:493] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:02.190680 20199 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:02.191895 20251 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:02.192376 20251 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:02.192759 20251 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.196058 20216 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:02.201524 20294 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.203806 20294 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.206487 20379 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:02.207018 15673 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:02.207341 16308 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 13: Already voted for candidate 398beb97ee4b40688f6279f18fa51ade in this term.
I20260709 13:19:02.211412 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:02.212109 16306 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:02.217803 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:02.218613 15595 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 13: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:02.218463 20204 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:02.227622 16306 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:02.229478 15716 leader_election.cc:304] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:02.211397 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:02.229318 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:02.113919 20191 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.236177 15602 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:19:02.234422 16265 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:02.255048 15567 leader_election.cc:304] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:02.264755 15597 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
I20260709 13:19:02.266934 20360 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.267050 20370 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.284011 20191 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.285665 20216 raft_consensus.cc:515] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.235412 20349 raft_consensus.cc:2804] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:02.286823 20349 raft_consensus.cc:697] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:02.287853 20349 consensus_queue.cc:237] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.296257 15595 raft_consensus.cc:3060] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:02.298910 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 144543us
I20260709 13:19:02.293861 20216 leader_election.cc:290] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.307919 19717 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.320250 20399 tablet_copy_client.cc:323] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.65:33667
I20260709 13:19:02.335093 19717 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:02.337414 19717 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:02.352669 20273 raft_consensus.cc:493] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:02.353264 20273 raft_consensus.cc:515] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.355279 20273 leader_election.cc:290] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.362834 20251 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.370427 15595 raft_consensus.cc:2468] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
W20260709 13:19:02.375233 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 222333us
I20260709 13:19:02.381477 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:02.383598 15675 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:02.380208 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:19:02.384811 15676 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 13: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:02.387172 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:02.387919 16308 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:02.401018 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 146059us
I20260709 13:19:02.412784 16308 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
I20260709 13:19:02.415274 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:02.416988 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:02.417383 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:02.415889 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:02.418941 15748 raft_consensus.cc:2393] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:02.405576 20292 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:02.420441 15675 raft_consensus.cc:2393] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 13: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:02.420271 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a774e81f58442c90fd80ad59687b99" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:02.421380 15673 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:02.405514 20110 raft_consensus.cc:2749] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:02.412982 20251 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.431692 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:02.432226 15597 raft_consensus.cc:3060] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:02.433398 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:02.434005 15602 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
W20260709 13:19:02.443344 20417 log.cc:927] Time spent T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:02.423244 20292 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:02.455818 15748 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:02.456664 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:02.460727 15642 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:02.465346 15642 leader_election.cc:304] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:02.462630 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:02.466033 20420 raft_consensus.cc:2804] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:02.472543 15597 raft_consensus.cc:2468] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
I20260709 13:19:02.457914 20292 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:02.484730 20420 raft_consensus.cc:697] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:02.485754 20420 consensus_queue.cc:237] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.490463 20379 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:02.493727 20427 log.cc:927] Time spent T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:19:02.495219 20423 log.cc:927] Time spent T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.075s	user 0.003s	sys 0.001s
I20260709 13:19:02.472980 20204 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:19:02.497613 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e303011bed72412ab6f5eebf5a6de748" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:02.498379 16308 raft_consensus.cc:2393] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 in current term 13: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:02.495875 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "181e7ee5f1ce4aa3bf93c66197002509" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:02.499377 16306 raft_consensus.cc:2368] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:19:02.483158 20273 raft_consensus.cc:2749] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:02.504142 16306 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:02.507488 15597 raft_consensus.cc:1275] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:19:02.508081 16306 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:02.511371 16309 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:19:02.514783 15642 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:02.516348 15567 leader_election.cc:400] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:19:02.516782 15567 leader_election.cc:403] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:19:02.522321 15640 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:02.536784 15612 tablet_copy_service.cc:140] P 558532223b984cf796cb6b98ddd6c9f2: Received BeginTabletCopySession request for tablet bbc6f003381b434b92d3b262155935c7 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:34574)
I20260709 13:19:02.538092 15612 tablet_copy_service.cc:161] P 558532223b984cf796cb6b98ddd6c9f2: Beginning new tablet copy session on tablet bbc6f003381b434b92d3b262155935c7 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:34574: session id = 398beb97ee4b40688f6279f18fa51ade-bbc6f003381b434b92d3b262155935c7
I20260709 13:19:02.556700 20227 consensus_queue.cc:1048] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:02.561455 15612 tablet_copy_source_session.cc:215] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:02.533522 20353 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:02.563079 20353 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.563534 20353 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:02.526423 20370 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:02.565270 20370 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:02.521166 20304 raft_consensus.cc:2749] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739) with higher term. Message: Invalid argument: T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 558532223b984cf796cb6b98ddd6c9f2 for earlier term 10. Current term is 11.
I20260709 13:19:02.520009 20251 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 13:19:02.574764 20426 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:19:02.594722 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:02.594463 20292 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:02.597023 20067 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.597194 20292 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:02.605149 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:02.597599 20067 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.626629 20394 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:02.627436 20067 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:02.632845 15673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:02.637385 16306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:02.638684 16306 raft_consensus.cc:2410] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for term 11 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:19:02.683461 15565 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:02.694509 15743 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:02.705197 15673 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:02.708211 15716 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:02.699707 20392 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:02.673305 20370 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:02.688550 20303 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:19:02.712007 20296 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:02.756321 16308 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:02.758793 20284 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:02.714797 20067 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 13:19:02.784180 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 89137us
I20260709 13:19:02.720314 20206 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:19:02.801666 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 98137.8us
I20260709 13:19:02.825727 15602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:02.826344 15602 raft_consensus.cc:606] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:19:02.875248 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:02.851513 20353 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:02.885003 15600 raft_consensus.cc:1275] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:19:02.886796 15602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29bae97aafa2447892a23984cd26cd90"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:02.887920 15602 raft_consensus.cc:606] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:19:02.888443 15602 raft_consensus.cc:614] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:02.899156 20399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbc6f003381b434b92d3b262155935c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:02.904165 15669 raft_consensus.cc:2368] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 13. Current term is 14.
I20260709 13:19:02.911960 20353 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:02.939364 15595 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
W20260709 13:19:02.950095 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 61737.9us
I20260709 13:19:02.960314 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:02.962224 15750 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:02.994419 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:02.995065 15602 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:02.995463 15593 raft_consensus.cc:1275] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:02.980937 20097 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:03.053855 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2; no voters: 
I20260709 13:19:03.075006 20067 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:03.086962 20067 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:03.088001 20067 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:03.048332 20097 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:03.068046 15602 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 14.
I20260709 13:19:02.994683 20234 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 13:19:03.070421 20294 consensus_queue.cc:1048] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:19:03.127496 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 73746.5us
W20260709 13:19:03.146304 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 114815us
I20260709 13:19:03.172479 15714 leader_election.cc:400] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Vote denied by peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941) with higher term. Message: Invalid argument: T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 for earlier term 13. Current term is 14.
I20260709 13:19:03.193446 20216 raft_consensus.cc:993] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:03.194015 20216 raft_consensus.cc:1081] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:03.197392 20097 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:03.166594 20379 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:03.209777 20379 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:03.179561 20453 consensus_queue.cc:1048] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:19:03.221089 20379 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:03.216569 15640 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:03.235203 19717 raft_consensus.cc:2804] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:03.235828 19717 raft_consensus.cc:697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:03.236847 19717 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:03.240849 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 193447us
I20260709 13:19:03.253368 15602 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:03.264986 15677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:19:03.265933 15677 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:03.266489 15677 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.280334 16309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:19:03.281101 16309 raft_consensus.cc:606] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:19:03.326686 15677 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:03.338891 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 56723.5us
I20260709 13:19:03.339388 15677 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:19:03.360069 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 56668.3us
W20260709 13:19:03.379210 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 88562.5us
I20260709 13:19:03.298781 20251 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:19:03.376102 20441 log.cc:927] Time spent T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:03.424010 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:03.437404 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:19:03.501497 20455 log.cc:927] Time spent T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:03.505328 20399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36520 (request call id 943) took 2023 ms. Trace:
W20260709 13:19:03.501484 20459 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:19:03.506016 20399 rpcz_store.cc:276] 0709 13:19:01.481803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.481935 (+   132us) service_pool.cc:224] Handling call
0709 13:19:01.780172 (+298237us) ts_tablet_manager.cc:934] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667)
0709 13:19:02.109076 (+328904us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefb48bdb1 00007faefb529c85 00007faefb52a6a2 00007faefe29c1db 00007faefe297aaf 00007faefb5e60ac 00007faf04440ab9 00007faefb60269b 00007faefb5ffcaa 00007faefb5ffbd2 00007faf03664131
0709 13:19:02.821675 (+712599us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:19:03.142726 (+321051us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:03.142890 (+   164us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:19:03.503946 (+361056us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:19:03.504432 (+   486us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:03.504962 (+   530us) ts_tablet_manager.cc:989] Replica registered.
0709 13:19:03.505191 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":51861,"spinlock_wait_cycles":7451904,"tablet-copy.queue_time_us":219940,"thread_start_us":429889,"threads_started":2}
I20260709 13:19:03.571979 20399 tablet_copy_client.cc:806] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:03.608026 20399 tablet_copy_client.cc:670] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
W20260709 13:19:03.618551 20426 log.cc:927] Time spent T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: Append to log took a long time: real 0.412s	user 0.002s	sys 0.002s
I20260709 13:19:03.708513 20465 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:03.709710 20465 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:03.713389 20465 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:03.782465 20350 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.783284 20350 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:03.785607 20350 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:03.818713 15714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.004s	sys 0.030s
W20260709 13:19:03.819124 15714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.004s	sys 0.030s
I20260709 13:19:03.824801 15669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:03.832840 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:03.833477 15743 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.836283 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:03.840530 15744 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:03.852146 15743 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
W20260709 13:19:03.865460 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 453918us
I20260709 13:19:03.878487 20251 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:03.883471 15743 raft_consensus.cc:3055] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:19:03.884091 15743 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:03.884991 15743 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:03.886003 15743 raft_consensus.cc:3060] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:03.894363 15674 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 LEADER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:03.896260 15743 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:19:03.898021 15743 pending_rounds.cc:85] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Aborting all ops after (but not including) 7
I20260709 13:19:03.898666 15743 pending_rounds.cc:107] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:19:03.878487 15642 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:03.899569 15743 raft_consensus.cc:2889] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.908797 20251 raft_consensus.cc:2804] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:03.911525 20251 raft_consensus.cc:697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:03.933064 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:03.933753 15595 raft_consensus.cc:3055] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:19:03.934078 15595 raft_consensus.cc:740] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:03.933099 15600 raft_consensus.cc:1240] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Rejecting Update request from peer 5433f0c9863e427d88ba5916819e28e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:19:03.915421 20470 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:19:03.917002 20304 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.945550 15595 consensus_queue.cc:260] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:03.949424 15595 raft_consensus.cc:3060] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:03.956223 15595 raft_consensus.cc:2468] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:19:03.946823 20448 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:03.987252 20235 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:03.957427 19717 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:03.987882 20235 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:03.988847 19717 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:03.990451 20235 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:03.991142 19717 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:03.982117 20448 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:03.992810 16263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.001s	sys 0.037s
W20260709 13:19:03.993163 16263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.037s
W20260709 13:19:03.993422 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 639400us
I20260709 13:19:03.994134 20448 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.014658 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbde144556724eb39acadbe99d8a1de3"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:04.015326 15595 raft_consensus.cc:606] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.015687 15595 raft_consensus.cc:614] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:04.016182 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.018791 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
W20260709 13:19:04.022356 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.016424 20082 raft_consensus.cc:493] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:04.024019 15597 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:19:04.023829 20082 raft_consensus.cc:515] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:03.953631 20304 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.025943 20082 leader_election.cc:290] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.038628 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:19:04.076823 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 67681.1us
I20260709 13:19:04.098832 15597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.102988 16307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e105ea6267284f22bdfda14678176b49"
dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:45146
I20260709 13:19:04.103864 16307 raft_consensus.cc:606] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.111604 16265 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:04.120482 15716 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.123914 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:04.141104 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.048086 20251 consensus_queue.cc:237] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.136895 20294 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.134127 20450 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:04.155529 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 145773us
I20260709 13:19:04.163110 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.202832 20227 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:04.205829 20227 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.209533 20227 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.211344 15677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.199141 19702 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:04.218982 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 134280us
I20260709 13:19:04.179529 20473 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:04.199745 20402 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:04.221662 19717 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:19:04.225427 20473 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:04.252290 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 128700us
I20260709 13:19:04.228212 20402 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:04.258692 20478 log.cc:927] Time spent T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:19:04.259212 20473 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:04.264397 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 141652us
I20260709 13:19:04.279371 16307 raft_consensus.cc:1275] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:19:04.279500 20402 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.281760 16310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.283519 16299 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:19:04.285254 15676 raft_consensus.cc:1240] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:04.275279 20304 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.292896 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.316968 20473 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.317731 20473 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.320077 20473 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.331333 20473 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.332016 20473 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.332924 20492 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.333549 20492 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.335225 20473 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.336293 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.335654 20492 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.337572 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.344080 20473 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.345031 20473 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.355072 20473 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.399101 20496 raft_consensus.cc:493] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:04.399772 20496 raft_consensus.cc:515] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.407030 20492 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.407613 20492 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.408488 15747 raft_consensus.cc:1240] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Rejecting Update request from peer 558532223b984cf796cb6b98ddd6c9f2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:19:04.411931 20496 leader_election.cc:290] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.413533 20492 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:04.414216 20466 raft_consensus.cc:993] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:04.414820 20466 raft_consensus.cc:1081] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:04.416817 20082 raft_consensus.cc:493] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:04.417572 20082 raft_consensus.cc:515] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.420173 20082 leader_election.cc:290] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:04.424185 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 84920.2us
I20260709 13:19:04.424990 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.425567 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6556ac1ec52640c3bad0bf13607c8d19" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.433643 20292 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.434325 20292 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.439523 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.439929 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.440531 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.444088 15673 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:40216
I20260709 13:19:04.444247 15675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.444559 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.453222 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.455552 20465 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:04.447691 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.448868 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.451560 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.444706 15673 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.460829 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.469099 15673 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.444810 20491 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:19:04.474774 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 49781.1us
I20260709 13:19:04.475193 20491 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:19:04.477499 20491 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.445434 20486 consensus_queue.cc:1048] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:19:04.484179 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.486747 15642 leader_election.cc:304] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.485769 20470 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.493409 20470 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.496279 20470 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:04.500283 20200 raft_consensus.cc:493] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:04.500952 20200 raft_consensus.cc:515] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.501231 15640 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:19:04.506740 15566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.515002 19717 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.516935 19717 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.519236 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.518356 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43658563a58a42e3b9a3da86a87a9c02" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.517498 19717 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.451645 20292 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.503199 20200 leader_election.cc:290] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.535239 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.538208 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.543735 20470 raft_consensus.cc:2749] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.538477 19717 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:04.547175 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.552745 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.556665 15670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.521531 15673 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.558863 20234 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.559621 15676 raft_consensus.cc:1240] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 10. Current term is 11. Ops: []
I20260709 13:19:04.561803 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.562175 15673 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.562621 20292 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.575150 20399 tablet_copy_client.cc:538] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:04.581020 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.582430 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.584678 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:04.585232 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.585388 15743 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.587255 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.592824 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:04.593420 16299 raft_consensus.cc:3055] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:04.593689 16299 raft_consensus.cc:740] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:04.594378 16299 consensus_queue.cc:260] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.595204 16299 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:04.600922 20450 raft_consensus.cc:993] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:04.601572 20450 raft_consensus.cc:1081] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:04.604513 16299 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:04.613466 15642 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:04.614302 20234 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:04.614835 20234 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:04.615785 20234 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.617998 15716 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.621608 20490 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.624787 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:04.626307 15499 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.628124 15499 catalog_manager.cc:5697] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 6, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 6 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.630275 15499 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:04.634562 16265 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.635426 15499 catalog_manager.cc:5697] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.637319 15499 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 8 to 9, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.639042 15499 catalog_manager.cc:5697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.653960 15499 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.644856 15744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e105ea6267284f22bdfda14678176b49"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:44676
I20260709 13:19:04.657572 15744 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.657963 15744 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:04.647143 20490 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.660948 20490 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.663251 20490 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.664256 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.666214 20490 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.666918 20490 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.668725 20473 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.669255 20473 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.600946 15743 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:04.670195 20491 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.670754 20491 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.671404 20473 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.672930 20491 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.673969 15744 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.676174 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.676409 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.648995 20399 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:19:04.677290 20450 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.634275 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 216) took 7344 ms. Trace:
I20260709 13:19:04.681679 15750 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 15 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:04.684667 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.682734 20490 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:04.679337 15500 rpcz_store.cc:276] 0709 13:18:57.289748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.310520 (+ 20772us) service_pool.cc:224] Handling call
0709 13:18:57.565316 (+254796us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe65a090 00007faefe6f8f3a 00007faf044af1cc 00007faf045ad37e 00007faf02a6e2a4 00007faf02a6e232 00007faf02a6e161 00007faf02a6e0dc 00007faf02a6d392 00007faefca2b48c 00007faefca2a8c6
0709 13:19:04.634176 (+7068860us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:01.795824 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:01.796436 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:01.796476 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:19:01.796498 (+    22us) tablet.cc:662] Decoding operations
0709 13:19:01.824686 (+ 28188us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:01.824787 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:01.824818 (+    31us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:19:01.827393 (+  2575us) tablet.cc:701] Row locks acquired
0709 13:19:01.827418 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:19:01.827859 (+   441us) write_op.cc:270] Start()
0709 13:19:01.827989 (+   130us) write_op.cc:276] Timestamp: P: 1783603141827803 usec, L: 0
0709 13:19:01.828016 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:19:01.946224 (+118208us) log.cc:844] Serialized 11356 byte log entry
0709 13:19:02.426593 (+480369us) op_driver.cc:464] REPLICATION: finished
0709 13:19:02.626599 (+200006us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b18003462a0. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faf044cbde1 00007faf044d85b1 00007faefb6033f3 00007faefb6057c1 00007faefb605779 00007faefb605709 00007faefb6056d1 00007faefb6049cd 000000000038f354 000000000038f199 00007faefb5e683a
0709 13:19:02.626737 (+   138us) write_op.cc:301] APPLY: starting
0709 13:19:02.626810 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:02.769242 (+142432us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:02.769266 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:02.977499 (+208233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:02.977875 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=0,mrs_lookups=0
0709 13:19:02.977925 (+    50us) write_op.cc:312] APPLY: finished
0709 13:19:02.978433 (+   508us) log.cc:844] Serialized 252 byte log entry
0709 13:19:02.978631 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:02.978854 (+   223us) write_op.cc:454] Released schema lock
0709 13:19:02.978920 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:02.979325 (+   405us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:02.979359 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1857655,"reported_tablets":36,"spinlock_wait_cycles":218184448,"child_traces":[["op",{"apply.queue_time_us":107767,"apply.run_cpu_time_us":37394,"apply.run_wall_time_us":352552,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125463,"num_ops":29,"prepare.queue_time_us":19924,"prepare.run_cpu_time_us":26828,"prepare.run_wall_time_us":178052,"raft.queue_time_us":180410,"raft.run_cpu_time_us":53382,"raft.run_wall_time_us":117734,"replication_time_us":586243,"spinlock_wait_cycles":45800832,"thread_start_us":260581,"threads_started":4,"wal-append.queue_time_us":75285,"wal-append.run_cpu_time_us":19862,"wal-append.run_wall_time_us":1954350}]]}
I20260709 13:19:04.690225 20503 consensus_queue.cc:1059] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:04.691325 20450 raft_consensus.cc:3055] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:04.691702 20450 raft_consensus.cc:740] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:04.692961 15744 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 15 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:04.696354 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 187784us
I20260709 13:19:04.696805 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:04.692535 20450 consensus_queue.cc:260] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.700636 20450 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:04.703286 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.705729 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3862488109f64226a32f4b77b567c1dc" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.706300 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.706389 20480 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.707167 20480 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.709271 16299 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b798e44b35ab41d0943297db40d7407f" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.710073 20480 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:04.711696 15499 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 7 to 10, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 10 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:04.724566 15499 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.715395 16309 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 15.
I20260709 13:19:04.710827 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:19:04.737072 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 228457us
I20260709 13:19:04.742878 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.744907 15499 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.742192 20435 raft_consensus.cc:493] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:04.747095 20435 raft_consensus.cc:515] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.746802 15499 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.749424 20435 leader_election.cc:290] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.743781 20449 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.744913 15716 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:04.764806 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.770629 15565 leader_election.cc:304] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.771225 20505 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.772162 20505 raft_consensus.cc:2749] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.773837 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.773501 20449 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.775866 20480 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.776134 20216 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.776468 20480 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.777249 20449 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:04.785862 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.791774 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.781176 20234 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:04.792866 20234 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } attrs { replace: true } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.793883 20480 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:04.785120 20491 raft_consensus.cc:2804] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:04.795722 20234 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.797228 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.784732 20435 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.799208 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.800501 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.809122 15642 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.810072 20234 raft_consensus.cc:2749] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.804296 15499 catalog_manager.cc:5697] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.814144 15499 catalog_manager.cc:5697] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.814641 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.815147 15598 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:04.816352 15499 catalog_manager.cc:5697] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 7, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.817364 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.818748 15499 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 4 to 10, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.820662 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.820268 15499 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 10 to 11, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.825207 15745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.828096 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.832230 15499 catalog_manager.cc:5697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.829761 20216 raft_consensus.cc:493] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:04.837041 20216 raft_consensus.cc:515] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:04.831338 20082 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:04.839524 20082 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.845530 15602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.845846 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.846874 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.851138 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.852918 15499 catalog_manager.cc:5697] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 7 to 9, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:04.833407 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.855453 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.854727 15499 catalog_manager.cc:5697] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 10 to 11, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:04.861231 15745 raft_consensus.cc:1275] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:04.862146 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.865556 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.866044 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.868137 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:04.868721 15601 raft_consensus.cc:3060] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:04.869361 20216 leader_election.cc:290] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:04.870920 20082 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:04.872658 15567 leader_election.cc:304] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.873486 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.874347 15600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.878206 15567 leader_election.cc:304] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.879379 20234 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:04.879890 20082 raft_consensus.cc:2749] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:04.855317 20491 raft_consensus.cc:697] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 15 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:04.881832 20491 consensus_queue.cc:237] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:04.890044 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.886574 20216 raft_consensus.cc:2749] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.890853 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:04.893240 16295 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:04.892210 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "558532223b984cf796cb6b98ddd6c9f2" is_pre_election: true
I20260709 13:19:04.895529 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:04.895639 15601 raft_consensus.cc:2468] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 15.
I20260709 13:19:04.903928 15600 raft_consensus.cc:1240] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 15 FOLLOWER]: Rejecting Update request from peer 398beb97ee4b40688f6279f18fa51ade for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:04.904883 20435 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.917718 15640 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:04.919237 15640 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:04.919376 20465 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.920254 20251 raft_consensus.cc:2749] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:04.920205 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.921746 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e5693d3c474948b687ba64b0b31215" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.922462 15640 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:04.924295 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.925513 20491 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.925472 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:04.926785 20292 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.928237 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.929605 20514 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:04.930064 15674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97765616b2ca49eca1b5b2c90a10c9a3" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:04.930351 15714 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.931288 20490 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.931597 20234 consensus_queue.cc:1048] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:04.931139 20495 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.934535 15640 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:04.935313 20480 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:04.931600 15714 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:04.941838 20490 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.943658 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.946038 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.946946 20490 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:04.947353 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.948444 20450 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:04.958578 20514 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:04.959988 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.961339 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.962448 20450 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:04.967264 20514 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:04.973142 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:04.976943 20514 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:05.007412 15565 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:05.011451 15745 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:05.011747 20435 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:05.013021 15565 leader_election.cc:304] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:05.020475 20480 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:05.023640 20505 raft_consensus.cc:2749] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:05.028201 15565 leader_election.cc:304] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:05.029201 20204 raft_consensus.cc:2749] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:05.121719 20399 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:05.122845 20399 tablet_bootstrap.cc:492] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:19:05.123677 20399 ts_tablet_manager.cc:1403] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.475s	user 0.043s	sys 0.024s
I20260709 13:19:05.130055 16309 raft_consensus.cc:1275] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:05.131964 20480 consensus_queue.cc:1048] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:05.132004 20399 raft_consensus.cc:359] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:19:05.141098 20399 raft_consensus.cc:740] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:19:05.146420 20399 consensus_queue.cc:260] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:19:05.149652 20399 ts_tablet_manager.cc:1434] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:19:05.151618 15612 tablet_copy_service.cc:342] P 558532223b984cf796cb6b98ddd6c9f2: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-bbc6f003381b434b92d3b262155935c7 received from {username='slave'} at 127.0.0.1:34574
I20260709 13:19:05.152216 15612 tablet_copy_service.cc:434] P 558532223b984cf796cb6b98ddd6c9f2: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-bbc6f003381b434b92d3b262155935c7 on tablet bbc6f003381b434b92d3b262155935c7 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:19:05.291044 15500 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 10 to 12, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 12 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.293720 15500 catalog_manager.cc:5697] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 10 to 13, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 13 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.310513 15500 catalog_manager.cc:5697] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 11 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.312849 15500 catalog_manager.cc:5697] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 7, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.314289 15500 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 8 to 10, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 10 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.315696 15500 catalog_manager.cc:5697] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:05.325531 16331 debug-util.cc:398] Leaking SignalData structure 0x7b0800323660 after lost signal to thread 14504
W20260709 13:19:05.335990 16331 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc520 after lost signal to thread 15534
W20260709 13:19:05.337358 16331 debug-util.cc:398] Leaking SignalData structure 0x7b080035d900 after lost signal to thread 15626
W20260709 13:19:05.337658 16331 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc8a0 after lost signal to thread 15627
W20260709 13:19:05.339308 16331 debug-util.cc:398] Leaking SignalData structure 0x7b0800301660 after lost signal to thread 15701
W20260709 13:19:05.344527 16331 debug-util.cc:398] Leaking SignalData structure 0x7b080011fba0 after lost signal to thread 15775
W20260709 13:19:05.349722 16331 debug-util.cc:398] Leaking SignalData structure 0x7b08002d6e60 after lost signal to thread 15776
W20260709 13:19:05.361740 16331 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc800 after lost signal to thread 16334
W20260709 13:19:05.377327 15499 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 293) took 12734 ms (client timeout 15000 ms). Trace:
I20260709 13:19:05.386987 15500 catalog_manager.cc:5697] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.399854 15500 catalog_manager.cc:5697] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 11, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 11 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.401443 15500 catalog_manager.cc:5697] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 11 to 13, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 13 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.403767 15500 catalog_manager.cc:5697] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 13, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 13 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.405411 15500 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 11 to 12, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 12 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.413883 15500 catalog_manager.cc:5697] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 6 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.415352 15500 catalog_manager.cc:5697] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.417919 15500 catalog_manager.cc:5697] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:05.384701 15499 rpcz_store.cc:269] 0709 13:18:52.642936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.652527 (+  9591us) service_pool.cc:224] Handling call
0709 13:19:05.377237 (+12724710us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:04.958948 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:04.959575 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:04.959615 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:19:04.959631 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:04.961213 (+  1582us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:04.961289 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:04.961315 (+    26us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:19:04.969609 (+  8294us) tablet.cc:701] Row locks acquired
0709 13:19:04.969629 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:04.969767 (+   138us) write_op.cc:270] Start()
0709 13:19:04.969885 (+   118us) write_op.cc:276] Timestamp: P: 1783603144969724 usec, L: 0
0709 13:19:04.969906 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:04.974587 (+  4681us) log.cc:844] Serialized 7459 byte log entry
0709 13:19:05.007939 (+ 33352us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b54003e4ed4. stack: 00007faefb5d1343 00007faefb5d1240 00007faefaf601d4 00007faf04c9e304 00007faf04c9e299 00007faefe659571 00007faefe6ebe28 00007faf02126581 00007faf02125d58 00007faf0212a9f1 00007faf0212a9a9 00007faf0212a939 00007faf0212a901 00007faf02129b2d 000000000038f354 000000000038f199
0709 13:19:05.029598 (+ 21659us) op_driver.cc:464] REPLICATION: finished
0709 13:19:05.054957 (+ 25359us) write_op.cc:301] APPLY: starting
0709 13:19:05.055043 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:05.075597 (+ 20554us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:05.083336 (+  7739us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:05.238270 (+154934us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:05.238634 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 13:19:05.238693 (+    59us) write_op.cc:312] APPLY: finished
0709 13:19:05.239162 (+   469us) log.cc:844] Serialized 172 byte log entry
0709 13:19:05.239353 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.239531 (+   178us) write_op.cc:454] Released schema lock
0709 13:19:05.239589 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:05.264359 (+ 24770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.264401 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71418,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":25096,"apply.run_cpu_time_us":28856,"apply.run_wall_time_us":185070,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83623,"num_ops":19,"prepare.queue_time_us":19109,"prepare.run_cpu_time_us":12092,"prepare.run_wall_time_us":49183,"raft.queue_time_us":16618,"raft.run_cpu_time_us":2350,"raft.run_wall_time_us":19350,"replication_time_us":59531,"spinlock_wait_cycles":9215232,"thread_start_us":52564,"threads_started":4,"wal-append.queue_time_us":24081}]]}
I20260709 13:19:05.430930 15500 catalog_manager.cc:5697] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:05.439581 16309 raft_consensus.cc:1217] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:19:05.440056 15500 catalog_manager.cc:5697] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 8 to 13, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 13 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.443697 15500 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:05.511554 16309 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 15 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:05.517105 15601 raft_consensus.cc:1275] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 15 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:19:05.530511 20514 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:05.539284 20514 consensus_queue.cc:1048] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:05.742533 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:05.948743 15565 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 49878.1us
W20260709 13:19:05.987041 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 43516.1us
I20260709 13:19:06.015486 15500 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:37366 (request call id 217) took 1195 ms. Trace:
I20260709 13:19:06.016115 15500 rpcz_store.cc:276] 0709 13:19:04.820093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.820296 (+   203us) service_pool.cc:224] Handling call
0709 13:19:06.015193 (+1194897us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:05.459153 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:05.459677 (+   524us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:05.459711 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:19:05.459729 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:05.461910 (+  2181us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:05.461968 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:05.461998 (+    30us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:19:05.464663 (+  2665us) tablet.cc:701] Row locks acquired
0709 13:19:05.464683 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:05.464825 (+   142us) write_op.cc:270] Start()
0709 13:19:05.464942 (+   117us) write_op.cc:276] Timestamp: P: 1783603145464780 usec, L: 0
0709 13:19:05.464965 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:05.465578 (+   613us) log.cc:844] Serialized 6672 byte log entry
0709 13:19:05.479804 (+ 14226us) op_driver.cc:464] REPLICATION: finished
0709 13:19:05.482313 (+  2509us) write_op.cc:301] APPLY: starting
0709 13:19:05.482397 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:05.588777 (+106380us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:05.588873 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:05.705206 (+116333us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:05.705614 (+   408us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:19:05.705663 (+    49us) write_op.cc:312] APPLY: finished
0709 13:19:05.706164 (+   501us) log.cc:844] Serialized 156 byte log entry
0709 13:19:05.706363 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.706522 (+   159us) write_op.cc:454] Released schema lock
0709 13:19:05.706575 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:05.706918 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:05.706947 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24784,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":2237,"apply.run_cpu_time_us":23603,"apply.run_wall_time_us":224580,"cfile_cache_hit":68,"cfile_cache_hit_bytes":71128,"num_ops":17,"prepare.queue_time_us":186,"prepare.run_cpu_time_us":4693,"prepare.run_wall_time_us":9211,"replication_time_us":14674}]]}
I20260709 13:19:06.129161 15497 catalog_manager.cc:5697] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 11 to 12, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 12 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.206810 20505 raft_consensus.cc:1064] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:19:06.219484 20505 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:06.276664 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 81709.8us
I20260709 13:19:06.302268 15497 catalog_manager.cc:5697] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 8 to 9, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 9 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.334410 15745 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:06.336930 20537 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:19:06.341615 15497 catalog_manager.cc:5697] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:06.367976 16309 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:06.369061 15676 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:19:06.371488 20505 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:06.371964 15497 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 8, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 8 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.374004 15497 catalog_manager.cc:5697] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:06.382134 20537 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:19:06.394479 15497 catalog_manager.cc:5697] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 9 to 10, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 10 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.426782 15497 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 10 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 11 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.441430 20216 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:06.451014 16295 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:06.456882 15671 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:06.484157 15743 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:06.681074 15500 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 10 to 11, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:06.683089 15500 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index -1 to 8, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 12 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:19:06.692056 15500 catalog_manager.cc:5697] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 14 to 15, leader changed from 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 15 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:06.755883 15496 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 11 to 12, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 12 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.793414 15497 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46324 (request call id 316) took 6175 ms. Trace:
I20260709 13:19:06.792951 15496 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 8 to 9, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 9 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:06.793895 15497 rpcz_store.cc:276] 0709 13:19:00.618016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.618266 (+   250us) service_pool.cc:224] Handling call
0709 13:19:06.793332 (+6175066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:06.506174 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:06.507132 (+   958us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:06.507186 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:19:06.507204 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:06.508086 (+   882us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:06.508193 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:06.508229 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:06.509028 (+   799us) tablet.cc:701] Row locks acquired
0709 13:19:06.509082 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:19:06.509232 (+   150us) write_op.cc:270] Start()
0709 13:19:06.516855 (+  7623us) write_op.cc:276] Timestamp: P: 1783603146509173 usec, L: 0
0709 13:19:06.516894 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:19:06.518018 (+  1124us) log.cc:844] Serialized 2849 byte log entry
0709 13:19:06.552050 (+ 34032us) op_driver.cc:464] REPLICATION: finished
0709 13:19:06.604073 (+ 52023us) write_op.cc:301] APPLY: starting
0709 13:19:06.604170 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:06.657900 (+ 53730us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:06.658054 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:06.662521 (+  4467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:06.662882 (+   361us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:19:06.662976 (+    94us) write_op.cc:312] APPLY: finished
0709 13:19:06.663420 (+   444us) log.cc:844] Serialized 73 byte log entry
0709 13:19:06.663620 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:06.663729 (+   109us) write_op.cc:454] Released schema lock
0709 13:19:06.663794 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:06.702447 (+ 38653us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:06.702477 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":724620,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":44328,"apply.run_cpu_time_us":11695,"apply.run_wall_time_us":105761,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33415,"num_ops":7,"prepare.queue_time_us":39374,"prepare.run_cpu_time_us":4697,"prepare.run_wall_time_us":12412,"replication_time_us":34957,"thread_start_us":81552,"threads_started":2}]]}
I20260709 13:19:06.796707 15496 catalog_manager.cc:5697] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 10 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.818559 15496 catalog_manager.cc:5697] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 9 to 10, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65). New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:06.827373 15496 catalog_manager.cc:5697] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 9 to 10, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 10 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:06.840695 15496 catalog_manager.cc:5697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:06.850693 15496 catalog_manager.cc:5697] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 11 to 12, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 12 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:06.916138 15500 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 8 to 9, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:07.009797 15499 catalog_manager.cc:5697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.026046 15496 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 328) took 3222 ms. Trace:
I20260709 13:19:07.026684 15499 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 11 to 14, leader changed from 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 14 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:07.031150 15499 catalog_manager.cc:5697] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: term changed from 7 to 8, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 8 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } }
I20260709 13:19:07.026587 15496 rpcz_store.cc:276] 0709 13:19:03.803462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.804568 (+  1106us) service_pool.cc:224] Handling call
0709 13:19:07.025963 (+3221395us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:06.894674 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:06.895226 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:06.895264 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:19:06.895278 (+    14us) tablet.cc:662] Decoding operations
0709 13:19:06.896132 (+   854us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:06.896197 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:06.896224 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:19:06.896927 (+   703us) tablet.cc:701] Row locks acquired
0709 13:19:06.896943 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:19:06.897084 (+   141us) write_op.cc:270] Start()
0709 13:19:06.897208 (+   124us) write_op.cc:276] Timestamp: P: 1783603146897042 usec, L: 0
0709 13:19:06.897227 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:06.897869 (+   642us) log.cc:844] Serialized 2849 byte log entry
0709 13:19:06.899834 (+  1965us) op_driver.cc:464] REPLICATION: finished
0709 13:19:06.900291 (+   457us) write_op.cc:301] APPLY: starting
0709 13:19:06.900366 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:06.904070 (+  3704us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:06.904155 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:06.908264 (+  4109us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:06.908464 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:19:06.908508 (+    44us) write_op.cc:312] APPLY: finished
0709 13:19:06.908794 (+   286us) log.cc:844] Serialized 73 byte log entry
0709 13:19:06.909531 (+   737us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:06.909637 (+   106us) write_op.cc:454] Released schema lock
0709 13:19:06.909684 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:06.910056 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:06.910092 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16805,"reported_tablets":48,"spinlock_wait_cycles":11008,"child_traces":[["op",{"apply.queue_time_us":237,"apply.run_cpu_time_us":9052,"apply.run_wall_time_us":9705,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29288,"num_ops":7,"prepare.queue_time_us":534,"prepare.run_cpu_time_us":3485,"prepare.run_wall_time_us":3484,"replication_time_us":2493}]]}
I20260709 13:19:07.127889 15499 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46306 (request call id 294) took 1570 ms. Trace:
I20260709 13:19:07.139582 15499 rpcz_store.cc:276] 0709 13:19:05.557148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.557281 (+   133us) service_pool.cc:224] Handling call
0709 13:19:07.127825 (+1570544us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:07.037801 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:07.038408 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:07.038446 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:19:07.038470 (+    24us) tablet.cc:662] Decoding operations
0709 13:19:07.039060 (+   590us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:07.039125 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:07.039156 (+    31us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:19:07.039496 (+   340us) tablet.cc:701] Row locks acquired
0709 13:19:07.039517 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:19:07.039669 (+   152us) write_op.cc:270] Start()
0709 13:19:07.039808 (+   139us) write_op.cc:276] Timestamp: P: 1783603147039621 usec, L: 0
0709 13:19:07.039837 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:19:07.040525 (+   688us) log.cc:844] Serialized 1304 byte log entry
0709 13:19:07.042529 (+  2004us) op_driver.cc:464] REPLICATION: finished
0709 13:19:07.042957 (+   428us) write_op.cc:301] APPLY: starting
0709 13:19:07.043052 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:07.044893 (+  1841us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:07.045003 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:07.046768 (+  1765us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:07.046941 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 13:19:07.046999 (+    58us) write_op.cc:312] APPLY: finished
0709 13:19:07.047209 (+   210us) log.cc:844] Serialized 41 byte log entry
0709 13:19:07.047374 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:07.047465 (+    91us) write_op.cc:454] Released schema lock
0709 13:19:07.047504 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:07.047829 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:07.047858 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27802,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":243,"apply.run_cpu_time_us":4794,"apply.run_wall_time_us":4819,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12552,"num_ops":3,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":3075,"prepare.run_wall_time_us":4672,"replication_time_us":2561}]]}
I20260709 13:19:07.232112 15595 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:07.240767 15601 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:07.259644 16295 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:07.263496 15671 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:19:07.265411 20540 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:07.267320 20216 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:07.299749 20540 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:07.306209 16309 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:19:07.326802 15498 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46310 (request call id 327) took 20503 ms (client timeout 15000 ms). Trace:
W20260709 13:19:07.329129 15498 rpcz_store.cc:269] 0709 13:18:46.823797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.827357 (+  3560us) service_pool.cc:224] Handling call
0709 13:19:07.326598 (+20499241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23525,"reported_tablets":48}
I20260709 13:19:07.335888 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bbc6f003381b434b92d3b262155935c7 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:07.364053 15676 raft_consensus.cc:2955] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:07.378901 15498 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 9 to 10, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 12 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:07.449340 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet bbc6f003381b434b92d3b262155935c7 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48722
I20260709 13:19:07.461347 16309 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:07.464535 15748 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 558532223b984cf796cb6b98ddd6c9f2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:07.466550 20505 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:07.474969 20216 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:19:07.498034 20505 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index 3 to 7, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:07.500422 15743 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 3 to 7, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:07.511922 20553 tablet_replica.cc:333] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:07.513319 20553 raft_consensus.cc:2243] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:07.514572 20553 raft_consensus.cc:2272] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:07.520293 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:07.534114 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fc4ccb73a2c14aa7864a676c25f3a2fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:07.546272 15498 catalog_manager.cc:5697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 reported cstate change: config changed from index 3 to 7, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New cstate: current_term: 10 leader_uuid: "558532223b984cf796cb6b98ddd6c9f2" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:07.561527 20553 ts_tablet_manager.cc:1916] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:07.560652 16299 raft_consensus.cc:2955] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index 3 to 7, VOTER 7019261981c6431baddd6812c15ac678 (127.14.41.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:07.587405 15660 tablet_service.cc:1558] Processing DeleteTablet for tablet fc4ccb73a2c14aa7864a676c25f3a2fc with delete_type TABLET_DATA_TOMBSTONED (TS 7019261981c6431baddd6812c15ac678 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:48120
I20260709 13:19:07.610831 20556 tablet_replica.cc:333] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:07.644300 20556 raft_consensus.cc:2243] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:07.646638 20556 raft_consensus.cc:2272] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:07.652499 20556 ts_tablet_manager.cc:1916] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:07.664211 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86c5f054f586412fbd8a416245340d63"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:07.665023 15601 raft_consensus.cc:606] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:19:07.670007 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:07.670585 15601 raft_consensus.cc:606] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:07.675246 20553 ts_tablet_manager.cc:1929] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:19:07.677640 20553 log.cc:1199] T bbc6f003381b434b92d3b262155935c7 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/bbc6f003381b434b92d3b262155935c7
I20260709 13:19:07.678807 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:07.679569 15601 raft_consensus.cc:606] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Received request to transfer leadership to TS 7019261981c6431baddd6812c15ac678
I20260709 13:19:07.687100 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:07.687790 15601 raft_consensus.cc:606] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:07.690546 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet bbc6f003381b434b92d3b262155935c7 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:19:07.694123 15601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc"
dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
mode: GRACEFUL
new_leader_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:54738
I20260709 13:19:07.694767 15601 raft_consensus.cc:606] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Received request to transfer leadership to TS 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:07.703434 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:07.705286 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:07.713440 20556 ts_tablet_manager.cc:1929] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.6
I20260709 13:19:07.716547 20556 log.cc:1199] T fc4ccb73a2c14aa7864a676c25f3a2fc P 7019261981c6431baddd6812c15ac678: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/wals/fc4ccb73a2c14aa7864a676c25f3a2fc
I20260709 13:19:07.764860 15484 catalog_manager.cc:5028] TS 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): tablet fc4ccb73a2c14aa7864a676c25f3a2fc (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
I20260709 13:19:07.866412 20558 raft_consensus.cc:993] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:07.867056 20558 raft_consensus.cc:1081] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:07.871340 15671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86c5f054f586412fbd8a416245340d63"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:19:07.872053 15671 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.872419 15671 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.884228 15671 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:07.893102 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:07.893812 15601 raft_consensus.cc:3055] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:07.894117 15601 raft_consensus.cc:740] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:07.894964 15601 consensus_queue.cc:260] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:07.896325 15601 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.906246 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:07.906910 15748 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.955302 20216 raft_consensus.cc:993] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:07.955889 20216 raft_consensus.cc:1081] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:07.957126 20558 raft_consensus.cc:993] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:07.957882 20558 raft_consensus.cc:1081] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Signalling peer 7019261981c6431baddd6812c15ac678 to start an election
I20260709 13:19:07.959434 20558 raft_consensus.cc:993] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:07.959635 15676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230"
dest_uuid: "7019261981c6431baddd6812c15ac678"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:19:07.959887 20558 raft_consensus.cc:1081] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:07.960331 15676 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.960817 15676 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.967262 15748 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:07.968472 15743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:19:07.969179 15743 raft_consensus.cc:493] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.969092 15676 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:07.969733 15743 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:07.972260 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:07.973024 15595 raft_consensus.cc:3055] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:07.973318 15595 raft_consensus.cc:740] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:07.974152 15595 consensus_queue.cc:260] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:07.975417 15595 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.977181 15676 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:07.978478 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b171707a6f8e44b7a4f81ef5fbf30230" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:07.979167 16309 raft_consensus.cc:3060] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.989181 15745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:19:07.989858 15745 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:07.990221 15745 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.002539 15745 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:19:08.004864 15745 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:08.006529 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:08.007236 15598 raft_consensus.cc:3055] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:08.006422 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:08.007992 15676 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:07.988523 16309 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:08.007541 15598 raft_consensus.cc:740] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:08.013427 15671 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:08.013290 15598 consensus_queue.cc:260] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:19:08.014564 15598 raft_consensus.cc:3060] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.016144 15601 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:08.014405 15642 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:08.017890 20533 raft_consensus.cc:2804] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.022111 20533 raft_consensus.cc:697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:08.023015 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86c5f054f586412fbd8a416245340d63" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:08.028925 16309 raft_consensus.cc:3060] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.029639 15676 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:08.031035 15714 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:08.031980 20292 raft_consensus.cc:2804] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.032517 20292 raft_consensus.cc:697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:08.033478 20292 consensus_queue.cc:237] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:19:08.025791 15595 raft_consensus.cc:2468] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:08.028255 15642 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:08.036065 20557 raft_consensus.cc:2804] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.024983 20533 consensus_queue.cc:237] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:08.036656 20557 raft_consensus.cc:697] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:08.037703 20557 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:08.029632 15743 raft_consensus.cc:515] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:08.045224 15743 leader_election.cc:290] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:08.046907 15598 raft_consensus.cc:2468] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:08.047780 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:08.054232 15676 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.047678 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f95117d3c05146d9a1c2b5c9158dc457" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:08.058588 15601 raft_consensus.cc:3055] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:19:08.059000 15601 raft_consensus.cc:740] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:08.059983 15601 consensus_queue.cc:260] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:08.064137 20537 raft_consensus.cc:993] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: : Instructing follower 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:08.065112 20537 raft_consensus.cc:1081] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Signalling peer 5433f0c9863e427d88ba5916819e28e3 to start an election
I20260709 13:19:08.068085 15601 raft_consensus.cc:3060] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:19:08.066921 15498 catalog_manager.cc:5697] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 10 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.068362 15743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc"
dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
 from {username='slave'} at 127.0.0.1:48744
I20260709 13:19:08.069572 15743 raft_consensus.cc:493] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:08.070549 15743 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.064318 15676 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:19:08.080535 15714 leader_election.cc:304] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:08.082674 16309 raft_consensus.cc:2468] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
I20260709 13:19:08.089780 15743 raft_consensus.cc:515] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:08.101022 15601 raft_consensus.cc:2468] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:19:08.101584 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "558532223b984cf796cb6b98ddd6c9f2"
I20260709 13:19:08.102186 15595 raft_consensus.cc:3055] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:19:08.102471 15595 raft_consensus.cc:740] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 558532223b984cf796cb6b98ddd6c9f2, State: Running, Role: LEADER
I20260709 13:19:08.103190 15595 consensus_queue.cc:260] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:08.104000 15595 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.113272 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc4ccb73a2c14aa7864a676c25f3a2fc" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:08.114028 16309 raft_consensus.cc:3060] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:08.108007 15743 leader_election.cc:290] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:08.121129 16309 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:08.116731 15595 raft_consensus.cc:2468] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:08.122371 15716 leader_election.cc:304] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:08.123733 20490 raft_consensus.cc:2804] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:08.125706 20538 raft_consensus.cc:2804] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:19:08.136731 15497 catalog_manager.cc:5697] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 10 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 11 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.145248 20538 raft_consensus.cc:697] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:08.149381 20538 consensus_queue.cc:237] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:08.153456 20490 raft_consensus.cc:697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:08.154582 20490 consensus_queue.cc:237] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:08.272707 15498 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 10 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.304759 15498 catalog_manager.cc:5697] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 10 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 11 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:08.306866 15498 catalog_manager.cc:5697] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 6 to 7, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 7 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.425966 15676 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:08.428755 20564 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:19:08.429008 15595 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:08.432053 20533 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:08.459896 16309 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:08.465688 20533 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:19:08.513883 15595 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:08.517069 20535 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:19:08.551195 15595 raft_consensus.cc:1275] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:19:08.551195 15671 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:08.554028 20292 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:08.554040 20490 consensus_queue.cc:1048] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:19:08.588303 15748 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:19:08.596935 16299 raft_consensus.cc:1275] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:19:08.599135 20557 consensus_queue.cc:1048] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:08.597282 20533 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:19:08.601477 15600 raft_consensus.cc:1275] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:19:08.613879 20564 consensus_queue.cc:1048] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:19:08.630419 16295 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:08.647230 20538 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:08.665982 15600 raft_consensus.cc:1275] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:19:08.667548 20564 consensus_queue.cc:1048] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:19:08.721832 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:08.825645 20586 log.cc:927] Time spent T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:19:08.911861 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
W20260709 13:19:08.918224 20590 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:19:08.918704 15548 auto_rebalancer.cc:629] Failed to schedule move for tablet 81dbf9e63ec84d138474082a1d0293c0: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:08.959811 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 72707.9us
W20260709 13:19:08.959263 20588 log.cc:927] Time spent T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
W20260709 13:19:08.963312 16263 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:19:09.010622 15671 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:19:09.017382 20589 log.cc:927] Time spent T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: Append to log took a long time: real 0.100s	user 0.001s	sys 0.001s
W20260709 13:19:09.064440 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 101142us
W20260709 13:19:09.089346 15642 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1301eda70cfb4417abc2a2d90b4bf0e8. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.134903 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.135677 15743 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:09.143980 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 120795us
W20260709 13:19:09.177141 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.204802 20597 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 13:19:09.228051 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.235962 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.253804 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.260898 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.301265 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.321504 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.319380 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.327692 15640 consensus_peers.cc:597] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.326468 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.328577 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.330035 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.332551 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.334008 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.335479 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.336625 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.337126 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.344024 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.345615 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.346916 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.345131 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.349638 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.350960 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.350255 15750 raft_consensus.cc:2955] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:19:09.351902 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 96622.5us
I20260709 13:19:09.354846 20533 raft_consensus.cc:2955] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:19:09.356866 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.375969 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.379420 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.380618 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.380123 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:09.388676 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.429215 15498 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 9, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 14 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
W20260709 13:19:09.444830 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.513613 15672 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
W20260709 13:19:09.610445 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.629770 20614 ts_tablet_manager.cc:933] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:09.634306 15642 consensus_peers.cc:597] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 -> Peer 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739): Couldn't send request to peer 398beb97ee4b40688f6279f18fa51ade. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bda38eb6cdcc4738a2dc39a9bec091f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.644757 15747 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:19:09.649133 15640 consensus_peers.cc:597] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:09.650453 20557 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:09.656141 15567 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 58979.4us
I20260709 13:19:09.675172 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:09.680624 14501 tablet_replica.cc:333] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.688834 14501 raft_consensus.cc:2243] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.689774 14501 raft_consensus.cc:2272] T 6fc66402c5e04df38b56e6d8d4d7731d P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.700958 14501 tablet_replica.cc:333] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.702066 14501 raft_consensus.cc:2243] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.703233 14501 raft_consensus.cc:2272] T 522c09add06b4e6c8c43c06c082d1e17 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.693518 20614 tablet_copy_client.cc:323] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:19:09.708300 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet 1301eda70cfb4417abc2a2d90b4bf0e8 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:19:09.708946 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet 1301eda70cfb4417abc2a2d90b4bf0e8 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-1301eda70cfb4417abc2a2d90b4bf0e8
I20260709 13:19:09.722854 14501 tablet_replica.cc:333] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.750371 14501 raft_consensus.cc:2243] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.732026 15687 tablet_copy_source_session.cc:215] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:09.731767 20605 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:19:09.734699 15747 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:19:09.744987 20558 raft_consensus.cc:493] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:09.752969 14501 raft_consensus.cc:2272] T 8c0bf08b91c244659abe8cb87e64f8cd P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.758158 20537 raft_consensus.cc:493] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:09.759203 14501 tablet_replica.cc:333] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.758788 20537 raft_consensus.cc:515] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:09.759451 20614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1301eda70cfb4417abc2a2d90b4bf0e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.760152 14501 raft_consensus.cc:2243] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.760874 14501 raft_consensus.cc:2272] T e303011bed72412ab6f5eebf5a6de748 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.761230 20537 leader_election.cc:290] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:09.763551 14501 tablet_replica.cc:333] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.764412 14501 raft_consensus.cc:2243] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.764715 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:09.754143 20558 raft_consensus.cc:515] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:09.765094 14501 raft_consensus.cc:2272] T c9e5693d3c474948b687ba64b0b31215 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.766991 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c248e8afdd4142d983c50c91087d8e01" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:09.768003 14501 tablet_replica.cc:333] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.768139 20558 leader_election.cc:290] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:09.769083 14501 raft_consensus.cc:2243] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.770107 14501 raft_consensus.cc:2272] T 29bae97aafa2447892a23984cd26cd90 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.770025 15567 leader_election.cc:304] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:09.771895 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:09.773196 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:09.774596 14501 tablet_replica.cc:333] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.775501 14501 raft_consensus.cc:2243] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.776165 14501 raft_consensus.cc:2272] T 181e7ee5f1ce4aa3bf93c66197002509 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.779179 14501 tablet_replica.cc:333] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.779304 20537 raft_consensus.cc:2749] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:09.780279 14501 raft_consensus.cc:2243] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.781068 14501 raft_consensus.cc:2272] T 958e81841a784ee79fccc9f488562c59 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.784011 14501 tablet_replica.cc:333] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.784801 14501 raft_consensus.cc:2243] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.786427 14501 raft_consensus.cc:2272] T efe3434ebb0f4f6f9578442969e933e5 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.789310 14501 tablet_replica.cc:333] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.791183 15565 leader_election.cc:304] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:09.790213 14501 raft_consensus.cc:2243] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.793354 14501 raft_consensus.cc:2272] T 2e56a58686fa47d397c114454143e4c6 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.793488 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651bfd4950ab4835b117f7364ee51b09" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:19:09.796743 15548 auto_rebalancer.cc:629] Failed to schedule move for tablet f2d6a74c6b234911b02521773c4fdddf: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:09.802455 20537 raft_consensus.cc:2749] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:09.814181 14501 tablet_replica.cc:333] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.815145 14501 raft_consensus.cc:2243] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.815778 14501 raft_consensus.cc:2272] T 581e4945d85a47ba97ce48f4027aeade P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.828477 20558 raft_consensus.cc:493] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:09.829568 14501 tablet_replica.cc:333] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.829530 20558 raft_consensus.cc:515] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:09.830596 14501 raft_consensus.cc:2243] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.843807 20558 leader_election.cc:290] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:09.845428 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:09.848760 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "473662f2d754459c9d26a0322ab3531a" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:09.850342 15567 leader_election.cc:304] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:09.854271 14501 raft_consensus.cc:2272] T ac51ecd2367a45e8a32a6a911f34a9c2 P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.857975 20537 raft_consensus.cc:2749] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.858865 20537 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:09.859406 20537 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:09.861618 20537 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:09.863382 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:09.870661 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee7f36a2ae4477291b5b34ce26ac07c" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:09.872339 14501 tablet_replica.cc:333] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.883128 14501 raft_consensus.cc:2243] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.883911 14501 raft_consensus.cc:2272] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.899363 14501 tablet_replica.cc:333] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.899619 20558 raft_consensus.cc:493] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:09.903228 20558 raft_consensus.cc:515] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:09.906320 20558 leader_election.cc:290] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:09.906769 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:09.908061 14501 raft_consensus.cc:2243] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.909930 14501 raft_consensus.cc:2272] T bbc6f003381b434b92d3b262155935c7 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.910935 15565 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:09.921300 20537 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:09.923470 14501 tablet_replica.cc:333] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.924496 14501 raft_consensus.cc:2243] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.927767 14501 raft_consensus.cc:2272] T b42c9970a1a64670ba11510d9c0c1809 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.927197 15498 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: config changed from index -1 to 10, NON_VOTER 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) added. New cstate: current_term: 12 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } } }
I20260709 13:19:09.930527 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f900b71a39b14f0e92515320b011e9a1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:09.930929 14501 tablet_replica.cc:333] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.931890 14501 raft_consensus.cc:2243] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.932483 14501 raft_consensus.cc:2272] T b171707a6f8e44b7a4f81ef5fbf30230 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.935161 14501 tablet_replica.cc:333] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.935994 14501 raft_consensus.cc:2243] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.936764 14501 raft_consensus.cc:2272] T b798e44b35ab41d0943297db40d7407f P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.939807 14501 tablet_replica.cc:333] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.940778 14501 raft_consensus.cc:2243] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.941931 14501 raft_consensus.cc:2272] T 32d6629b913f439393c69fd7e6b8a55d P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.943728 20537 raft_consensus.cc:493] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:09.944319 20537 raft_consensus.cc:515] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:09.944864 14501 tablet_replica.cc:333] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.945892 14501 raft_consensus.cc:2243] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.946563 14501 raft_consensus.cc:2272] T c248e8afdd4142d983c50c91087d8e01 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.947361 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:09.949834 14501 tablet_replica.cc:333] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.950068 20537 leader_election.cc:290] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:09.950927 14501 raft_consensus.cc:2243] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:19:09.951297 20537 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:09.952171 14501 raft_consensus.cc:2272] T 693cb838c6224bb88e8195042cafa653 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.951858 20537 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:09.955332 14501 tablet_replica.cc:333] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.955736 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e105ea6267284f22bdfda14678176b49" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:09.956401 14501 raft_consensus.cc:2243] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.957036 14501 pending_rounds.cc:70] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Trying to abort 1 pending ops.
I20260709 13:19:09.957337 14501 pending_rounds.cc:77] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7305638495063228416 op_type: NO_OP noop_request { }
I20260709 13:19:09.957810 14501 raft_consensus.cc:2889] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:09.958226 14501 raft_consensus.cc:2272] T fc4ccb73a2c14aa7864a676c25f3a2fc P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.960807 14501 tablet_replica.cc:333] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.961773 14501 raft_consensus.cc:2243] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.962428 14501 raft_consensus.cc:2272] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.963406 15567 leader_election.cc:304] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
W20260709 13:19:09.964227 15567 raft_consensus.cc:2686] T e105ea6267284f22bdfda14678176b49 P 558532223b984cf796cb6b98ddd6c9f2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:09.965391 14501 tablet_replica.cc:333] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.966282 14501 raft_consensus.cc:2243] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.966879 14501 raft_consensus.cc:2272] T 473662f2d754459c9d26a0322ab3531a P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.969558 20614 tablet_copy_client.cc:806] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:09.970216 20614 tablet_copy_client.cc:670] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:09.973783 20537 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:09.979214 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:09.983254 14501 tablet_replica.cc:333] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.984261 14501 raft_consensus.cc:2243] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.984937 14501 raft_consensus.cc:2272] T 9fa9cf9412ae412a8756d1fc1138ddce P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.986289 15565 leader_election.cc:304] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:09.987149 20611 raft_consensus.cc:2749] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:09.987782 14501 tablet_replica.cc:333] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.988633 14501 raft_consensus.cc:2243] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:09.989259 14501 raft_consensus.cc:2272] T 43658563a58a42e3b9a3da86a87a9c02 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.990774 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:09.990938 20611 raft_consensus.cc:493] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:09.996295 20611 raft_consensus.cc:515] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:09.997154 14501 tablet_replica.cc:333] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:09.998420 20611 leader_election.cc:290] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:09.998334 14501 raft_consensus.cc:2243] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.000433 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:10.001353 14501 pending_rounds.cc:70] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Trying to abort 1 pending ops.
I20260709 13:19:10.001652 14501 pending_rounds.cc:77] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2: Aborting op as it isn't in flight: id { term: 7 index: 6 } timestamp: 7305638494829830144 op_type: NO_OP noop_request { }
I20260709 13:19:10.001969 14501 raft_consensus.cc:2889] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:10.002274 14501 raft_consensus.cc:2272] T f95117d3c05146d9a1c2b5c9158dc457 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.005003 14501 tablet_replica.cc:333] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.005591 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd4ffeb1af146f384319d74146b93f6" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:10.007272 14501 raft_consensus.cc:2243] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.007992 14501 raft_consensus.cc:2272] T 97765616b2ca49eca1b5b2c90a10c9a3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.008661 15567 leader_election.cc:304] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:10.010205 20594 raft_consensus.cc:2749] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:10.011392 14501 tablet_replica.cc:333] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.012231 14501 raft_consensus.cc:2243] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.013164 14501 raft_consensus.cc:2272] T f2d6a74c6b234911b02521773c4fdddf P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:09.989845 20614 tablet_copy_client.cc:538] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:10.016111 14501 tablet_replica.cc:333] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.018036 14501 raft_consensus.cc:2243] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.019098 14501 raft_consensus.cc:2272] T 75de3a46207e4bcfb457cdc43ffba2e2 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.021891 14501 tablet_replica.cc:333] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.022614 14501 raft_consensus.cc:2243] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.023530 14501 raft_consensus.cc:2272] T 81dbf9e63ec84d138474082a1d0293c0 P 558532223b984cf796cb6b98ddd6c9f2 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.026290 14501 tablet_replica.cc:333] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.027086 14501 raft_consensus.cc:2243] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.027707 14501 raft_consensus.cc:2272] T 651bfd4950ab4835b117f7364ee51b09 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.032693 14501 tablet_replica.cc:333] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.033525 14501 raft_consensus.cc:2243] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.034142 14501 raft_consensus.cc:2272] T dbde144556724eb39acadbe99d8a1de3 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.037128 14501 tablet_replica.cc:333] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.037900 14501 raft_consensus.cc:2243] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.040544 14501 raft_consensus.cc:2272] T 534cd68adf1a448ba243ff66d1dcd5da P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.043162 14501 tablet_replica.cc:333] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.043993 14501 raft_consensus.cc:2243] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.044579 14501 raft_consensus.cc:2272] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.047382 14501 tablet_replica.cc:333] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.048696 20611 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:10.049265 20611 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:10.054347 20611 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:10.048247 14501 raft_consensus.cc:2243] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.055022 15565 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:19:10.055925 15565 raft_consensus.cc:2686] T bda38eb6cdcc4738a2dc39a9bec091f0 P 558532223b984cf796cb6b98ddd6c9f2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:10.056015 14501 raft_consensus.cc:2272] T 7b872b4d6b684a548289e080316a1b94 P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.059010 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:10.064528 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90bff7f9147743b39de29e593c7a83b1" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:10.065388 14501 tablet_replica.cc:333] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.066259 14501 raft_consensus.cc:2243] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.067361 14501 raft_consensus.cc:2272] T 6388e92df0fa4fac9a75573887c28fd9 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.068733 20611 raft_consensus.cc:493] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:10.069312 20594 raft_consensus.cc:493] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:10.069271 20611 raft_consensus.cc:515] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } }
I20260709 13:19:10.069938 20594 raft_consensus.cc:515] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:10.071633 20611 leader_election.cc:290] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:10.071962 20594 leader_election.cc:290] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:10.074105 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:10.075399 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:10.077975 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9f9791071f42759780d6353d07808d" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:10.080585 15567 leader_election.cc:304] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:10.082055 20594 raft_consensus.cc:2749] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:10.084728 14501 tablet_replica.cc:333] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.085268 20614 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:19:10.086750 14501 raft_consensus.cc:2243] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.087437 14501 raft_consensus.cc:2272] T f900b71a39b14f0e92515320b011e9a1 P 558532223b984cf796cb6b98ddd6c9f2 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.089820 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f2c1f9b34a4914bc89224fb8100cd5" candidate_uuid: "558532223b984cf796cb6b98ddd6c9f2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:10.092696 14501 tablet_replica.cc:333] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.093520 14501 raft_consensus.cc:2243] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.094110 14501 raft_consensus.cc:2272] T ee9f9791071f42759780d6353d07808d P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.096635 14501 tablet_replica.cc:333] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.097440 14501 raft_consensus.cc:2243] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.098558 14501 raft_consensus.cc:2272] T ffd4ffeb1af146f384319d74146b93f6 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.102258 14501 tablet_replica.cc:333] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.103570 14501 raft_consensus.cc:2243] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.104468 14501 raft_consensus.cc:2272] T 3862488109f64226a32f4b77b567c1dc P 558532223b984cf796cb6b98ddd6c9f2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.107188 14501 tablet_replica.cc:333] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.108264 14501 raft_consensus.cc:2243] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.108858 14501 raft_consensus.cc:2272] T e80fb58800714a47b47ac1e701a9400f P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.111353 14501 tablet_replica.cc:333] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.112068 14501 raft_consensus.cc:2243] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.113413 14501 raft_consensus.cc:2272] T 06c670aee4b042d2aa73b9c2ec68245f P 558532223b984cf796cb6b98ddd6c9f2 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.116183 14501 tablet_replica.cc:333] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.116918 14501 raft_consensus.cc:2243] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.117522 14501 raft_consensus.cc:2272] T 86c5f054f586412fbd8a416245340d63 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.120179 14501 tablet_replica.cc:333] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.120961 14501 raft_consensus.cc:2243] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.121510 14501 raft_consensus.cc:2272] T 1ee7f36a2ae4477291b5b34ce26ac07c P 558532223b984cf796cb6b98ddd6c9f2 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.124090 14501 tablet_replica.cc:333] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.124807 14501 raft_consensus.cc:2243] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.125324 14501 raft_consensus.cc:2272] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.127844 14501 tablet_replica.cc:333] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.128509 14501 raft_consensus.cc:2243] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:10.129199 14501 raft_consensus.cc:2272] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.131863 14501 tablet_replica.cc:333] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2: stopping tablet replica
I20260709 13:19:10.132529 14501 raft_consensus.cc:2243] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:10.133608 14501 raft_consensus.cc:2272] T bea9d89f73eb4c36b8a8270cda937174 P 558532223b984cf796cb6b98ddd6c9f2 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:10.140875 15565 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:19:10.148675 15565 raft_consensus.cc:2686] T 90bff7f9147743b39de29e593c7a83b1 P 558532223b984cf796cb6b98ddd6c9f2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:10.151341 15565 leader_election.cc:304] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 558532223b984cf796cb6b98ddd6c9f2; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
W20260709 13:19:10.152050 15565 raft_consensus.cc:2686] T 95f2c1f9b34a4914bc89224fb8100cd5 P 558532223b984cf796cb6b98ddd6c9f2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:10.173859 20620 ts_tablet_manager.cc:933] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Initiating tablet copy from peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:10.193609 20620 tablet_copy_client.cc:323] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Beginning tablet copy session from remote peer at address 127.14.41.66:33941
I20260709 13:19:10.200464 15687 tablet_copy_service.cc:140] P 7019261981c6431baddd6812c15ac678: Received BeginTabletCopySession request for tablet bda38eb6cdcc4738a2dc39a9bec091f0 from peer 398beb97ee4b40688f6279f18fa51ade ({username='slave'} at 127.0.0.1:40216)
I20260709 13:19:10.201121 15687 tablet_copy_service.cc:161] P 7019261981c6431baddd6812c15ac678: Beginning new tablet copy session on tablet bda38eb6cdcc4738a2dc39a9bec091f0 from peer 398beb97ee4b40688f6279f18fa51ade at {username='slave'} at 127.0.0.1:40216: session id = 398beb97ee4b40688f6279f18fa51ade-bda38eb6cdcc4738a2dc39a9bec091f0
I20260709 13:19:10.210280 15687 tablet_copy_source_session.cc:215] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:19:10.217778 20620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda38eb6cdcc4738a2dc39a9bec091f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.321982 20620 tablet_copy_client.cc:806] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 0 data blocks...
I20260709 13:19:10.322682 20620 tablet_copy_client.cc:670] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Starting download of 1 WAL segments...
I20260709 13:19:10.329483 20620 tablet_copy_client.cc:538] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:19:10.353489 20620 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap starting.
I20260709 13:19:10.374390 20614 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:10.375589 20614 tablet_bootstrap.cc:492] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:19:10.376421 20614 ts_tablet_manager.cc:1403] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.293s	user 0.033s	sys 0.013s
I20260709 13:19:10.417073 20614 raft_consensus.cc:359] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:19:10.417997 20614 raft_consensus.cc:740] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:19:10.418711 20614 consensus_queue.cc:260] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:19:10.473908 20614 ts_tablet_manager.cc:1434] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.004s
I20260709 13:19:10.478518 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-1301eda70cfb4417abc2a2d90b4bf0e8 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:19:10.479032 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-1301eda70cfb4417abc2a2d90b4bf0e8 on tablet 1301eda70cfb4417abc2a2d90b4bf0e8 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:19:10.521951 16308 raft_consensus.cc:1217] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:19:10.621894 20620 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:10.622862 20620 tablet_bootstrap.cc:492] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Bootstrap complete.
I20260709 13:19:10.623571 20620 ts_tablet_manager.cc:1403] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Time spent bootstrapping tablet: real 0.270s	user 0.035s	sys 0.009s
I20260709 13:19:10.657203 20620 raft_consensus.cc:359] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:19:10.658103 20620 raft_consensus.cc:740] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Initialized, Role: LEARNER
I20260709 13:19:10.658780 20620 consensus_queue.cc:260] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: NON_VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: true } }
I20260709 13:19:10.682629 20620 ts_tablet_manager.cc:1434] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:19:10.687956 15687 tablet_copy_service.cc:342] P 7019261981c6431baddd6812c15ac678: Request end of tablet copy session 398beb97ee4b40688f6279f18fa51ade-bda38eb6cdcc4738a2dc39a9bec091f0 received from {username='slave'} at 127.0.0.1:40216
I20260709 13:19:10.688447 15687 tablet_copy_service.cc:434] P 7019261981c6431baddd6812c15ac678: ending tablet copy session 398beb97ee4b40688f6279f18fa51ade-bda38eb6cdcc4738a2dc39a9bec091f0 on tablet bda38eb6cdcc4738a2dc39a9bec091f0 with peer 398beb97ee4b40688f6279f18fa51ade
I20260709 13:19:10.710584 16309 raft_consensus.cc:1217] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:19:10.922498 20591 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:10.923103 20591 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:10.925380 20591 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:10.928783 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:19:10.930430 15640 leader_election.cc:336] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:10.932396 15642 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:10.934398 20625 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:10.934998 20625 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:10.937146 20625 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:10.939731 20557 raft_consensus.cc:2749] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:10.944480 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:19:10.945827 15714 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:10.984578 20557 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:10.985285 20557 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:10.987397 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:10.991806 20591 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:10.992385 20591 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.000140 20557 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.004629 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:10.988883 20625 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:19:11.016060 15640 leader_election.cc:336] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.016579 15640 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.019608 20605 raft_consensus.cc:2749] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.021137 20591 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:11.023415 15640 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.064890 20625 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.065531 20625 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.069890 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:11.073172 15642 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.074992 20591 raft_consensus.cc:2749] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:11.078089 20625 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:11.087263 20557 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.087878 20557 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.090140 20557 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.101365 16308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:11.127476 20591 raft_consensus.cc:1064] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:19:11.130906 20630 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.130214 20591 consensus_queue.cc:237] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.131594 20630 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.133755 20630 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.134191 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:19:11.135288 15714 leader_election.cc:336] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.135732 15714 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.136548 20625 raft_consensus.cc:2749] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:11.150887 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.153947 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.158177 20630 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.158766 20630 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.161218 20630 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.161427 20625 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.161794 20292 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.162015 20625 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.162331 20292 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.164403 20625 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.164546 20292 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.164933 20606 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.165463 20606 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.167884 20606 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:11.168861 15640 leader_election.cc:336] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.169366 15640 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.170071 20630 raft_consensus.cc:2749] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:19:11.171669 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.172401 15671 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
W20260709 13:19:11.174273 16263 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.174748 20630 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.175156 16263 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.175293 20630 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.177662 20630 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.182440 20629 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.183187 16308 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:11.183022 20629 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.185078 20629 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.185570 20292 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.186442 20606 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:11.186851 20606 raft_consensus.cc:493] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.186244 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.187372 20606 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.187585 15671 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:11.186219 20292 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:11.189194 15640 leader_election.cc:336] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.189667 15640 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.189919 20557 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:11.190425 20292 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.197252 20591 raft_consensus.cc:2749] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:11.198374 20557 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.198945 20557 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.202504 20557 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:19:11.207688 15640 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.209466 20606 raft_consensus.cc:515] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:11.221488 15640 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.224653 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.225386 20629 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.226011 20629 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.228158 20629 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.225442 15671 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:19:11.231292 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.232137 20629 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.232672 20629 raft_consensus.cc:493] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.233124 20629 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:11.233976 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:11.234486 15640 leader_election.cc:336] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.254702 16263 leader_election.cc:336] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.256533 20629 raft_consensus.cc:515] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.259094 20629 leader_election.cc:290] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.261240 20606 leader_election.cc:290] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.232296 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.264047 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbc6f003381b434b92d3b262155935c7" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:11.264678 15671 raft_consensus.cc:3060] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.265130 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.266637 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.267191 15748 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 8.
I20260709 13:19:11.268640 15748 raft_consensus.cc:1275] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:19:11.269881 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.270473 20629 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:11.273720 20629 raft_consensus.cc:493] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.274220 20629 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:11.273236 15671 raft_consensus.cc:2468] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:19:11.283542 20607 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.284209 20607 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.286911 20607 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.288166 20625 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.288756 20625 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.289502 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.290467 15748 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:19:11.290853 20625 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.292732 20629 raft_consensus.cc:515] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.295087 16265 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:11.306281 20629 leader_election.cc:290] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.311002 20630 raft_consensus.cc:1064] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: attempting to promote NON_VOTER 398beb97ee4b40688f6279f18fa51ade to VOTER
I20260709 13:19:11.314572 20630 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.319684 20607 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:11.320221 20607 raft_consensus.cc:493] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.320652 20607 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:11.327809 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.332412 16263 leader_election.cc:304] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.338967 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.342088 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.342800 15671 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:11.346362 20591 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.346985 20591 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.348219 20557 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.348798 20557 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.349243 20591 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.346326 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
W20260709 13:19:11.356294 15640 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.356921 15640 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.350924 20557 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.360019 20606 raft_consensus.cc:2804] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:11.365016 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522c09add06b4e6c8c43c06c082d1e17" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:11.365741 15671 raft_consensus.cc:3060] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.373224 15671 raft_consensus.cc:2468] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
W20260709 13:19:11.380762 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 48466.8us
I20260709 13:19:11.381161 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.381870 15676 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:19:11.379045 15642 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:19:11.388116 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 50506.2us
W20260709 13:19:11.389689 15714 leader_election.cc:336] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.390733 15714 leader_election.cc:336] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.391202 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.394834 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b42c9970a1a64670ba11510d9c0c1809" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:11.395498 15676 raft_consensus.cc:3060] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:11.400756 20557 raft_consensus.cc:2749] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:11.404264 14501 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15623)
I20260709 13:19:11.417634 20591 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:19:11.417765 15642 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.418205 20591 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.418613 20591 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.418591 20605 consensus_queue.cc:1048] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:11.420385 20605 raft_consensus.cc:2749] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:11.424431 20557 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.424996 20557 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.428570 20557 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.429119 20557 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.429597 20557 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.416507 15676 raft_consensus.cc:2468] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 14.
I20260709 13:19:11.446547 20629 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.449586 20629 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.451350 20629 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.437048 20606 raft_consensus.cc:697] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:11.436797 20605 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.476059 20642 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.441282 20591 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.478797 20292 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.479221 20292 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.467187 20557 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.492168 20606 consensus_queue.cc:237] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.465099 20605 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.505178 20605 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.505504 20292 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.510300 20557 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.510957 20557 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.513938 20557 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:11.515842 20591 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.491374 20607 raft_consensus.cc:515] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.518688 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:11.520272 20607 leader_election.cc:290] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.523787 20292 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.524523 20292 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.526682 20292 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.482118 20642 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.558578 16309 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
W20260709 13:19:11.565472 15640 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.566155 15640 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.569804 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.572265 16308 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEARNER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:19:11.573788 20639 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:11.574281 20639 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.574651 20639 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.578079 20630 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:19:11.590399 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.591042 15747 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 12.
W20260709 13:19:11.593729 15640 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.594089 20642 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:11.594380 15640 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.595209 15640 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.595335 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:19:11.595674 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.595995 15748 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:19:11.606770 20639 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.624517 15744 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:19:11.626803 16263 leader_election.cc:336] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.637209 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.617172 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.617914 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.638592 15750 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:19:11.622004 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efe3434ebb0f4f6f9578442969e933e5" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:11.639637 15743 raft_consensus.cc:3060] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.609714 20643 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.632858 16309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:11.649421 16309 raft_consensus.cc:3060] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.635106 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac51ecd2367a45e8a32a6a911f34a9c2" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:11.650092 15748 raft_consensus.cc:3060] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:19:11.650792 15743 raft_consensus.cc:2468] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
I20260709 13:19:11.610415 20644 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.654232 20644 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.655808 15747 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:19:11.654570 15498 catalog_manager.cc:5697] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 12 to 13, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 13 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.658427 20644 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.637682 20639 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:11.648378 20643 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.633728 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:11.671309 15744 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:19:11.672551 20643 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:11.674618 15640 consensus_peers.cc:597] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:11.681107 15640 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.687412 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.691249 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea9d89f73eb4c36b8a8270cda937174" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.692198 15676 raft_consensus.cc:2393] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 398beb97ee4b40688f6279f18fa51ade in current term 13: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:11.663823 16309 raft_consensus.cc:2468] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
I20260709 13:19:11.636215 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
W20260709 13:19:11.701952 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 65815.6us
I20260709 13:19:11.702546 15642 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.702875 15714 leader_election.cc:304] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.703800 20292 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.704202 20292 raft_consensus.cc:493] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.704653 20292 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.704703 20643 raft_consensus.cc:2804] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:11.705279 20643 raft_consensus.cc:697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:11.706110 20643 consensus_queue.cc:237] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.668591 16265 leader_election.cc:304] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:11.704057 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.664944 15748 raft_consensus.cc:2468] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 9.
I20260709 13:19:11.708890 20648 raft_consensus.cc:2804] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:11.709419 20648 raft_consensus.cc:697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:11.709569 15714 leader_election.cc:304] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.710333 20648 consensus_queue.cc:237] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.710861 20625 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:11.711288 20625 raft_consensus.cc:493] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.711673 20625 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.712591 20630 raft_consensus.cc:2804] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:11.713121 20630 raft_consensus.cc:697] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:11.713924 20630 consensus_queue.cc:237] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:11.715739 20292 raft_consensus.cc:515] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.717813 20629 raft_consensus.cc:2804] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:11.731201 20629 raft_consensus.cc:697] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 14 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:11.731782 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.732512 15676 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:19:11.732244 20629 consensus_queue.cc:237] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:11.738632 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.739235 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.739646 16263 leader_election.cc:336] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.744139 20292 leader_election.cc:290] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.752755 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.753755 15671 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:19:11.761013 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.761796 15676 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 7.
I20260709 13:19:11.762207 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:19:11.769547 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.743942 20625 raft_consensus.cc:515] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.773758 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.778780 20645 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:11.779306 20645 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.779704 20645 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.790001 20591 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:11.780803 20646 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.791765 20646 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.792127 20646 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:11.793386 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.798111 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.798652 16263 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.799026 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:11.802503 20633 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:11.805879 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.806444 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.807647 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.808338 15671 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 9.
I20260709 13:19:11.810721 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:11.811422 15671 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:11.813581 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32d6629b913f439393c69fd7e6b8a55d" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:11.814203 15671 raft_consensus.cc:3060] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.810756 20646 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:11.816576 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.811299 15714 leader_election.cc:336] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.817093 20646 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:19:11.819199 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:11.820463 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.820667 15642 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.823045 20639 raft_consensus.cc:2955] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:11.828816 20630 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.829348 20630 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.829797 20630 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.846940 20645 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:11.847909 15640 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.849321 20645 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.846700 15497 catalog_manager.cc:5697] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 12 to 13, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 13 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.852419 15642 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.853606 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.854636 15642 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.856995 20591 raft_consensus.cc:2804] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:19:11.857743 20625 leader_election.cc:290] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.857065 20605 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.859869 20605 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.860304 20605 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.861418 20591 raft_consensus.cc:697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 9 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:11.862500 20591 consensus_queue.cc:237] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:11.866034 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.867691 20646 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.868561 20646 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.868989 20646 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:11.873214 15640 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.873462 15714 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.875555 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:11.876394 20625 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:11.877925 15671 raft_consensus.cc:2468] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
W20260709 13:19:11.876559 15714 leader_election.cc:336] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.879164 15714 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.880623 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:19:11.882939 15714 leader_election.cc:336] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:11.883733 15714 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.879930 20605 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.885342 20625 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:19:11.890111 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.892763 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b872b4d6b684a548289e080316a1b94" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:11.910332 15744 raft_consensus.cc:3060] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.894455 15743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6388e92df0fa4fac9a75573887c28fd9" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:11.889601 15499 catalog_manager.cc:5697] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 11 to 12, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 12 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.893364 15747 raft_consensus.cc:2955] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:11.911072 15743 raft_consensus.cc:3060] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:11.900113 15671 raft_consensus.cc:1275] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:11.897588 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.917939 15743 raft_consensus.cc:2468] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 13.
I20260709 13:19:11.920208 20633 consensus_queue.cc:1048] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:19:11.920434 20629 raft_consensus.cc:2764] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:19:11.923558 20605 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.930526 15744 raft_consensus.cc:2468] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:19:11.933387 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.935777 20643 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.936224 20643 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
W20260709 13:19:11.936883 15640 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:11.936645 20643 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:19:11.944797 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:11.937696 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.954393 20646 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.957340 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.960279 20629 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:19:11.961654 20629 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.962342 20629 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.964998 20630 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.967315 20630 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.959354 20625 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:19:11.968940 20625 raft_consensus.cc:493] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.969336 20625 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:11.970100 20646 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:11.971411 20629 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.961508 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.976401 20643 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:11.978214 20654 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:11.978657 20654 raft_consensus.cc:493] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 558532223b984cf796cb6b98ddd6c9f2)
I20260709 13:19:11.979027 20654 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:11.979905 20643 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:11.977217 15714 leader_election.cc:304] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:11.993175 15748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "693cb838c6224bb88e8195042cafa653" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:11.995741 15642 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:11.995965 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e56a58686fa47d397c114454143e4c6" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:11.996865 15748 raft_consensus.cc:3060] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:19:11.997188 15676 raft_consensus.cc:3060] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:11.997411 15747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:11.999768 15747 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:11.999719 15744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:12.001448 15744 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7019261981c6431baddd6812c15ac678 in current term 10: Already voted for candidate 5433f0c9863e427d88ba5916819e28e3 in this term.
I20260709 13:19:12.003266 15642 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:12.003295 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:12.008172 15672 raft_consensus.cc:2393] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:12.006775 20605 raft_consensus.cc:2804] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:12.013960 16309 raft_consensus.cc:2955] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:11.997383 20643 raft_consensus.cc:2804] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:12.017110 20605 raft_consensus.cc:697] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:12.024806 15748 raft_consensus.cc:2468] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:19:12.008371 20639 raft_consensus.cc:2804] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.026744 20629 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:12.029593 15672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:12.030385 15672 raft_consensus.cc:2393] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5433f0c9863e427d88ba5916819e28e3 in current term 10: Already voted for candidate 7019261981c6431baddd6812c15ac678 in this term.
I20260709 13:19:12.031730 20639 raft_consensus.cc:697] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
W20260709 13:19:12.039009 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:12.046173 20645 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:12.050963 20639 consensus_queue.cc:237] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:12.045883 15640 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:12.054068 15640 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
W20260709 13:19:12.055132 15640 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:12.055564 15640 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 5433f0c9863e427d88ba5916819e28e3, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:12.056278 20557 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.056975 20557 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.031195 20605 consensus_queue.cc:237] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:12.045650 15714 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:12.063453 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.063926 15714 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:12.064700 15714 leader_election.cc:336] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:12.065292 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.065666 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.066023 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.067183 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.067602 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.068053 15714 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:12.068579 15714 leader_election.cc:336] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:12.069167 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.069494 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.070056 15714 leader_election.cc:336] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:12.070423 15676 raft_consensus.cc:2468] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:12.075501 20654 raft_consensus.cc:515] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:12.026070 20643 raft_consensus.cc:697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:12.077361 20643 consensus_queue.cc:237] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:12.081053 20625 raft_consensus.cc:515] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:12.083950 20625 leader_election.cc:290] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:12.093951 15676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81dbf9e63ec84d138474082a1d0293c0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:12.094798 15676 raft_consensus.cc:3060] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:19:12.096052 16299 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:12.102198 15714 leader_election.cc:304] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:12.106815 20629 raft_consensus.cc:2804] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:19:12.108150 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:12.110097 15676 raft_consensus.cc:2468] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 8.
I20260709 13:19:12.107370 20629 raft_consensus.cc:697] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:12.111366 15744 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:19:12.129050 15714 leader_election.cc:336] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:12.130383 15714 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:12.130944 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
W20260709 13:19:12.135064 15714 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:12.137286 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:12.137661 15642 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:12.139125 20292 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.142376 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75de3a46207e4bcfb457cdc43ffba2e2" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:12.143482 15671 raft_consensus.cc:3060] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:12.146018 15714 leader_election.cc:304] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:12.138254 20654 leader_election.cc:290] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:12.138264 20643 raft_consensus.cc:2749] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:19:12.145123 20557 raft_consensus.cc:2804] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:19:12.158565 20557 raft_consensus.cc:697] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:12.159592 20557 consensus_queue.cc:237] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
W20260709 13:19:12.160091 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.148118 20652 raft_consensus.cc:2804] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:19:12.161152 20652 raft_consensus.cc:697] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:12.162142 20652 consensus_queue.cc:237] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:12.155516 15671 raft_consensus.cc:2468] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:19:12.165242 20629 consensus_queue.cc:237] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:12.188169 15498 catalog_manager.cc:5697] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 12 to 13, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 13 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.194020 15498 catalog_manager.cc:5697] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 9 to 10, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:19:12.244096 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.263619 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.266762 15498 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: config changed from index 10 to 11, 398beb97ee4b40688f6279f18fa51ade (127.14.41.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } attrs { replace: true } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
W20260709 13:19:12.274544 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 125690us
W20260709 13:19:12.277595 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:12.277932 16299 raft_consensus.cc:1275] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:12.280534 20638 consensus_queue.cc:1048] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:12.282233 15671 raft_consensus.cc:1275] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:12.291296 15714 leader_election.cc:304] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:12.309767 20643 raft_consensus.cc:2804] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:12.309960 20292 consensus_queue.cc:1048] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:12.310669 20643 raft_consensus.cc:697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:12.311762 20643 consensus_queue.cc:237] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:12.319818 15747 raft_consensus.cc:1275] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Refusing update from remote peer 398beb97ee4b40688f6279f18fa51ade: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:19:12.323042 20674 consensus_queue.cc:1048] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:19:12.328383 15714 leader_election.cc:336] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:12.336367 15714 leader_election.cc:336] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:12.353551 15671 raft_consensus.cc:1275] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:19:12.357924 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:12.362308 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.362931 15498 catalog_manager.cc:5697] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 8 to 9, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 9 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.374549 15498 catalog_manager.cc:5697] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 12 to 13, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 13 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.370469 20679 consensus_queue.cc:1048] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:19:12.381724 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.382328 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.386940 15498 catalog_manager.cc:5697] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 9 to 10, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 10 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.397054 15498 catalog_manager.cc:5697] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 9 to 10, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 10 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:12.404817 14501 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15623)
I20260709 13:19:12.430939 15744 raft_consensus.cc:1275] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:19:12.432492 20557 consensus_queue.cc:1048] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:12.442509 15497 catalog_manager.cc:5697] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 11 to 12, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 12 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.444456 15497 catalog_manager.cc:5697] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 10 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 11 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.446485 15497 catalog_manager.cc:5697] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 7 to 8, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 8 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.488925 15671 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:12.490238 15497 catalog_manager.cc:5697] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 13 to 14, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 14 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.495723 16299 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:19:12.497394 15747 raft_consensus.cc:1275] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:19:12.502100 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.507777 20639 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:12.507526 15497 catalog_manager.cc:5697] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 11 to 12, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 12 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:12.509516 20639 consensus_queue.cc:1048] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:12.539598 20641 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:12.552440 15672 raft_consensus.cc:1275] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:19:12.555557 16299 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:12.581172 15744 raft_consensus.cc:1275] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:19:12.608659 20652 consensus_queue.cc:1048] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:12.621330 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.628985 20639 consensus_queue.cc:1048] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:19:12.651450 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bda38eb6cdcc4738a2dc39a9bec091f0 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:12.667554 15744 raft_consensus.cc:1275] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:19:12.668249 15748 raft_consensus.cc:2955] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Committing config change with OpId 12.12: config changed from index 11 to 12, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:12.680138 15498 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 11 to 12, VOTER 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) evicted. New cstate: current_term: 12 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:12.747696 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 46060.5us
I20260709 13:19:12.749799 20668 consensus_queue.cc:1048] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 13:19:12.754632 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.767477 15671 raft_consensus.cc:1275] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:19:12.776978 15748 raft_consensus.cc:1275] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:19:12.801736 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.806360 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.816720 20591 consensus_queue.cc:1048] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:19:12.819305 15671 raft_consensus.cc:1275] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:12.825032 20688 consensus_queue.cc:1048] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:19:12.833135 20292 consensus_queue.cc:1048] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:19:12.834622 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:12.835304 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.885511 15676 raft_consensus.cc:1275] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:19:12.876417 15484 catalog_manager.cc:4755] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bda38eb6cdcc4738a2dc39a9bec091f0: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:12.894228 20652 consensus_queue.cc:1048] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:19:13.406049 14501 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15623)
I20260709 13:19:13.471058 15671 consensus_queue.cc:237] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:13.535676 16299 raft_consensus.cc:1275] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:19:13.539983 20591 consensus_queue.cc:1048] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:19:13.550973 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.573483 20591 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 3 to 10, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:13.582230 16299 raft_consensus.cc:2955] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 3 to 10, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } } }
I20260709 13:19:13.608537 15484 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 86c5f054f586412fbd8a416245340d63 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
W20260709 13:19:13.614571 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:13.625077 15498 catalog_manager.cc:5697] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 reported cstate change: config changed from index 3 to 10, VOTER 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67) evicted. New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:13.641845 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.654266 20700 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.654879 20700 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:13.657048 20700 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:13.661684 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678" is_pre_election: true
I20260709 13:19:13.662461 15671 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:19:13.664574 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:13.669797 20679 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:19:13.669966 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.670271 20679 raft_consensus.cc:493] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.670632 20679 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:13.676980 15714 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:13.680423 20679 raft_consensus.cc:515] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:13.682852 20679 leader_election.cc:290] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:13.692364 15671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c670aee4b042d2aa73b9c2ec68245f" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7019261981c6431baddd6812c15ac678"
I20260709 13:19:13.693077 15671 raft_consensus.cc:3060] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:13.698762 15714 leader_election.cc:336] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:13.708066 15671 raft_consensus.cc:2468] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:13.713130 15714 leader_election.cc:304] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:13.717278 20591 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.717828 20591 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:13.717051 20679 raft_consensus.cc:2804] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:13.718816 20679 raft_consensus.cc:697] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:13.721889 20591 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:13.722932 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:13.723652 15750 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 10.
I20260709 13:19:13.719831 20679 consensus_queue.cc:237] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:13.727917 15642 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 
I20260709 13:19:13.728847 20591 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:13.729300 20591 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.729679 20591 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:13.731444 15640 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:13.744729 20591 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:13.761840 20591 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Requested vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:13.766969 15750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2d6a74c6b234911b02521773c4fdddf" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:13.767632 15750 raft_consensus.cc:3060] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:13.786088 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.789693 15497 catalog_manager.cc:5697] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 9 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 11 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.789036 15750 raft_consensus.cc:2468] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7019261981c6431baddd6812c15ac678 in term 11.
W20260709 13:19:13.800395 15640 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:13.800767 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.805414 15642 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678; no voters: 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:13.806561 20591 raft_consensus.cc:2804] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:13.807623 20591 raft_consensus.cc:697] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Becoming Leader. State: Replica: 7019261981c6431baddd6812c15ac678, State: Running, Role: LEADER
I20260709 13:19:13.808391 20591 consensus_queue.cc:237] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:13.807307 15741 tablet_service.cc:1558] Processing DeleteTablet for tablet 86c5f054f586412fbd8a416245340d63 with delete_type TABLET_DATA_TOMBSTONED (TS 5433f0c9863e427d88ba5916819e28e3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48722
I20260709 13:19:13.872131 20707 tablet_replica.cc:333] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:13.873171 20707 raft_consensus.cc:2243] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:13.873875 20707 raft_consensus.cc:2272] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:13.876278 20707 ts_tablet_manager.cc:1916] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:19:13.891256 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:13.892352 15496 catalog_manager.cc:5697] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 reported cstate change: term changed from 9 to 11, leader changed from 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65) to 7019261981c6431baddd6812c15ac678 (127.14.41.66). New cstate: current_term: 11 leader_uuid: "7019261981c6431baddd6812c15ac678" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.937608 20707 ts_tablet_manager.cc:1929] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:19:13.938153 20707 log.cc:1199] T 86c5f054f586412fbd8a416245340d63 P 5433f0c9863e427d88ba5916819e28e3: Deleting WAL directory at /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/wals/86c5f054f586412fbd8a416245340d63
I20260709 13:19:13.940236 15486 catalog_manager.cc:5028] TS 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): tablet 86c5f054f586412fbd8a416245340d63 (table test-workload [id=0625606dfaef40a6bf7ebf24d8657cd1]) successfully deleted
W20260709 13:19:13.959547 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:13.996800 15714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111) [suppressed 421 similar messages]
W20260709 13:19:14.060098 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.117090 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.142704 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.143246 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.153790 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.184903 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.234704 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.238300 15484 catalog_manager.cc:4755] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bda38eb6cdcc4738a2dc39a9bec091f0: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:14.243444 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.251942 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.262305 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.271883 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.293061 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.293159 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:14.299741 15672 raft_consensus.cc:1275] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:19:14.307659 20652 consensus_queue.cc:1048] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:19:14.334199 15747 raft_consensus.cc:1275] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Refusing update from remote peer 7019261981c6431baddd6812c15ac678: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:19:14.355600 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.381212 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:14.389042 20639 consensus_queue.cc:1048] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:19:14.394140 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.406540 14501 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:14.424700 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.454339 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.504859 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.520346 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:14.529229 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.553522 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:14.563321 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.577741 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.715330 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.764765 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:14.782909 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.810343 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:14.824548 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:14.828884 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:14.958564 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.093674 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 84412.9us
W20260709 13:19:15.167917 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.180968 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.186913 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.208109 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.247682 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.259097 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.320508 15484 catalog_manager.cc:4755] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bda38eb6cdcc4738a2dc39a9bec091f0: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:15.407028 14501 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:15.475629 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:15.557952 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 43867us
W20260709 13:19:15.897290 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:16.207221 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.222910 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 88575.2us
W20260709 13:19:16.227250 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.244647 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.245800 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.283787 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 135908us
W20260709 13:19:16.289482 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.324433 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.407718 14501 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:16.464181 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.490721 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.493500 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.581452 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.602540 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:16.673848 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.693457 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.747956 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.794709 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.799695 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.830814 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.849146 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.885299 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.898854 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.902526 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.936331 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.944154 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.963274 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:16.981508 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.000238 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.023109 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:17.068833 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.145949 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.157683 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.169457 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.226493 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.237021 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.317976 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.408262 14501 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:17.421450 15484 catalog_manager.cc:4755] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bda38eb6cdcc4738a2dc39a9bec091f0: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:17.492662 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.495659 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.624138 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.640856 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.698143 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:17.749835 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.882766 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.936651 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:17.974674 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:18.129629 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:18.143335 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:18.363745 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:18.409317 14501 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:18.576165 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.608378 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.627168 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:18.687642 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.766036 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.823199 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.875102 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:18.885000 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.003422 15640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111) [suppressed 454 similar messages]
W20260709 13:19:19.027980 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:19.056799 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 50080.2us
W20260709 13:19:19.106168 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.155781 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.177774 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.203787 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.215480 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.219826 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.239985 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.278411 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.329816 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.331462 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.349115 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.290194 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.352984 15640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 62835.4us
W20260709 13:19:19.361732 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:19.409843 14501 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:19.443773 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.449913 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.499662 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.556731 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:19.558235 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:19.576171 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.621681 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.672938 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.732086 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:19.750595 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.861696 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 47941.8us
W20260709 13:19:19.902276 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:19.937561 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.093787 15642 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 57330.5us
W20260709 13:19:20.127807 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.198189 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.233315 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.236903 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.315503 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.316126 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.406617 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.411096 14501 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:20.474268 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.633172 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.640556 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.652343 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:20.712620 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:20.734341 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:20.983589 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:21.095911 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.225283 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:21.242455 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.290060 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.372926 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.412875 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.420955 14501 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:21.461287 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.534760 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.603309 15484 catalog_manager.cc:4755] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bda38eb6cdcc4738a2dc39a9bec091f0: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:21.610345 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.623489 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.741093 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.877255 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:21.941895 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:21.978008 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:22.007347 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.040632 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.093336 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.098595 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.119864 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.123667 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:22.127609 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.218925 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.266386 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.302260 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:22.422561 14501 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:22.551021 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:22.579757 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.582410 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.594923 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.596978 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.614465 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.620352 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.802101 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.804195 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:22.833945 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.903653 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:22.965463 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:22.980644 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:23.011001 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:23.078825 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.379410 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:23.380167 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:23.419684 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:23.423591 14501 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:23.432487 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.745100 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:23.791743 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.832703 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.931702 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:23.943650 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:23.972514 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:23.987560 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.006444 15640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111) [suppressed 445 similar messages]
W20260709 13:19:24.106047 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:24.143626 15531 debug-util.cc:398] Leaking SignalData structure 0x7b08000f3140 after lost signal to thread 14504
W20260709 13:19:24.144964 15531 debug-util.cc:398] Leaking SignalData structure 0x7b0800179f00 after lost signal to thread 15534
W20260709 13:19:24.146426 15531 debug-util.cc:398] Leaking SignalData structure 0x7b080008aba0 after lost signal to thread 15701
W20260709 13:19:24.152643 15531 debug-util.cc:398] Leaking SignalData structure 0x7b08000675e0 after lost signal to thread 15775
W20260709 13:19:24.155529 15531 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3f20 after lost signal to thread 16334
W20260709 13:19:24.324453 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.332644 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.340762 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:24.378206 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.385561 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.392313 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.406589 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.428789 14501 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:24.452062 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:24.501462 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:24.593034 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.594524 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.621520 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.624792 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.650545 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.696882 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 46362.4us
W20260709 13:19:24.739470 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.739962 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:24.740844 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 79891.5us
W20260709 13:19:24.748930 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:24.800784 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 48825.3us
W20260709 13:19:24.842273 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:24.931421 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.008458 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.126700 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:25.144456 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.218588 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:25.251518 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:25.430275 14501 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:25.650650 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:25.844039 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:25.875407 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.881644 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.882473 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.883113 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.883606 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.886233 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.887148 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:25.968967 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.004909 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:26.062296 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:26.163864 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:26.244947 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.430917 14501 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:26.468822 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.570955 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.574545 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:26.690805 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:26.713106 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.747201 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:26.821102 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:26.859346 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.870061 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:26.876891 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.889104 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.902525 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.908008 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:26.924474 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.969580 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:26.972254 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.126813 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.188202 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:27.210474 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.224973 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.232280 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.244794 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.270906 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.299865 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.406203 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.424700 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.431497 14501 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:27.469755 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:27.546624 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.644424 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:27.768347 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:27.818413 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:27.861188 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.115638 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:28.432054 14501 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:28.821233 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.822778 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.823958 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.825703 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.834858 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:28.836977 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:28.885733 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 82405.7us
W20260709 13:19:28.912009 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:28.913103 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:28.914470 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:28.923774 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.103753 15640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111) [suppressed 394 similar messages]
W20260709 13:19:29.127862 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:29.158648 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:29.167886 15698 debug-util.cc:398] Leaking SignalData structure 0x7b080010e8c0 after lost signal to thread 14504
W20260709 13:19:29.169126 15698 debug-util.cc:398] Leaking SignalData structure 0x7b0800385940 after lost signal to thread 15534
W20260709 13:19:29.170493 15698 debug-util.cc:398] Leaking SignalData structure 0x7b080022e260 after lost signal to thread 15701
W20260709 13:19:29.171674 15698 debug-util.cc:398] Leaking SignalData structure 0x7b08003573e0 after lost signal to thread 15775
W20260709 13:19:29.172451 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.174489 15698 debug-util.cc:398] Leaking SignalData structure 0x7b08002cce80 after lost signal to thread 16334
W20260709 13:19:29.199014 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:29.241278 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:29.276212 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:29.329768 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.432686 14501 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:29.548058 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:29.578626 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.632325 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.632771 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:29.658368 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.776569 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.777098 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.818276 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.844201 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:29.859704 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.861460 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:29.883046 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.891321 15716 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:46739, user_credentials={real_user=slave}} blocked reactor thread for 49724.2us
W20260709 13:19:29.907135 15484 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 49949us
W20260709 13:19:29.909662 15484 catalog_manager.cc:4755] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bda38eb6cdcc4738a2dc39a9bec091f0: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:29.927311 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.944631 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:29.950297 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.084474 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:30.117154 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.121381 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.250102 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.257892 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.295671 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:30.364571 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.367345 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.433200 14501 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:30.499648 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.611647 16265 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:40623, user_credentials={real_user=slave}} blocked reactor thread for 73029.3us
W20260709 13:19:30.809490 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.817926 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:30.818228 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:30.821678 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:30.821674 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.150223 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.189142 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:31.205777 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.217454 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.226011 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.271015 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:31.303090 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:31.402312 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:31.433691 14501 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:31.436357 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.487069 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:31.492812 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.604707 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.652375 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.803176 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:31.820473 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.843387 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.847084 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:31.891103 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.902899 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:31.965031 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.041102 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.081108 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:32.086645 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:32.172519 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.219568 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.228837 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.235292 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.393524 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.401399 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.434616 14501 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:32.457295 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:32.464445 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:32.489540 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.514954 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.527603 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:32.550817 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.572165 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:32.833927 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:32.935369 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:32.972669 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:32.989329 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.017843 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:33.134943 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.205212 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.209718 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.362834 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.435158 14501 thread.cc:527] Waited for 23000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:33.459383 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:33.664707 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.690449 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:33.770210 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:33.797183 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.814656 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:33.837464 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.865485 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:33.898646 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:33.922334 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:34.021106 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:34.029549 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.046977 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:34.082261 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:34.084713 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.135495 16263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111) [suppressed 470 similar messages]
W20260709 13:19:34.369257 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:34.435742 14501 thread.cc:527] Waited for 24000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:34.577741 16263 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 51032us
W20260709 13:19:34.585654 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:34.614002 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.652752 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:33941, user_credentials={real_user=slave}} blocked reactor thread for 52629us
W20260709 13:19:34.669629 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:34.686666 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.722119 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.753791 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.767071 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.768110 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.825678 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:34.878415 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:34.935359 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:34.954577 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:34.980015 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.033845 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:35.042327 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.048588 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:35.078536 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.123907 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.186017 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.237824 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.436671 14501 thread.cc:527] Waited for 25000ms trying to join with diag-logger (tid 15623)
W20260709 13:19:35.466040 16331 debug-util.cc:398] Leaking SignalData structure 0x7b08002e88c0 after lost signal to thread 14504
W20260709 13:19:35.467200 16331 debug-util.cc:398] Leaking SignalData structure 0x7b08003af2e0 after lost signal to thread 15534
W20260709 13:19:35.468585 16331 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac3a0 after lost signal to thread 15701
W20260709 13:19:35.469813 16331 debug-util.cc:398] Leaking SignalData structure 0x7b080036d1a0 after lost signal to thread 15775
W20260709 13:19:35.471122 16331 debug-util.cc:398] Leaking SignalData structure 0x7b0800360120 after lost signal to thread 16334
W20260709 13:19:35.494969 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:35.518392 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.694494 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.758534 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:35.828336 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.836366 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:35.922886 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:35.944914 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:36.001216 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.163187 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.205708 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.256961 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.257583 15640 consensus_peers.cc:597] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.455287 15640 consensus_peers.cc:597] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.870894 15640 consensus_peers.cc:597] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.874863 15640 consensus_peers.cc:597] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:36.875537 15640 consensus_peers.cc:597] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:36.876116 15640 consensus_peers.cc:597] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.876559 15640 consensus_peers.cc:597] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:36.877266 15640 consensus_peers.cc:597] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:36.904953 15717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.012s	sys 0.021s
W20260709 13:19:36.905403 15717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.012s	sys 0.021s
W20260709 13:19:36.952473 15640 consensus_peers.cc:597] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:36.972769 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 76917.5us
W20260709 13:19:37.078096 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.083612 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.084385 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.198144 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:37.263331 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:37.283025 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.298861 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:37.314667 15640 consensus_peers.cc:597] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:37.386701 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.401934 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.416325 15640 consensus_peers.cc:597] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.420570 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.432715 15640 consensus_peers.cc:597] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:19:37.447825 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
W20260709 13:19:37.456825 15698 debug-util.cc:398] Leaking SignalData structure 0x7b0800037620 after lost signal to thread 14504
W20260709 13:19:37.458386 15698 debug-util.cc:398] Leaking SignalData structure 0x7b0800110020 after lost signal to thread 15534
W20260709 13:19:37.460232 15698 debug-util.cc:398] Leaking SignalData structure 0x7b0800385980 after lost signal to thread 15701
W20260709 13:19:37.461625 15698 debug-util.cc:398] Leaking SignalData structure 0x7b08000fcf60 after lost signal to thread 15775
W20260709 13:19:37.463299 15698 debug-util.cc:398] Leaking SignalData structure 0x7b08001f27e0 after lost signal to thread 16334
W20260709 13:19:37.465189 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:37.465720 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.633354 15640 consensus_peers.cc:597] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:37.697371 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.719414 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:37.735293 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
W20260709 13:19:37.760949 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.773821 15714 consensus_peers.cc:597] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.780458 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.817224 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.838613 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.843997 16263 consensus_peers.cc:597] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.848913 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.851974 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:37.869385 15640 consensus_peers.cc:597] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.873345 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:37.887049 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.898092 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.907238 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.918027 16263 consensus_peers.cc:597] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.918828 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.919519 16263 consensus_peers.cc:597] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.923799 16263 consensus_peers.cc:597] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.941040 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:37.955412 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:19:37.965349 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:37.967628 16263 consensus_peers.cc:597] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:37.958326 14501 tablet_replica.cc:333] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:37.975126 14501 raft_consensus.cc:2243] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:37.978883 14501 raft_consensus.cc:2272] T 522c09add06b4e6c8c43c06c082d1e17 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:37.986099 14501 tablet_replica.cc:333] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678: stopping tablet replica
W20260709 13:19:37.995363 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.007328 14501 raft_consensus.cc:2243] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:38.016039 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.004889 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:38.017055 15714 consensus_peers.cc:597] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.021217 14501 raft_consensus.cc:2272] T 6fc66402c5e04df38b56e6d8d4d7731d P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.026032 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.026765 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.032761 14501 tablet_replica.cc:333] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.033849 14501 raft_consensus.cc:2243] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.034480 14501 raft_consensus.cc:2272] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.032768 16263 consensus_peers.cc:597] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.037938 14501 tablet_replica.cc:333] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.063813 14501 raft_consensus.cc:2243] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.065925 14501 raft_consensus.cc:2272] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.049803 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.080745 14501 tablet_replica.cc:333] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.081838 14501 raft_consensus.cc:2243] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.087626 14501 raft_consensus.cc:2272] T e303011bed72412ab6f5eebf5a6de748 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.093930 14501 tablet_replica.cc:333] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
W20260709 13:19:38.099534 15714 consensus_peers.cc:597] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:38.101399 14501 raft_consensus.cc:2243] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.109748 14501 raft_consensus.cc:2272] T 651bfd4950ab4835b117f7364ee51b09 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.116201 14501 tablet_replica.cc:333] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.117859 14501 raft_consensus.cc:2243] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.126036 14501 raft_consensus.cc:2272] T 5fd98191b2d04d05b9a41afba67ac044 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.135360 14501 tablet_replica.cc:333] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.136405 14501 raft_consensus.cc:2243] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.137666 14501 raft_consensus.cc:2272] T c9e5693d3c474948b687ba64b0b31215 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.147639 14501 tablet_replica.cc:333] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.153159 14501 raft_consensus.cc:2243] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:38.161638 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.162789 14501 raft_consensus.cc:2272] T 2e56a58686fa47d397c114454143e4c6 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.171343 14501 tablet_replica.cc:333] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.185281 14501 raft_consensus.cc:2243] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:38.186206 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:38.187220 14501 raft_consensus.cc:2272] T 581e4945d85a47ba97ce48f4027aeade P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.211997 14501 tablet_replica.cc:333] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.213922 14501 raft_consensus.cc:2243] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.215224 14501 raft_consensus.cc:2272] T ac51ecd2367a45e8a32a6a911f34a9c2 P 7019261981c6431baddd6812c15ac678 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.222288 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.244022 15714 consensus_peers.cc:597] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:38.252159 15714 consensus_peers.cc:597] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:38.269275 14501 tablet_replica.cc:333] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.270363 14501 raft_consensus.cc:2243] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.308169 14501 raft_consensus.cc:2272] T 29bae97aafa2447892a23984cd26cd90 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.314297 14501 tablet_replica.cc:333] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
W20260709 13:19:38.406453 15640 consensus_peers.cc:597] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:38.408094 14501 raft_consensus.cc:2243] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.416163 14501 raft_consensus.cc:2272] T 6556ac1ec52640c3bad0bf13607c8d19 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.419435 14501 tablet_replica.cc:333] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
W20260709 13:19:38.438851 15640 consensus_peers.cc:597] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:38.420378 14501 raft_consensus.cc:2243] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.441601 14501 raft_consensus.cc:2272] T eaaf7f7575314c29a12eedde1fe321a7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.453850 14501 tablet_replica.cc:333] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.472103 14501 raft_consensus.cc:2243] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.473500 14501 raft_consensus.cc:2272] T 958e81841a784ee79fccc9f488562c59 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.467419 15640 consensus_peers.cc:597] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:38.470929 15714 consensus_peers.cc:597] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:38.480166 14501 tablet_replica.cc:333] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.486591 14501 raft_consensus.cc:2243] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.487504 14501 raft_consensus.cc:2272] T b42c9970a1a64670ba11510d9c0c1809 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.490983 14501 tablet_replica.cc:333] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.491900 14501 raft_consensus.cc:2243] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.497960 14501 raft_consensus.cc:2272] T b171707a6f8e44b7a4f81ef5fbf30230 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.510331 14501 tablet_replica.cc:333] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.511336 14501 raft_consensus.cc:2243] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.513559 14501 raft_consensus.cc:2272] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 7019261981c6431baddd6812c15ac678 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.517859 14501 tablet_replica.cc:333] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.518813 14501 raft_consensus.cc:2243] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.519686 14501 raft_consensus.cc:2272] T bbc6f003381b434b92d3b262155935c7 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.518806 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:19:38.535879 14501 tablet_replica.cc:333] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.537026 14501 raft_consensus.cc:2243] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.537739 14501 raft_consensus.cc:2272] T 32d6629b913f439393c69fd7e6b8a55d P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.541472 14501 tablet_replica.cc:333] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.549026 14501 raft_consensus.cc:2243] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.551676 14501 raft_consensus.cc:2272] T ea2d5bac8fb54783a1f420061d08067f P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.568833 14501 tablet_replica.cc:333] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.569799 14501 raft_consensus.cc:2243] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.571137 14501 raft_consensus.cc:2272] T 693cb838c6224bb88e8195042cafa653 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.574651 14501 tablet_replica.cc:333] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.587139 14501 raft_consensus.cc:2243] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.587841 14501 raft_consensus.cc:2272] T 97765616b2ca49eca1b5b2c90a10c9a3 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.590639 14501 tablet_replica.cc:333] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.591532 14501 raft_consensus.cc:2243] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.592618 14501 raft_consensus.cc:2272] T f95117d3c05146d9a1c2b5c9158dc457 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.598768 15714 consensus_peers.cc:597] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:38.601799 14501 tablet_replica.cc:333] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.644738 14501 raft_consensus.cc:2243] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.647320 14501 raft_consensus.cc:2272] T e1e65bafed7145eb85b802c6c68a9129 P 7019261981c6431baddd6812c15ac678 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.653779 14501 tablet_replica.cc:333] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.655019 14501 raft_consensus.cc:2243] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.666304 14501 raft_consensus.cc:2272] T dbde144556724eb39acadbe99d8a1de3 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.671033 14501 tablet_replica.cc:333] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.673461 14501 raft_consensus.cc:2243] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.674880 14501 raft_consensus.cc:2272] T bda38eb6cdcc4738a2dc39a9bec091f0 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.688871 14501 tablet_replica.cc:333] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.689872 14501 raft_consensus.cc:2243] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.691157 14501 raft_consensus.cc:2272] T 7b872b4d6b684a548289e080316a1b94 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.693377 14501 tablet_replica.cc:333] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.694015 14501 raft_consensus.cc:2243] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.694959 14501 raft_consensus.cc:2272] T 9b90fe6b2a274b68b50cf564b626c03e P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.697412 14501 tablet_replica.cc:333] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.699474 14501 raft_consensus.cc:2243] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.700191 14501 raft_consensus.cc:2272] T 81dbf9e63ec84d138474082a1d0293c0 P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.703034 14501 tablet_replica.cc:333] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.703917 14501 raft_consensus.cc:2243] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.705394 14501 raft_consensus.cc:2272] T 86c5f054f586412fbd8a416245340d63 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.708865 14501 tablet_replica.cc:333] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.709856 14501 raft_consensus.cc:2243] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.710733 14501 raft_consensus.cc:2272] T 06c670aee4b042d2aa73b9c2ec68245f P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.714227 14501 tablet_replica.cc:333] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.716002 14501 raft_consensus.cc:2243] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.717339 14501 raft_consensus.cc:2272] T f2d6a74c6b234911b02521773c4fdddf P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.721058 14501 tablet_replica.cc:333] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.721915 14501 raft_consensus.cc:2243] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.722748 14501 raft_consensus.cc:2272] T 75de3a46207e4bcfb457cdc43ffba2e2 P 7019261981c6431baddd6812c15ac678 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.725805 14501 tablet_replica.cc:333] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.726514 14501 raft_consensus.cc:2243] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.727814 14501 raft_consensus.cc:2272] T 6388e92df0fa4fac9a75573887c28fd9 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.730528 14501 tablet_replica.cc:333] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.731307 14501 raft_consensus.cc:2243] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.731920 14501 raft_consensus.cc:2272] T f900b71a39b14f0e92515320b011e9a1 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.735673 14501 tablet_replica.cc:333] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.746461 14501 raft_consensus.cc:2243] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.748327 14501 raft_consensus.cc:2272] T bea9d89f73eb4c36b8a8270cda937174 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.755795 14501 tablet_replica.cc:333] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.756707 14501 raft_consensus.cc:2243] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.757848 14501 raft_consensus.cc:2272] T 9fa9cf9412ae412a8756d1fc1138ddce P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.760910 14501 tablet_replica.cc:333] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.761686 14501 raft_consensus.cc:2243] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.763266 14501 raft_consensus.cc:2272] T 9dc37ba667f048359988247ddb2d7f5b P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.766242 14501 tablet_replica.cc:333] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.767082 14501 raft_consensus.cc:2243] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.768404 14501 raft_consensus.cc:2272] T e80fb58800714a47b47ac1e701a9400f P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.771495 14501 tablet_replica.cc:333] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.772348 14501 raft_consensus.cc:2243] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.773331 14501 raft_consensus.cc:2272] T f6a774e81f58442c90fd80ad59687b99 P 7019261981c6431baddd6812c15ac678 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.779569 14501 tablet_replica.cc:333] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.780489 14501 raft_consensus.cc:2243] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.781819 14501 raft_consensus.cc:2272] T 1ee7f36a2ae4477291b5b34ce26ac07c P 7019261981c6431baddd6812c15ac678 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.782685 20867 raft_consensus.cc:493] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 398beb97ee4b40688f6279f18fa51ade)
I20260709 13:19:38.783349 20867 raft_consensus.cc:515] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:38.785435 14501 tablet_replica.cc:333] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.786373 14501 raft_consensus.cc:2243] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.787253 14501 raft_consensus.cc:2272] T 43658563a58a42e3b9a3da86a87a9c02 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.790316 14501 tablet_replica.cc:333] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.791230 14501 raft_consensus.cc:2243] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.791479 20867 leader_election.cc:290] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:38.795876 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:38.796861 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "889d20b228a74f7abdc0104e2529c28d" candidate_uuid: "7019261981c6431baddd6812c15ac678" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:38.802778 15642 leader_election.cc:304] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7019261981c6431baddd6812c15ac678; no voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3
I20260709 13:19:38.804459 20867 raft_consensus.cc:2749] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:38.792480 14501 raft_consensus.cc:2272] T 16817d3f588f45019ebd19d0c1915814 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.812736 14501 tablet_replica.cc:333] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.813578 14501 raft_consensus.cc:2243] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:38.814620 14501 raft_consensus.cc:2272] T 95f2c1f9b34a4914bc89224fb8100cd5 P 7019261981c6431baddd6812c15ac678 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.818214 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:38.818902 14501 tablet_replica.cc:333] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.822579 14501 raft_consensus.cc:2243] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:38.831275 14501 raft_consensus.cc:2272] T 90bff7f9147743b39de29e593c7a83b1 P 7019261981c6431baddd6812c15ac678 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:38.834769 14501 tablet_replica.cc:333] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678: stopping tablet replica
I20260709 13:19:38.835742 14501 raft_consensus.cc:2243] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:38.839536 15714 consensus_peers.cc:597] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:38.839931 14501 raft_consensus.cc:2272] T 889d20b228a74f7abdc0104e2529c28d P 7019261981c6431baddd6812c15ac678 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:38.847324 15714 consensus_peers.cc:597] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:39.081053 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:39.095402 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:39.148692 15714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111) [suppressed 482 similar messages]
I20260709 13:19:39.308528 20870 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.309229 20870 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.319824 20870 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:39.328017 20870 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.328744 20870 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.335902 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
W20260709 13:19:39.337976 16263 leader_election.cc:336] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:39.338832 16263 leader_election.cc:336] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.339314 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.340224 20878 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:39.335992 20870 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:19:39.344420 16263 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.344946 16263 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.345755 20878 raft_consensus.cc:2749] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:39.395604 16263 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:39.418206 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:19:39.420445 20848 raft_consensus.cc:493] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.421097 20848 raft_consensus.cc:515] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:39.423264 20848 leader_election.cc:290] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:39.433463 15714 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:39.435603 15714 leader_election.cc:336] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:39.436149 15714 leader_election.cc:304] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.438010 20848 raft_consensus.cc:2749] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:19:39.549005 20863 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.549539 20863 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.554867 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:19:39.559880 15714 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:39.560369 15714 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 558532223b984cf796cb6b98ddd6c9f2
I20260709 13:19:39.562115 20848 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.562829 20882 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:39.562840 20848 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.565771 20848 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:39.568205 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:39.569216 16305 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 10.
I20260709 13:19:39.571650 15716 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:39.574195 20882 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:19:39.562083 20863 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:39.574636 20882 raft_consensus.cc:493] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.576927 20882 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:19:39.626381 20848 raft_consensus.cc:493] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.627085 20848 raft_consensus.cc:515] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:39.629338 20848 leader_election.cc:290] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:39.642024 16263 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:19:39.612407 20882 raft_consensus.cc:515] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.647572 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cee88791b35487fb5b26c8d3d7ee6c8" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:39.648423 16305 raft_consensus.cc:3060] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:19:39.659727 15714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:33667, user_credentials={real_user=slave}} blocked reactor thread for 99868.2us
W20260709 13:19:39.660732 15714 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:39.669734 16263 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:19:39.670538 16305 raft_consensus.cc:2468] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 11.
I20260709 13:19:39.671175 20882 leader_election.cc:290] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:39.672086 15716 leader_election.cc:304] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:39.674273 20863 raft_consensus.cc:2804] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:19:39.675172 20863 raft_consensus.cc:697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:39.676470 20863 consensus_queue.cc:237] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:39.692257 15714 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:39.693475 15714 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:39.694155 15714 leader_election.cc:336] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:39.696964 15714 leader_election.cc:336] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:39.697450 15714 leader_election.cc:304] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.698421 20883 raft_consensus.cc:2749] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:39.700912 20870 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.701465 20870 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.703459 20870 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:39.713359 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:39.714401 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.714886 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.715617 20870 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.726046 15496 catalog_manager.cc:5697] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 10 to 11, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 11 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:39.777962 20870 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.778613 20870 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.781020 20870 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:39.780396 20863 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.782011 20863 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.784919 20863 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:39.786094 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:19:39.787931 16263 leader_election.cc:336] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:39.788713 16263 leader_election.cc:336] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.789168 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.790388 20870 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:39.790921 15714 leader_election.cc:336] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.791388 15714 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.793429 20863 raft_consensus.cc:2749] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:39.798496 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:39.812769 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:39.817346 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:39.832183 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:39.853303 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:39.882094 16263 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:39.892203 20878 raft_consensus.cc:493] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.892905 20878 raft_consensus.cc:515] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } attrs { replace: true } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.895856 20878 leader_election.cc:290] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:39.897117 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1301eda70cfb4417abc2a2d90b4bf0e8" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:39.897858 15746 raft_consensus.cc:2468] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 14.
I20260709 13:19:39.904227 20878 raft_consensus.cc:493] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.904999 20878 raft_consensus.cc:515] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.908476 20878 leader_election.cc:290] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:39.912976 16263 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:39.914137 16263 leader_election.cc:336] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.914654 16263 leader_election.cc:304] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.916345 20870 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.918249 20870 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.921682 20870 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:39.921921 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:39.922410 20870 raft_consensus.cc:2749] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:39.922602 15746 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:19:39.924111 16265 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:39.925045 20878 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:39.925467 20878 raft_consensus.cc:493] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.925940 20878 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.933418 20883 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.934058 20883 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:39.936470 20883 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
I20260709 13:19:39.937906 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
W20260709 13:19:39.945246 16263 leader_election.cc:336] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:39.948661 20889 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:39.949406 20889 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:39.950300 16263 leader_election.cc:336] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.950879 16263 leader_election.cc:304] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.951709 20870 raft_consensus.cc:2749] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.953419 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:39.952256 20889 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:19:39.966910 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:19:39.970230 20878 raft_consensus.cc:515] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:39.968362 15714 leader_election.cc:336] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.972823 15714 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 398beb97ee4b40688f6279f18fa51ade, 7019261981c6431baddd6812c15ac678
W20260709 13:19:39.971549 16263 leader_election.cc:336] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.973698 20863 raft_consensus.cc:2749] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:39.977344 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda38eb6cdcc4738a2dc39a9bec091f0" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:39.977965 15746 raft_consensus.cc:3060] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:39.979436 20878 leader_election.cc:290] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
W20260709 13:19:39.981809 16263 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.982241 16263 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:39.983956 20878 raft_consensus.cc:2749] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:39.991508 16263 leader_election.cc:336] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:39.985952 15746 raft_consensus.cc:2468] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 13.
W20260709 13:19:40.002202 15714 consensus_peers.cc:597] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:19:40.003693 16265 leader_election.cc:304] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.004573 20889 raft_consensus.cc:2804] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:40.005252 20889 raft_consensus.cc:697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:40.008371 20878 raft_consensus.cc:493] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.009124 20889 consensus_queue.cc:237] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.011986 20878 raft_consensus.cc:515] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.015724 20878 leader_election.cc:290] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:40.027395 20889 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.028111 20889 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.030537 20889 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.045217 16263 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.045464 15496 catalog_manager.cc:5697] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 12 to 13, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 13 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:40.048293 16263 consensus_peers.cc:597] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.048908 16263 leader_election.cc:336] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.049400 16263 leader_election.cc:304] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.050218 20878 raft_consensus.cc:2749] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.050427 20863 raft_consensus.cc:493] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.051060 20863 raft_consensus.cc:515] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:40.053459 20863 leader_election.cc:290] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.057394 16263 leader_election.cc:336] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.065387 20883 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.066002 20883 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.066921 20882 raft_consensus.cc:493] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.067514 20882 raft_consensus.cc:515] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:40.068380 20883 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:40.071475 16263 leader_election.cc:336] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.071658 20882 leader_election.cc:290] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:40.072417 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.073302 20878 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:40.075542 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade" is_pre_election: true
I20260709 13:19:40.076233 16305 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 12.
I20260709 13:19:40.077500 15716 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:40.078821 20883 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:19:40.081314 20883 raft_consensus.cc:493] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.081883 20883 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:19:40.095422 15714 leader_election.cc:336] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.097893 20883 raft_consensus.cc:515] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.102077 16305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b90fe6b2a274b68b50cf564b626c03e" candidate_uuid: "5433f0c9863e427d88ba5916819e28e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "398beb97ee4b40688f6279f18fa51ade"
I20260709 13:19:40.102715 16305 raft_consensus.cc:3060] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:19:40.103089 20883 leader_election.cc:290] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 398beb97ee4b40688f6279f18fa51ade (127.14.41.68:46739)
W20260709 13:19:40.103273 15714 leader_election.cc:336] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.103806 15714 leader_election.cc:304] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.104565 20883 raft_consensus.cc:2749] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.109992 16305 raft_consensus.cc:2468] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5433f0c9863e427d88ba5916819e28e3 in term 13.
I20260709 13:19:40.111532 15716 leader_election.cc:304] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:40.112627 20889 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.113487 20863 raft_consensus.cc:2804] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:19:40.113206 20889 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.114040 20863 raft_consensus.cc:697] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Becoming Leader. State: Replica: 5433f0c9863e427d88ba5916819e28e3, State: Running, Role: LEADER
I20260709 13:19:40.115595 20889 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:40.117542 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3" is_pre_election: true
I20260709 13:19:40.118196 15746 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 11.
I20260709 13:19:40.121153 16265 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:40.122258 20889 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:19:40.122684 20889 raft_consensus.cc:493] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.123071 20889 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:19:40.115101 20863 consensus_queue.cc:237] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.131410 20878 raft_consensus.cc:493] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.132244 20878 raft_consensus.cc:515] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.134908 20878 leader_election.cc:290] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.139976 16263 leader_election.cc:336] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:40.145685 15714 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:40.146627 15714 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.145537 20863 raft_consensus.cc:493] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.148396 20889 raft_consensus.cc:515] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.150949 20883 raft_consensus.cc:493] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.151528 20883 raft_consensus.cc:515] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:40.152873 20889 leader_election.cc:290] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Requested vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:40.154165 15746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc37ba667f048359988247ddb2d7f5b" candidate_uuid: "398beb97ee4b40688f6279f18fa51ade" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5433f0c9863e427d88ba5916819e28e3"
I20260709 13:19:40.154796 15746 raft_consensus.cc:3060] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:19:40.155748 15714 leader_election.cc:336] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.156219 15714 leader_election.cc:304] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.157114 20881 raft_consensus.cc:2749] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.159787 20883 leader_election.cc:290] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.166405 15714 leader_election.cc:336] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.164552 15496 catalog_manager.cc:5697] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 reported cstate change: term changed from 12 to 13, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67). New cstate: current_term: 13 leader_uuid: "5433f0c9863e427d88ba5916819e28e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.169864 20881 raft_consensus.cc:493] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.170128 15746 raft_consensus.cc:2468] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 398beb97ee4b40688f6279f18fa51ade in term 12.
I20260709 13:19:40.148674 20863 raft_consensus.cc:515] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:40.171643 20881 raft_consensus.cc:515] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:40.174261 16265 leader_election.cc:304] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade, 5433f0c9863e427d88ba5916819e28e3; no voters: 
I20260709 13:19:40.173760 20881 leader_election.cc:290] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
I20260709 13:19:40.175946 20889 raft_consensus.cc:2804] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:19:40.177295 20889 raft_consensus.cc:697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Becoming Leader. State: Replica: 398beb97ee4b40688f6279f18fa51ade, State: Running, Role: LEADER
I20260709 13:19:40.178371 20889 consensus_queue.cc:237] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
W20260709 13:19:40.178419 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.184886 16263 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:40.185762 16263 leader_election.cc:336] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.186161 16263 leader_election.cc:304] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.186889 20878 raft_consensus.cc:2749] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:40.173774 20863 leader_election.cc:290] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.192571 15714 consensus_peers.cc:597] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:40.193254 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:40.199048 15714 consensus_peers.cc:597] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.196255 16263 leader_election.cc:336] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:40.202410 15714 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:40.207175 15714 leader_election.cc:336] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.210194 15714 leader_election.cc:304] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.211102 20881 raft_consensus.cc:2749] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:19:40.216940 15714 consensus_peers.cc:597] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.217623 15714 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.216751 15496 catalog_manager.cc:5697] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade reported cstate change: term changed from 11 to 12, leader changed from 7019261981c6431baddd6812c15ac678 (127.14.41.66) to 398beb97ee4b40688f6279f18fa51ade (127.14.41.68). New cstate: current_term: 12 leader_uuid: "398beb97ee4b40688f6279f18fa51ade" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:40.218163 15714 leader_election.cc:336] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:40.225327 15714 leader_election.cc:336] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.225835 15714 leader_election.cc:304] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.226672 20881 raft_consensus.cc:2749] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:19:40.227732 15714 leader_election.cc:336] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.228232 15714 leader_election.cc:304] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.229091 20881 raft_consensus.cc:2749] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:19:40.230808 20881 raft_consensus.cc:493] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.231312 20881 raft_consensus.cc:515] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } }
I20260709 13:19:40.233572 20881 leader_election.cc:290] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.235287 15714 consensus_peers.cc:597] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.235841 15714 consensus_peers.cc:597] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.241737 15714 leader_election.cc:336] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:40.242923 15714 leader_election.cc:336] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:40.243453 15714 leader_election.cc:304] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5433f0c9863e427d88ba5916819e28e3; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.244251 20881 raft_consensus.cc:2749] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:19:40.276439 16305 raft_consensus.cc:1275] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:19:40.279279 20863 consensus_queue.cc:1048] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:40.280256 20889 raft_consensus.cc:493] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.280901 20889 raft_consensus.cc:515] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.283129 20889 leader_election.cc:290] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.289247 16263 leader_election.cc:336] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:40.290038 16263 leader_election.cc:336] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.290511 16263 leader_election.cc:304] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.293720 20889 raft_consensus.cc:2749] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:40.339098 15714 consensus_peers.cc:597] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:40.351269 16263 consensus_peers.cc:597] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.363329 15714 consensus_peers.cc:597] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:19:40.366950 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
W20260709 13:19:40.376955 16263 consensus_peers.cc:597] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.411577 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.474082 15714 consensus_peers.cc:597] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:19:40.480984 16263 consensus_peers.cc:597] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.483669 15714 consensus_peers.cc:597] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.506541 15714 consensus_peers.cc:597] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.507717 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
W20260709 13:19:40.522717 15714 consensus_peers.cc:597] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.528168 15714 consensus_peers.cc:597] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.535976 16265 consensus_peers.cc:597] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.547878 16263 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:40.551862 15714 consensus_peers.cc:597] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.557017 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:19:40.561245 16263 consensus_peers.cc:597] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.566169 16263 consensus_peers.cc:597] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.574811 15714 consensus_peers.cc:597] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.577464 16265 consensus_peers.cc:597] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.590021 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:19:40.590381 16263 consensus_peers.cc:597] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.591133 14501 tablet_replica.cc:333] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.592085 14501 raft_consensus.cc:2243] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.593722 14501 raft_consensus.cc:2272] T 651bfd4950ab4835b117f7364ee51b09 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.594071 16263 consensus_peers.cc:597] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.596258 14501 tablet_replica.cc:333] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.597154 14501 raft_consensus.cc:2243] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.598208 14501 raft_consensus.cc:2272] T 522c09add06b4e6c8c43c06c082d1e17 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.598400 15714 consensus_peers.cc:597] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.600561 14501 tablet_replica.cc:333] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.601523 14501 raft_consensus.cc:2243] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.602442 14501 raft_consensus.cc:2272] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.605026 14501 tablet_replica.cc:333] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.606674 14501 raft_consensus.cc:2243] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.607393 14501 raft_consensus.cc:2272] T 5fd98191b2d04d05b9a41afba67ac044 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.608994 16265 consensus_peers.cc:597] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.610283 14501 tablet_replica.cc:333] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
W20260709 13:19:40.610500 16263 consensus_peers.cc:597] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.611223 14501 raft_consensus.cc:2243] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.611742 14501 raft_consensus.cc:2272] T efe3434ebb0f4f6f9578442969e933e5 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.613688 14501 tablet_replica.cc:333] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.614282 14501 raft_consensus.cc:2243] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.615239 14501 raft_consensus.cc:2272] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.617514 14501 tablet_replica.cc:333] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.618152 14501 raft_consensus.cc:2243] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.619167 14501 raft_consensus.cc:2272] T 8c0bf08b91c244659abe8cb87e64f8cd P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.621833 14501 tablet_replica.cc:333] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.622648 14501 raft_consensus.cc:2243] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.623570 14501 raft_consensus.cc:2272] T eaaf7f7575314c29a12eedde1fe321a7 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.625002 16265 consensus_peers.cc:597] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.626210 14501 tablet_replica.cc:333] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.626991 14501 raft_consensus.cc:2243] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.627748 14501 raft_consensus.cc:2272] T 6556ac1ec52640c3bad0bf13607c8d19 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.630035 16263 consensus_peers.cc:597] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.630192 14501 tablet_replica.cc:333] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.630962 14501 raft_consensus.cc:2243] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.631819 14501 raft_consensus.cc:2272] T 181e7ee5f1ce4aa3bf93c66197002509 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.634122 14501 tablet_replica.cc:333] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.634904 14501 raft_consensus.cc:2243] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.635504 14501 raft_consensus.cc:2272] T 16817d3f588f45019ebd19d0c1915814 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.638422 14501 tablet_replica.cc:333] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.639138 14501 raft_consensus.cc:2243] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.640081 14501 raft_consensus.cc:2272] T 2e56a58686fa47d397c114454143e4c6 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.640350 16265 consensus_peers.cc:597] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.642144 14501 tablet_replica.cc:333] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.642757 14501 raft_consensus.cc:2243] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.643543 14501 raft_consensus.cc:2272] T 581e4945d85a47ba97ce48f4027aeade P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.645750 14501 tablet_replica.cc:333] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.646318 14501 raft_consensus.cc:2243] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.646850 14501 raft_consensus.cc:2272] T ac51ecd2367a45e8a32a6a911f34a9c2 P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.649349 14501 tablet_replica.cc:333] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.649914 14501 raft_consensus.cc:2243] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.650882 14501 raft_consensus.cc:2272] T b42c9970a1a64670ba11510d9c0c1809 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.652789 14501 tablet_replica.cc:333] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.653304 14501 raft_consensus.cc:2243] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.653934 14501 raft_consensus.cc:2272] T b798e44b35ab41d0943297db40d7407f P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.655825 14501 tablet_replica.cc:333] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.656348 14501 raft_consensus.cc:2243] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.657075 14501 raft_consensus.cc:2272] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.658942 14501 tablet_replica.cc:333] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.659480 14501 raft_consensus.cc:2243] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.660281 14501 raft_consensus.cc:2272] T fc4ccb73a2c14aa7864a676c25f3a2fc P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.662313 14501 tablet_replica.cc:333] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.662847 14501 raft_consensus.cc:2243] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.663365 14501 raft_consensus.cc:2272] T 473662f2d754459c9d26a0322ab3531a P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.665318 14501 tablet_replica.cc:333] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.665863 14501 raft_consensus.cc:2243] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.666671 14501 raft_consensus.cc:2272] T e105ea6267284f22bdfda14678176b49 P 5433f0c9863e427d88ba5916819e28e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.668550 14501 tablet_replica.cc:333] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.669271 14501 raft_consensus.cc:2243] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.670217 14501 raft_consensus.cc:2272] T 32d6629b913f439393c69fd7e6b8a55d P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.672691 14501 tablet_replica.cc:333] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.673384 14501 raft_consensus.cc:2243] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.674348 14501 raft_consensus.cc:2272] T ea2d5bac8fb54783a1f420061d08067f P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.676353 14501 tablet_replica.cc:333] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.676949 14501 raft_consensus.cc:2243] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.677625 14501 raft_consensus.cc:2272] T c248e8afdd4142d983c50c91087d8e01 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.679558 16305 raft_consensus.cc:1275] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Refusing update from remote peer 5433f0c9863e427d88ba5916819e28e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:19:40.679896 14501 tablet_replica.cc:333] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.680755 14501 raft_consensus.cc:2243] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.681450 14501 raft_consensus.cc:2272] T 693cb838c6224bb88e8195042cafa653 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.681218 20881 consensus_queue.cc:1048] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:40.683919 14501 tablet_replica.cc:333] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.684758 14501 raft_consensus.cc:2243] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.685461 14501 raft_consensus.cc:2272] T 9dc37ba667f048359988247ddb2d7f5b P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.688050 14501 tablet_replica.cc:333] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.688534 14501 raft_consensus.cc:2243] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.689555 14501 raft_consensus.cc:2272] T 97765616b2ca49eca1b5b2c90a10c9a3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.693657 14501 tablet_replica.cc:333] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.694502 14501 raft_consensus.cc:2243] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.695708 14501 raft_consensus.cc:2272] T f95117d3c05146d9a1c2b5c9158dc457 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.698580 14501 tablet_replica.cc:333] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.699571 14501 raft_consensus.cc:2243] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.706185 14501 raft_consensus.cc:2272] T 9b90fe6b2a274b68b50cf564b626c03e P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.709148 14501 tablet_replica.cc:333] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.709969 14501 raft_consensus.cc:2243] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.711066 14501 raft_consensus.cc:2272] T 81dbf9e63ec84d138474082a1d0293c0 P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.711333 16263 consensus_peers.cc:597] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:19:40.713485 14501 tablet_replica.cc:333] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.714116 14501 raft_consensus.cc:2243] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.714614 14501 raft_consensus.cc:2272] T f2d6a74c6b234911b02521773c4fdddf P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.716364 14501 tablet_replica.cc:333] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.716993 14501 raft_consensus.cc:2243] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.717844 14501 raft_consensus.cc:2272] T 75de3a46207e4bcfb457cdc43ffba2e2 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.719744 14501 tablet_replica.cc:333] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.720273 14501 raft_consensus.cc:2243] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.721099 14501 raft_consensus.cc:2272] T ee9f9791071f42759780d6353d07808d P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.722947 14501 tablet_replica.cc:333] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.723505 14501 raft_consensus.cc:2243] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.724102 14501 raft_consensus.cc:2272] T ffd4ffeb1af146f384319d74146b93f6 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.726227 14501 tablet_replica.cc:333] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.726747 14501 raft_consensus.cc:2243] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.727243 14501 raft_consensus.cc:2272] T e1e65bafed7145eb85b802c6c68a9129 P 5433f0c9863e427d88ba5916819e28e3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.729220 14501 tablet_replica.cc:333] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.729766 14501 raft_consensus.cc:2243] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.730474 14501 raft_consensus.cc:2272] T dbde144556724eb39acadbe99d8a1de3 P 5433f0c9863e427d88ba5916819e28e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.732818 14501 tablet_replica.cc:333] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.733563 14501 raft_consensus.cc:2243] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.734426 14501 raft_consensus.cc:2272] T 534cd68adf1a448ba243ff66d1dcd5da P 5433f0c9863e427d88ba5916819e28e3 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.734426 15714 consensus_peers.cc:597] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:40.736811 14501 tablet_replica.cc:333] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.737545 14501 raft_consensus.cc:2243] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.738668 14501 raft_consensus.cc:2272] T bda38eb6cdcc4738a2dc39a9bec091f0 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.741161 14501 tablet_replica.cc:333] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.741895 14501 raft_consensus.cc:2243] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.742558 14501 raft_consensus.cc:2272] T 7b872b4d6b684a548289e080316a1b94 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.744993 14501 tablet_replica.cc:333] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.745671 14501 raft_consensus.cc:2243] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.746183 14501 raft_consensus.cc:2272] T 6388e92df0fa4fac9a75573887c28fd9 P 5433f0c9863e427d88ba5916819e28e3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.747964 16265 consensus_peers.cc:597] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.748646 14501 tablet_replica.cc:333] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.749405 14501 raft_consensus.cc:2243] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.750404 14501 raft_consensus.cc:2272] T f900b71a39b14f0e92515320b011e9a1 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.752338 14501 tablet_replica.cc:333] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.752923 14501 raft_consensus.cc:2243] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.753791 14501 raft_consensus.cc:2272] T 06c670aee4b042d2aa73b9c2ec68245f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.755995 14501 tablet_replica.cc:333] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.756529 14501 raft_consensus.cc:2243] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.757063 14501 raft_consensus.cc:2272] T 889d20b228a74f7abdc0104e2529c28d P 5433f0c9863e427d88ba5916819e28e3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.759152 14501 tablet_replica.cc:333] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.759670 14501 raft_consensus.cc:2243] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.760514 14501 raft_consensus.cc:2272] T 95f2c1f9b34a4914bc89224fb8100cd5 P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.762549 14501 tablet_replica.cc:333] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.763150 14501 raft_consensus.cc:2243] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.763716 14501 raft_consensus.cc:2272] T 3862488109f64226a32f4b77b567c1dc P 5433f0c9863e427d88ba5916819e28e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.766063 14501 tablet_replica.cc:333] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.766774 14501 raft_consensus.cc:2243] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.767401 14501 raft_consensus.cc:2272] T e80fb58800714a47b47ac1e701a9400f P 5433f0c9863e427d88ba5916819e28e3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.769912 14501 tablet_replica.cc:333] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.770416 14501 raft_consensus.cc:2243] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.771122 14501 raft_consensus.cc:2272] T f6a774e81f58442c90fd80ad59687b99 P 5433f0c9863e427d88ba5916819e28e3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.773078 14501 tablet_replica.cc:333] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3: stopping tablet replica
I20260709 13:19:40.773545 14501 raft_consensus.cc:2243] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.774039 14501 raft_consensus.cc:2272] T 1ee7f36a2ae4477291b5b34ce26ac07c P 5433f0c9863e427d88ba5916819e28e3 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.804837 16265 consensus_peers.cc:597] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.812247 16265 consensus_peers.cc:597] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.836046 16265 consensus_peers.cc:597] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.851135 14501 connection.cc:466] server connection from 127.0.0.1:44676 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44676 (request call id 2061) could send its response
W20260709 13:19:40.853653 16265 consensus_peers.cc:597] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:40623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.874991 16263 consensus_peers.cc:597] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade -> Peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Couldn't send request to peer 7019261981c6431baddd6812c15ac678. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:40.922919 16265 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:40623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.942947 20889 raft_consensus.cc:493] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:40.943487 20889 raft_consensus.cc:515] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:40.945580 20889 leader_election.cc:290] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:40.951129 16265 consensus_peers.cc:597] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:40623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.951769 16265 consensus_peers.cc:597] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:40623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.958122 16263 leader_election.cc:336] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:40.960764 16263 leader_election.cc:336] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:40.961211 16263 leader_election.cc:304] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:40.961910 20889 raft_consensus.cc:2749] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:19:41.035573 16265 consensus_peers.cc:597] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade -> Peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Couldn't send request to peer 5433f0c9863e427d88ba5916819e28e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:40623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:41.228490 20900 raft_consensus.cc:493] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:41.231575 20900 raft_consensus.cc:515] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:41.233901 20900 leader_election.cc:290] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:41.237811 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:41.239847 16263 leader_election.cc:336] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:41.240271 16263 leader_election.cc:304] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:41.241003 20900 raft_consensus.cc:2749] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:19:41.488195 16263 consensus_peers.cc:597] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade -> Peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Couldn't send request to peer 558532223b984cf796cb6b98ddd6c9f2. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:19:41.495903 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:19:41.516786 20878 raft_consensus.cc:493] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:41.517552 20878 raft_consensus.cc:515] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:41.520002 20878 leader_election.cc:290] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:41.529007 16263 leader_election.cc:336] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:41.529999 16263 leader_election.cc:336] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:41.530583 16263 leader_election.cc:304] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:41.534227 20900 raft_consensus.cc:2749] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:19:41.605415 14501 tablet_server.cc:179] TabletServer@127.14.41.68:0 shutting down...
I20260709 13:19:41.619227 20900 raft_consensus.cc:493] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7019261981c6431baddd6812c15ac678)
I20260709 13:19:41.619935 20900 raft_consensus.cc:515] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "558532223b984cf796cb6b98ddd6c9f2" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 33667 } } peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:41.622610 20900 leader_election.cc:290] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667), 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941)
W20260709 13:19:41.629721 16263 leader_election.cc:336] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
W20260709 13:19:41.631457 16263 leader_election.cc:336] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:41.631908 16263 leader_election.cc:304] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 558532223b984cf796cb6b98ddd6c9f2, 7019261981c6431baddd6812c15ac678
I20260709 13:19:41.632750 20900 raft_consensus.cc:2749] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:19:41.655462 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:41.656394 14501 tablet_replica.cc:333] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.657562 14501 raft_consensus.cc:2243] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.658665 14501 pending_rounds.cc:70] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Trying to abort 1 pending ops.
I20260709 13:19:41.658866 14501 pending_rounds.cc:77] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade: Aborting op as it isn't in flight: id { term: 13 index: 13 } timestamp: 7305638625338408960 op_type: NO_OP noop_request { }
I20260709 13:19:41.659207 14501 raft_consensus.cc:2889] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:41.659588 14501 raft_consensus.cc:2272] T bda38eb6cdcc4738a2dc39a9bec091f0 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.662410 14501 tablet_replica.cc:333] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.662963 14501 raft_consensus.cc:2243] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.663861 14501 raft_consensus.cc:2272] T bbc6f003381b434b92d3b262155935c7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.666357 14501 tablet_replica.cc:333] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.666939 14501 raft_consensus.cc:2243] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.667652 14501 raft_consensus.cc:2272] T fc4ccb73a2c14aa7864a676c25f3a2fc P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.669800 14501 tablet_replica.cc:333] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.670430 14501 raft_consensus.cc:2243] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.670892 14501 raft_consensus.cc:2272] T 534cd68adf1a448ba243ff66d1dcd5da P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.673094 14501 tablet_replica.cc:333] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.673696 14501 raft_consensus.cc:2243] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.674612 14501 raft_consensus.cc:2272] T 6556ac1ec52640c3bad0bf13607c8d19 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.677407 14501 tablet_replica.cc:333] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.678254 14501 raft_consensus.cc:2243] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.679309 14501 raft_consensus.cc:2272] T 473662f2d754459c9d26a0322ab3531a P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.681641 14501 tablet_replica.cc:333] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.682219 14501 raft_consensus.cc:2243] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.682879 14501 raft_consensus.cc:2272] T 651bfd4950ab4835b117f7364ee51b09 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.685196 14501 tablet_replica.cc:333] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.686031 14501 raft_consensus.cc:2243] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.687094 14501 raft_consensus.cc:2272] T e1e65bafed7145eb85b802c6c68a9129 P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.689993 14501 tablet_replica.cc:333] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.690882 14501 raft_consensus.cc:2243] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.691717 14501 raft_consensus.cc:2272] T b171707a6f8e44b7a4f81ef5fbf30230 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.694226 14501 tablet_replica.cc:333] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.694792 14501 raft_consensus.cc:2243] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.695468 14501 raft_consensus.cc:2272] T 29bae97aafa2447892a23984cd26cd90 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.697767 14501 tablet_replica.cc:333] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.698408 14501 raft_consensus.cc:2243] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.699206 14501 raft_consensus.cc:2272] T efe3434ebb0f4f6f9578442969e933e5 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.701365 14501 tablet_replica.cc:333] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.702351 14501 raft_consensus.cc:2243] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.703073 14501 raft_consensus.cc:2272] T e303011bed72412ab6f5eebf5a6de748 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.705348 14501 tablet_replica.cc:333] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.705924 14501 raft_consensus.cc:2243] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.706424 14501 raft_consensus.cc:2272] T 6cee88791b35487fb5b26c8d3d7ee6c8 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.708397 14501 tablet_replica.cc:333] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.709012 14501 raft_consensus.cc:2243] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.709535 14501 raft_consensus.cc:2272] T 1301eda70cfb4417abc2a2d90b4bf0e8 P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.711637 14501 tablet_replica.cc:333] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.712181 14501 raft_consensus.cc:2243] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.713048 14501 raft_consensus.cc:2272] T 16817d3f588f45019ebd19d0c1915814 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.715214 14501 tablet_replica.cc:333] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.715793 14501 raft_consensus.cc:2243] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.716230 14501 raft_consensus.cc:2272] T e105ea6267284f22bdfda14678176b49 P 398beb97ee4b40688f6279f18fa51ade [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.718307 14501 tablet_replica.cc:333] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.718861 14501 raft_consensus.cc:2243] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.719661 14501 raft_consensus.cc:2272] T 3862488109f64226a32f4b77b567c1dc P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.721594 14501 tablet_replica.cc:333] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.722132 14501 raft_consensus.cc:2243] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.722942 14501 raft_consensus.cc:2272] T 5fd98191b2d04d05b9a41afba67ac044 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.725172 14501 tablet_replica.cc:333] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.725912 14501 raft_consensus.cc:2243] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.726868 14501 raft_consensus.cc:2272] T b798e44b35ab41d0943297db40d7407f P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.729604 14501 tablet_replica.cc:333] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.730233 14501 raft_consensus.cc:2243] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.731019 14501 raft_consensus.cc:2272] T 889d20b228a74f7abdc0104e2529c28d P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.732950 14501 tablet_replica.cc:333] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.733490 14501 raft_consensus.cc:2243] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.734087 14501 raft_consensus.cc:2272] T 90bff7f9147743b39de29e593c7a83b1 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.736121 14501 tablet_replica.cc:333] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.736725 14501 raft_consensus.cc:2243] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.737161 14501 raft_consensus.cc:2272] T 181e7ee5f1ce4aa3bf93c66197002509 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.739091 14501 tablet_replica.cc:333] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.739645 14501 raft_consensus.cc:2243] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.740155 14501 raft_consensus.cc:2272] T 9e1ddbbc3cce4edcbe5c245fb2d8ed29 P 398beb97ee4b40688f6279f18fa51ade [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.742172 14501 tablet_replica.cc:333] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.742709 14501 raft_consensus.cc:2243] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.743166 14501 raft_consensus.cc:2272] T 9fa9cf9412ae412a8756d1fc1138ddce P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.745123 14501 tablet_replica.cc:333] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.745671 14501 raft_consensus.cc:2243] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.746438 14501 pending_rounds.cc:70] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Trying to abort 1 pending ops.
I20260709 13:19:41.746639 14501 pending_rounds.cc:77] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade: Aborting op as it isn't in flight: id { term: 12 index: 12 } timestamp: 7305638626021523456 op_type: NO_OP noop_request { }
I20260709 13:19:41.746908 14501 raft_consensus.cc:2889] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:41.747234 14501 raft_consensus.cc:2272] T 9dc37ba667f048359988247ddb2d7f5b P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.749214 14501 tablet_replica.cc:333] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.749651 20878 raft_consensus.cc:493] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:41.750437 20878 raft_consensus.cc:515] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:41.750830 14501 raft_consensus.cc:2243] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.752043 14501 raft_consensus.cc:2272] T 86c5f054f586412fbd8a416245340d63 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.753913 20878 leader_election.cc:290] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:41.755125 14501 tablet_replica.cc:333] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.756035 14501 raft_consensus.cc:2243] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.756901 20878 raft_consensus.cc:493] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5433f0c9863e427d88ba5916819e28e3)
I20260709 13:19:41.757139 14501 raft_consensus.cc:2272] T c9e5693d3c474948b687ba64b0b31215 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.757442 20878 raft_consensus.cc:515] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "7019261981c6431baddd6812c15ac678" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 33941 } } peers { permanent_uuid: "5433f0c9863e427d88ba5916819e28e3" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 40623 } } peers { permanent_uuid: "398beb97ee4b40688f6279f18fa51ade" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 46739 } attrs { promote: false } }
I20260709 13:19:41.759703 20878 leader_election.cc:290] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941), 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623)
I20260709 13:19:41.759986 14501 tablet_replica.cc:333] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.760831 14501 raft_consensus.cc:2243] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 10 LEADER]: Raft consensus shutting down.
W20260709 13:19:41.761070 16263 leader_election.cc:336] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
W20260709 13:19:41.761888 16265 leader_election.cc:336] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Network error: Client connection negotiation failed: client connection to 127.14.41.67:40623: connect: Connection refused (error 111)
I20260709 13:19:41.761930 14501 raft_consensus.cc:2272] T f6a774e81f58442c90fd80ad59687b99 P 398beb97ee4b40688f6279f18fa51ade [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.762400 16265 leader_election.cc:304] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:41.763147 20878 raft_consensus.cc:2749] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:19:41.764973 14501 tablet_replica.cc:333] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.765825 14501 raft_consensus.cc:2243] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:41.766139 16265 leader_election.cc:336] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5433f0c9863e427d88ba5916819e28e3 (127.14.41.67:40623): Network error: Client connection negotiation failed: client connection to 127.14.41.67:40623: connect: Connection refused (error 111)
I20260709 13:19:41.766438 14501 raft_consensus.cc:2272] T 8c0bf08b91c244659abe8cb87e64f8cd P 398beb97ee4b40688f6279f18fa51ade [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:41.767232 16263 leader_election.cc:336] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 7019261981c6431baddd6812c15ac678 (127.14.41.66:33941): Network error: Client connection negotiation failed: client connection to 127.14.41.66:33941: connect: Connection refused (error 111)
I20260709 13:19:41.767638 16263 leader_election.cc:304] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 398beb97ee4b40688f6279f18fa51ade; no voters: 5433f0c9863e427d88ba5916819e28e3, 7019261981c6431baddd6812c15ac678
I20260709 13:19:41.768347 20878 raft_consensus.cc:2749] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:19:41.769141 14501 tablet_replica.cc:333] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.769731 14501 raft_consensus.cc:2243] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.770558 14501 raft_consensus.cc:2272] T 43658563a58a42e3b9a3da86a87a9c02 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.772683 14501 tablet_replica.cc:333] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.773204 14501 raft_consensus.cc:2243] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.773732 14501 raft_consensus.cc:2272] T 958e81841a784ee79fccc9f488562c59 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.776230 14501 tablet_replica.cc:333] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.776947 14501 raft_consensus.cc:2243] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.777485 14501 raft_consensus.cc:2272] T ea2d5bac8fb54783a1f420061d08067f P 398beb97ee4b40688f6279f18fa51ade [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.780041 14501 tablet_replica.cc:333] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.780690 14501 raft_consensus.cc:2243] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.781167 14501 raft_consensus.cc:2272] T 9b90fe6b2a274b68b50cf564b626c03e P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.783005 14501 tablet_replica.cc:333] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.783558 14501 raft_consensus.cc:2243] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.784087 14501 raft_consensus.cc:2272] T bea9d89f73eb4c36b8a8270cda937174 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.786126 14501 tablet_replica.cc:333] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.786628 14501 raft_consensus.cc:2243] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.788020 14501 raft_consensus.cc:2272] T c248e8afdd4142d983c50c91087d8e01 P 398beb97ee4b40688f6279f18fa51ade [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.790005 14501 tablet_replica.cc:333] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.790516 14501 raft_consensus.cc:2243] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.790997 14501 raft_consensus.cc:2272] T ee9f9791071f42759780d6353d07808d P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.793011 14501 tablet_replica.cc:333] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.793628 14501 raft_consensus.cc:2243] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.794450 14501 raft_consensus.cc:2272] T ffd4ffeb1af146f384319d74146b93f6 P 398beb97ee4b40688f6279f18fa51ade [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.796375 14501 tablet_replica.cc:333] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.796880 14501 raft_consensus.cc:2243] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:41.797410 14501 raft_consensus.cc:2272] T eaaf7f7575314c29a12eedde1fe321a7 P 398beb97ee4b40688f6279f18fa51ade [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:41.799252 14501 tablet_replica.cc:333] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade: stopping tablet replica
I20260709 13:19:41.799706 14501 raft_consensus.cc:2243] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:41.800474 14501 raft_consensus.cc:2272] T 6fc66402c5e04df38b56e6d8d4d7731d P 398beb97ee4b40688f6279f18fa51ade [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.098234 14501 tablet_server.cc:196] TabletServer@127.14.41.68:0 shutdown complete.
I20260709 13:19:42.163166 14501 master.cc:562] Master@127.14.41.126:40467 shutting down...
W20260709 13:19:42.208099 15548 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:19:42.208446 15548 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:42.208689 15548 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:46.347446 15484 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111) [suppressed 309 similar messages]
W20260709 13:19:46.350834 15484 catalog_manager.cc:4755] TS 558532223b984cf796cb6b98ddd6c9f2 (127.14.41.65:33667): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet bda38eb6cdcc4738a2dc39a9bec091f0: Network error: Client connection negotiation failed: client connection to 127.14.41.65:33667: connect: Connection refused (error 111)
I20260709 13:19:46.695796 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.697084 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.697539 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P c996756dd34f40be806bd3ad4744f303: stopping tablet replica
I20260709 13:19:46.848906 14501 master.cc:584] Master@127.14.41.126:40467 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (184698 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:19:46.968904 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:36967
I20260709 13:19:46.970119 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:46.976408 20904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:46.976466 20905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:46.977674 20907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:46.978327 14501 server_base.cc:1061] running on GCE node
I20260709 13:19:46.981155 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:46.981359 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:46.981474 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603186981463 us; error 0 us; skew 500 ppm
I20260709 13:19:46.981942 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:46.984448 14501 webserver.cc:533] Webserver started at http://127.14.41.126:44107/ using document root <none> and password file <none>
I20260709 13:19:46.984997 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:46.985152 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:46.985365 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:46.986711 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "019711ec89b74c388bd03d0a1214e1f9"
format_stamp: "Formatted at 2026-07-09 13:19:46 on dist-test-slave-56lb"
I20260709 13:19:46.991952 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:19:46.995661 20912 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:46.996459 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:46.996887 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "019711ec89b74c388bd03d0a1214e1f9"
format_stamp: "Formatted at 2026-07-09 13:19:46 on dist-test-slave-56lb"
I20260709 13:19:46.997148 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.009627 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.011013 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.051807 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:36967
I20260709 13:19:47.051928 20963 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:36967 every 8 connection(s)
I20260709 13:19:47.056136 20964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.066893 20964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9: Bootstrap starting.
I20260709 13:19:47.071730 20964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.076195 20964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9: No bootstrap required, opened a new log
I20260709 13:19:47.078531 20964 raft_consensus.cc:359] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "019711ec89b74c388bd03d0a1214e1f9" member_type: VOTER }
I20260709 13:19:47.078997 20964 raft_consensus.cc:385] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.079259 20964 raft_consensus.cc:740] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 019711ec89b74c388bd03d0a1214e1f9, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.079869 20964 consensus_queue.cc:260] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "019711ec89b74c388bd03d0a1214e1f9" member_type: VOTER }
I20260709 13:19:47.080338 20964 raft_consensus.cc:399] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:47.080585 20964 raft_consensus.cc:493] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:47.080912 20964 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.085381 20964 raft_consensus.cc:515] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "019711ec89b74c388bd03d0a1214e1f9" member_type: VOTER }
I20260709 13:19:47.085964 20964 leader_election.cc:304] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 019711ec89b74c388bd03d0a1214e1f9; no voters: 
I20260709 13:19:47.087124 20964 leader_election.cc:290] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:47.087589 20967 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.089073 20967 raft_consensus.cc:697] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 1 LEADER]: Becoming Leader. State: Replica: 019711ec89b74c388bd03d0a1214e1f9, State: Running, Role: LEADER
I20260709 13:19:47.089836 20967 consensus_queue.cc:237] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "019711ec89b74c388bd03d0a1214e1f9" member_type: VOTER }
I20260709 13:19:47.090185 20964 sys_catalog.cc:565] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:47.097198 20969 sys_catalog.cc:455] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 019711ec89b74c388bd03d0a1214e1f9. Latest consensus state: current_term: 1 leader_uuid: "019711ec89b74c388bd03d0a1214e1f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "019711ec89b74c388bd03d0a1214e1f9" member_type: VOTER } }
I20260709 13:19:47.097458 20968 sys_catalog.cc:455] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "019711ec89b74c388bd03d0a1214e1f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "019711ec89b74c388bd03d0a1214e1f9" member_type: VOTER } }
I20260709 13:19:47.098043 20969 sys_catalog.cc:458] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:47.098074 20968 sys_catalog.cc:458] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:47.100140 20977 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:47.106475 20977 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:47.107651 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:47.115743 20977 catalog_manager.cc:1383] Generated new cluster ID: 7cea60dc16cd47f393fbbd1639717845
I20260709 13:19:47.116062 20977 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:47.134739 20977 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:47.136135 20977 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:47.147986 20977 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9: Generated new TSK 0
I20260709 13:19:47.148712 20977 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:47.174674 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.180989 20985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.182145 20986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.185047 20988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.185196 14501 server_base.cc:1061] running on GCE node
I20260709 13:19:47.187094 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:47.187336 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.187520 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603187187501 us; error 0 us; skew 500 ppm
I20260709 13:19:47.188086 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.190496 14501 webserver.cc:533] Webserver started at http://127.14.41.65:37213/ using document root <none> and password file <none>
I20260709 13:19:47.190979 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.191183 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.191516 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.192858 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "1d804ce9949645b19a0ccc1faf258ec7"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.197330 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:19:47.200906 20993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.201654 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:19:47.201959 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "1d804ce9949645b19a0ccc1faf258ec7"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.202241 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.259543 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.260888 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.262452 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:47.265175 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:47.265405 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.265728 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:47.265903 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.309286 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:43285
I20260709 13:19:47.309427 21055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:43285 every 8 connection(s)
I20260709 13:19:47.314627 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.323071 21060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.323547 21061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.326956 21063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.328408 14501 server_base.cc:1061] running on GCE node
I20260709 13:19:47.330534 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:47.330849 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.331061 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603187331041 us; error 0 us; skew 500 ppm
I20260709 13:19:47.331892 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.333865 21056 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36967
I20260709 13:19:47.334235 21056 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:47.335057 21056 heartbeater.cc:507] Master 127.14.41.126:36967 requested a full tablet report, sending...
I20260709 13:19:47.336321 14501 webserver.cc:533] Webserver started at http://127.14.41.66:43207/ using document root <none> and password file <none>
I20260709 13:19:47.336958 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.337157 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.337457 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.337404 20929 ts_manager.cc:194] Registered new tserver with Master: 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:47.338971 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "e8ce20857fa342c1b4cfc322565e1648"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.339627 20929 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57472
I20260709 13:19:47.343801 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:47.347725 21068 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.348546 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:47.348927 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "e8ce20857fa342c1b4cfc322565e1648"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.349210 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.360297 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.361636 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.363209 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:47.365693 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:47.365965 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.366277 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:47.366460 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.410580 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:43093
I20260709 13:19:47.410688 21130 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:43093 every 8 connection(s)
I20260709 13:19:47.415511 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.422896 21134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.423216 21135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.427212 21137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.427721 14501 server_base.cc:1061] running on GCE node
I20260709 13:19:47.427819 21131 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36967
I20260709 13:19:47.428386 21131 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:47.429113 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:47.429236 21131 heartbeater.cc:507] Master 127.14.41.126:36967 requested a full tablet report, sending...
W20260709 13:19:47.429388 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.429764 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603187429734 us; error 0 us; skew 500 ppm
I20260709 13:19:47.430557 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.431798 20929 ts_manager.cc:194] Registered new tserver with Master: e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:47.433486 14501 webserver.cc:533] Webserver started at http://127.14.41.67:43185/ using document root <none> and password file <none>
I20260709 13:19:47.433797 20929 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57486
I20260709 13:19:47.434137 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.434427 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.434765 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.436128 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.440747 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:19:47.444083 21142 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.444947 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:19:47.445253 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.445551 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.458508 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.459815 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.461467 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:47.463838 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:47.464138 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.464386 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:47.464562 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.512513 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:34045
I20260709 13:19:47.512687 21204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:34045 every 8 connection(s)
I20260709 13:19:47.518113 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:47.526328 21208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.527084 21209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:47.532059 21211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:47.532712 14501 server_base.cc:1061] running on GCE node
I20260709 13:19:47.533211 21205 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36967
I20260709 13:19:47.533674 21205 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:47.533867 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:47.534193 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:47.534387 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603187534367 us; error 0 us; skew 500 ppm
I20260709 13:19:47.534678 21205 heartbeater.cc:507] Master 127.14.41.126:36967 requested a full tablet report, sending...
I20260709 13:19:47.535125 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:47.537235 20929 ts_manager.cc:194] Registered new tserver with Master: 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:47.538196 14501 webserver.cc:533] Webserver started at http://127.14.41.68:41479/ using document root <none> and password file <none>
I20260709 13:19:47.538781 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:47.538997 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:47.539083 20929 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57490
I20260709 13:19:47.539299 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:47.540943 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-3-root/instance:
uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.545815 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:19:47.549695 21216 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.550572 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:47.550997 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-3-root
uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:19:47.551317 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:47.566368 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:47.567893 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:47.569628 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:47.572193 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:47.572459 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.572767 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:47.572978 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:47.621901 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.68:37887
I20260709 13:19:47.622017 21278 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.68:37887 every 8 connection(s)
I20260709 13:19:47.636960 21279 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36967
I20260709 13:19:47.637382 21279 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:47.638209 21279 heartbeater.cc:507] Master 127.14.41.126:36967 requested a full tablet report, sending...
I20260709 13:19:47.640398 20929 ts_manager.cc:194] Registered new tserver with Master: 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:47.640851 14501 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015282504s
I20260709 13:19:47.641944 20929 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57494
I20260709 13:19:47.669592 20929 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57498:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:19:47.929787 21096 tablet_service.cc:1511] Processing CreateTablet for tablet 0f17fd17b854429c8d54b89098c0498e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:47.930802 21093 tablet_service.cc:1511] Processing CreateTablet for tablet cbecd21568da4cba91bf43b4ce59a28c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:47.932996 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 9289ff54958748809113e69d968d9332 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:47.933470 21094 tablet_service.cc:1511] Processing CreateTablet for tablet d8db1e0ee06248228c09ec09a8ec2374 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:47.931401 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f17fd17b854429c8d54b89098c0498e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.935812 21095 tablet_service.cc:1511] Processing CreateTablet for tablet c1cf371fb66e4871bfbcf50de978af7d (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:47.937340 21095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cf371fb66e4871bfbcf50de978af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.937804 21091 tablet_service.cc:1511] Processing CreateTablet for tablet b1f8bda438ea43dfa50e131788b83ebd (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:47.939208 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f8bda438ea43dfa50e131788b83ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.944309 21090 tablet_service.cc:1511] Processing CreateTablet for tablet 3547414adb8447f6989687a1f99ce241 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:47.945799 21090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3547414adb8447f6989687a1f99ce241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.947181 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8db1e0ee06248228c09ec09a8ec2374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.948539 21093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbecd21568da4cba91bf43b4ce59a28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.948650 21244 tablet_service.cc:1511] Processing CreateTablet for tablet 0f17fd17b854429c8d54b89098c0498e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:47.950069 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9289ff54958748809113e69d968d9332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.950249 21244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f17fd17b854429c8d54b89098c0498e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.949852 21238 tablet_service.cc:1511] Processing CreateTablet for tablet 8805cdcd3cb148acb1654e722cf4a577 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:47.951866 21243 tablet_service.cc:1511] Processing CreateTablet for tablet d8db1e0ee06248228c09ec09a8ec2374 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:47.961432 21089 tablet_service.cc:1511] Processing CreateTablet for tablet 8805cdcd3cb148acb1654e722cf4a577 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:47.962229 21243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8db1e0ee06248228c09ec09a8ec2374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.964097 21088 tablet_service.cc:1511] Processing CreateTablet for tablet e227c9264c424ae89443b124431f4bc4 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:47.955248 21240 tablet_service.cc:1511] Processing CreateTablet for tablet d033c5d43dee4eaca81ac47cdb061f0b (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:47.965973 21240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d033c5d43dee4eaca81ac47cdb061f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.966301 21089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8805cdcd3cb148acb1654e722cf4a577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.968694 21088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e227c9264c424ae89443b124431f4bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.953573 21241 tablet_service.cc:1511] Processing CreateTablet for tablet 9289ff54958748809113e69d968d9332 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:47.970100 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9289ff54958748809113e69d968d9332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.970548 21087 tablet_service.cc:1511] Processing CreateTablet for tablet 3848031ef4394b0bbc4d53d2fc9546d2 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:47.972064 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3848031ef4394b0bbc4d53d2fc9546d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.973381 21021 tablet_service.cc:1511] Processing CreateTablet for tablet c1cf371fb66e4871bfbcf50de978af7d (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:47.974944 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cf371fb66e4871bfbcf50de978af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.975669 21019 tablet_service.cc:1511] Processing CreateTablet for tablet f0e039db49ff4c319e42dc1783ed2045 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:47.977965 21018 tablet_service.cc:1511] Processing CreateTablet for tablet cbecd21568da4cba91bf43b4ce59a28c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:47.979591 21018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbecd21568da4cba91bf43b4ce59a28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.948212 21242 tablet_service.cc:1511] Processing CreateTablet for tablet f0e039db49ff4c319e42dc1783ed2045 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:47.981936 21017 tablet_service.cc:1511] Processing CreateTablet for tablet 9289ff54958748809113e69d968d9332 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:47.984555 21016 tablet_service.cc:1511] Processing CreateTablet for tablet d033c5d43dee4eaca81ac47cdb061f0b (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:47.987185 21015 tablet_service.cc:1511] Processing CreateTablet for tablet 3547414adb8447f6989687a1f99ce241 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:47.978039 21020 tablet_service.cc:1511] Processing CreateTablet for tablet d8db1e0ee06248228c09ec09a8ec2374 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:47.956692 21239 tablet_service.cc:1511] Processing CreateTablet for tablet b1f8bda438ea43dfa50e131788b83ebd (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:47.994993 21237 tablet_service.cc:1511] Processing CreateTablet for tablet fd01db0747d94dc08454b218e6dca7be (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:47.997939 21236 tablet_service.cc:1511] Processing CreateTablet for tablet e227c9264c424ae89443b124431f4bc4 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:48.000969 21235 tablet_service.cc:1511] Processing CreateTablet for tablet b77f26debe334a758ab2ca9c17429fb6 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:48.009178 21017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9289ff54958748809113e69d968d9332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.013089 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8db1e0ee06248228c09ec09a8ec2374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.018065 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77f26debe334a758ab2ca9c17429fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.021134 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e039db49ff4c319e42dc1783ed2045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.024992 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8805cdcd3cb148acb1654e722cf4a577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.025300 21015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3547414adb8447f6989687a1f99ce241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.029007 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd01db0747d94dc08454b218e6dca7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.040953 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d033c5d43dee4eaca81ac47cdb061f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.043236 21096 tablet_service.cc:1511] Processing CreateTablet for tablet b77f26debe334a758ab2ca9c17429fb6 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:48.046190 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 35366fd4bf3b40269b10dbf95981ec98 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:48.054227 21013 tablet_service.cc:1511] Processing CreateTablet for tablet fd01db0747d94dc08454b218e6dca7be (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:48.055719 21013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd01db0747d94dc08454b218e6dca7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.048693 21014 tablet_service.cc:1511] Processing CreateTablet for tablet 8805cdcd3cb148acb1654e722cf4a577 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:48.058008 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8805cdcd3cb148acb1654e722cf4a577. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.059252 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f8bda438ea43dfa50e131788b83ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.061342 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e227c9264c424ae89443b124431f4bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.061539 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 3848031ef4394b0bbc4d53d2fc9546d2 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:48.062979 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3848031ef4394b0bbc4d53d2fc9546d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.087456 21242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e039db49ff4c319e42dc1783ed2045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.090490 21168 tablet_service.cc:1511] Processing CreateTablet for tablet f0e039db49ff4c319e42dc1783ed2045 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:48.092239 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e039db49ff4c319e42dc1783ed2045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.093211 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 0f17fd17b854429c8d54b89098c0498e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:48.093961 21167 tablet_service.cc:1511] Processing CreateTablet for tablet cbecd21568da4cba91bf43b4ce59a28c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:48.096552 21166 tablet_service.cc:1511] Processing CreateTablet for tablet d033c5d43dee4eaca81ac47cdb061f0b (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:48.096735 21169 tablet_service.cc:1511] Processing CreateTablet for tablet c1cf371fb66e4871bfbcf50de978af7d (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
W20260709 13:19:48.101454 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:48.101766 21162 tablet_service.cc:1511] Processing CreateTablet for tablet e227c9264c424ae89443b124431f4bc4 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:48.097904 21165 tablet_service.cc:1511] Processing CreateTablet for tablet b1f8bda438ea43dfa50e131788b83ebd (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:48.099231 21164 tablet_service.cc:1511] Processing CreateTablet for tablet 3547414adb8447f6989687a1f99ce241 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:48.099231 21163 tablet_service.cc:1511] Processing CreateTablet for tablet fd01db0747d94dc08454b218e6dca7be (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:48.104981 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbecd21568da4cba91bf43b4ce59a28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.106324 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e227c9264c424ae89443b124431f4bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.107443 21165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1f8bda438ea43dfa50e131788b83ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.109043 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3547414adb8447f6989687a1f99ce241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.109830 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f17fd17b854429c8d54b89098c0498e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.113226 21166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d033c5d43dee4eaca81ac47cdb061f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.113994 21161 tablet_service.cc:1511] Processing CreateTablet for tablet 3848031ef4394b0bbc4d53d2fc9546d2 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:48.116005 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3848031ef4394b0bbc4d53d2fc9546d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.116997 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1cf371fb66e4871bfbcf50de978af7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.121024 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd01db0747d94dc08454b218e6dca7be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.136400 21096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77f26debe334a758ab2ca9c17429fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.157755 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35366fd4bf3b40269b10dbf95981ec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.156265 21088 tablet_service.cc:1511] Processing CreateTablet for tablet c088f6c59e3d40e28bfb3005f3fe8930 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:48.189954 21088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c088f6c59e3d40e28bfb3005f3fe8930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.214745 21241 tablet_service.cc:1511] Processing CreateTablet for tablet 18c983bfb97d4996978143ed268649ca (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:48.216090 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c983bfb97d4996978143ed268649ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.225102 21015 tablet_service.cc:1511] Processing CreateTablet for tablet b77f26debe334a758ab2ca9c17429fb6 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:48.227062 21015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77f26debe334a758ab2ca9c17429fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.232223 21299 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:48.256551 21301 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:48.258374 21021 tablet_service.cc:1511] Processing CreateTablet for tablet 18c983bfb97d4996978143ed268649ca (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:48.260124 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c983bfb97d4996978143ed268649ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.260787 21299 tablet_bootstrap.cc:654] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.263793 21301 tablet_bootstrap.cc:654] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.171074 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 115f88285bc14a5b8057a3aa7e8f3d49 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:48.274307 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115f88285bc14a5b8057a3aa7e8f3d49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.286039 21300 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:48.341887 21300 tablet_bootstrap.cc:654] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.342465 21056 heartbeater.cc:499] Master 127.14.41.126:36967 was elected leader, sending a full tablet report...
I20260709 13:19:48.347330 21091 tablet_service.cc:1511] Processing CreateTablet for tablet c7a6eec3bdec4955bc56e41974349edd (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:48.380573 21168 tablet_service.cc:1511] Processing CreateTablet for tablet 18c983bfb97d4996978143ed268649ca (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:48.381186 21238 tablet_service.cc:1511] Processing CreateTablet for tablet 35366fd4bf3b40269b10dbf95981ec98 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:48.383191 21168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c983bfb97d4996978143ed268649ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.393766 21235 tablet_service.cc:1511] Processing CreateTablet for tablet c088f6c59e3d40e28bfb3005f3fe8930 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:48.395256 21244 tablet_service.cc:1511] Processing CreateTablet for tablet 38983c417740476390f693a1ab05eb8a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:48.397647 21236 tablet_service.cc:1511] Processing CreateTablet for tablet f72d9426efb8467e9ff58df645ea8f6c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:48.381585 21093 tablet_service.cc:1511] Processing CreateTablet for tablet 38983c417740476390f693a1ab05eb8a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:48.406224 21093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38983c417740476390f693a1ab05eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.408793 21090 tablet_service.cc:1511] Processing CreateTablet for tablet c297a12f6a8d4cebb87de531c02e7944 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:48.430023 21165 tablet_service.cc:1511] Processing CreateTablet for tablet 35366fd4bf3b40269b10dbf95981ec98 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:48.431514 21161 tablet_service.cc:1511] Processing CreateTablet for tablet 115f88285bc14a5b8057a3aa7e8f3d49 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:48.432528 21018 tablet_service.cc:1511] Processing CreateTablet for tablet 28ebc67ba1384341b5cbd68f36a5d420 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:48.432771 21166 tablet_service.cc:1511] Processing CreateTablet for tablet f72d9426efb8467e9ff58df645ea8f6c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:48.433125 21169 tablet_service.cc:1511] Processing CreateTablet for tablet 38983c417740476390f693a1ab05eb8a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:48.425802 21302 tablet_bootstrap.cc:492] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:48.437548 21242 tablet_service.cc:1511] Processing CreateTablet for tablet a01bd1c7e8e34a2cb7235e985339f475 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:48.437553 21240 tablet_service.cc:1511] Processing CreateTablet for tablet 28ebc67ba1384341b5cbd68f36a5d420 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:48.439118 21131 heartbeater.cc:499] Master 127.14.41.126:36967 was elected leader, sending a full tablet report...
I20260709 13:19:48.431562 21165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35366fd4bf3b40269b10dbf95981ec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.442148 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115f88285bc14a5b8057a3aa7e8f3d49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.428138 21019 tablet_service.cc:1511] Processing CreateTablet for tablet a01bd1c7e8e34a2cb7235e985339f475 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:48.445066 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38983c417740476390f693a1ab05eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.445322 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35366fd4bf3b40269b10dbf95981ec98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.456537 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01bd1c7e8e34a2cb7235e985339f475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.456784 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c088f6c59e3d40e28bfb3005f3fe8930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.464984 21240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ebc67ba1384341b5cbd68f36a5d420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.469018 21242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01bd1c7e8e34a2cb7235e985339f475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.470311 21018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ebc67ba1384341b5cbd68f36a5d420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.475967 21021 tablet_service.cc:1511] Processing CreateTablet for tablet c7a6eec3bdec4955bc56e41974349edd (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:48.477445 21021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a6eec3bdec4955bc56e41974349edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.442116 21170 tablet_service.cc:1511] Processing CreateTablet for tablet 28ebc67ba1384341b5cbd68f36a5d420 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:48.480397 21164 tablet_service.cc:1511] Processing CreateTablet for tablet c297a12f6a8d4cebb87de531c02e7944 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:48.481451 21170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ebc67ba1384341b5cbd68f36a5d420. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.450716 21020 tablet_service.cc:1511] Processing CreateTablet for tablet f72d9426efb8467e9ff58df645ea8f6c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:48.485464 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72d9426efb8467e9ff58df645ea8f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.494844 21243 tablet_service.cc:1511] Processing CreateTablet for tablet c297a12f6a8d4cebb87de531c02e7944 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:48.496333 21243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c297a12f6a8d4cebb87de531c02e7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.498283 21239 tablet_service.cc:1511] Processing CreateTablet for tablet 90ab82e70de84e30bf72e4383c4309b0 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:48.499229 21301 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:48.504803 21301 ts_tablet_manager.cc:1403] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.249s	user 0.019s	sys 0.023s
I20260709 13:19:48.506585 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a6eec3bdec4955bc56e41974349edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.507289 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c297a12f6a8d4cebb87de531c02e7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.513609 21014 tablet_service.cc:1511] Processing CreateTablet for tablet c088f6c59e3d40e28bfb3005f3fe8930 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:48.514770 21299 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:48.514444 21087 tablet_service.cc:1511] Processing CreateTablet for tablet a01bd1c7e8e34a2cb7235e985339f475 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:48.500317 21017 tablet_service.cc:1511] Processing CreateTablet for tablet 115f88285bc14a5b8057a3aa7e8f3d49 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:48.519240 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ab82e70de84e30bf72e4383c4309b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.530699 21162 tablet_service.cc:1511] Processing CreateTablet for tablet 20e2322c978e431ab9ce24d58bf8177a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:48.535409 21163 tablet_service.cc:1511] Processing CreateTablet for tablet 13fea0e467074bd185a6c07450057598 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:48.529505 21088 tablet_service.cc:1511] Processing CreateTablet for tablet 13fea0e467074bd185a6c07450057598 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:48.530326 21166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72d9426efb8467e9ff58df645ea8f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.539433 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72d9426efb8467e9ff58df645ea8f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.522346 21299 ts_tablet_manager.cc:1403] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.291s	user 0.010s	sys 0.020s
I20260709 13:19:48.542362 21205 heartbeater.cc:499] Master 127.14.41.126:36967 was elected leader, sending a full tablet report...
I20260709 13:19:48.545370 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c088f6c59e3d40e28bfb3005f3fe8930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.548476 21244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38983c417740476390f693a1ab05eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.553256 21017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 115f88285bc14a5b8057a3aa7e8f3d49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.556780 21090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c297a12f6a8d4cebb87de531c02e7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.558861 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13fea0e467074bd185a6c07450057598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.559979 21237 tablet_service.cc:1511] Processing CreateTablet for tablet 20e2322c978e431ab9ce24d58bf8177a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:48.561991 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e2322c978e431ab9ce24d58bf8177a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.564210 21167 tablet_service.cc:1511] Processing CreateTablet for tablet c7a6eec3bdec4955bc56e41974349edd (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:48.565842 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a6eec3bdec4955bc56e41974349edd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.568406 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a01bd1c7e8e34a2cb7235e985339f475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.569538 21088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13fea0e467074bd185a6c07450057598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.582013 21016 tablet_service.cc:1511] Processing CreateTablet for tablet 90ab82e70de84e30bf72e4383c4309b0 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:48.583415 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ab82e70de84e30bf72e4383c4309b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.585572 21300 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:48.586155 21300 ts_tablet_manager.cc:1403] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.301s	user 0.011s	sys 0.019s
I20260709 13:19:48.592330 21302 tablet_bootstrap.cc:654] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.592763 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 90ab82e70de84e30bf72e4383c4309b0 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:48.594906 21169 tablet_service.cc:1511] Processing CreateTablet for tablet b1d5cd05e2f349d8b1916f974171fb46 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:48.579926 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 13fea0e467074bd185a6c07450057598 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:48.605021 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13fea0e467074bd185a6c07450057598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.610324 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e2322c978e431ab9ce24d58bf8177a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.619159 21299 raft_consensus.cc:359] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:48.619992 21299 raft_consensus.cc:385] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.620306 21299 raft_consensus.cc:740] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.621199 21299 consensus_queue.cc:260] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:48.624825 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90ab82e70de84e30bf72e4383c4309b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.627315 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d5cd05e2f349d8b1916f974171fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.631876 21300 raft_consensus.cc:359] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:48.633322 21300 raft_consensus.cc:385] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.621358 21301 raft_consensus.cc:359] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:48.637603 21301 raft_consensus.cc:385] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.637985 21301 raft_consensus.cc:740] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.638971 21301 consensus_queue.cc:260] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:48.644907 21279 heartbeater.cc:499] Master 127.14.41.126:36967 was elected leader, sending a full tablet report...
I20260709 13:19:48.647482 21093 tablet_service.cc:1511] Processing CreateTablet for tablet b1d5cd05e2f349d8b1916f974171fb46 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:48.650431 21015 tablet_service.cc:1511] Processing CreateTablet for tablet 20e2322c978e431ab9ce24d58bf8177a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:48.637075 21300 raft_consensus.cc:740] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.735150 21015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e2322c978e431ab9ce24d58bf8177a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.739735 21299 ts_tablet_manager.cc:1434] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.199s	user 0.009s	sys 0.011s
I20260709 13:19:48.730578 21302 tablet_bootstrap.cc:492] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:48.743862 21308 raft_consensus.cc:493] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.751411 21300 consensus_queue.cc:260] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:48.754493 21094 tablet_service.cc:1511] Processing CreateTablet for tablet ae9de470b5d74977809dc2668fa67ae3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:48.756191 21163 tablet_service.cc:1511] Processing CreateTablet for tablet ae9de470b5d74977809dc2668fa67ae3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:48.757649 21019 tablet_service.cc:1511] Processing CreateTablet for tablet ae9de470b5d74977809dc2668fa67ae3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:48.763110 21093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d5cd05e2f349d8b1916f974171fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.766129 21241 tablet_service.cc:1511] Processing CreateTablet for tablet b1d5cd05e2f349d8b1916f974171fb46 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:48.767603 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d5cd05e2f349d8b1916f974171fb46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.767894 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9de470b5d74977809dc2668fa67ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.766681 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9de470b5d74977809dc2668fa67ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.778455 21164 tablet_service.cc:1511] Processing CreateTablet for tablet 95a91f1d3cda4e78b61f1817a855f249 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:48.782073 21239 tablet_service.cc:1511] Processing CreateTablet for tablet 18db2aafa5c048e98de27e15a5df6e61 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:48.783581 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18db2aafa5c048e98de27e15a5df6e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.769577 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae9de470b5d74977809dc2668fa67ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.769806 21308 raft_consensus.cc:515] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:48.790786 21308 leader_election.cc:290] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:48.771719 21301 ts_tablet_manager.cc:1434] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.259s	user 0.009s	sys 0.013s
I20260709 13:19:48.764653 21302 ts_tablet_manager.cc:1403] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.339s	user 0.010s	sys 0.012s
I20260709 13:19:48.776721 21299 tablet_bootstrap.cc:492] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:48.775436 21020 tablet_service.cc:1511] Processing CreateTablet for tablet 18db2aafa5c048e98de27e15a5df6e61 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:48.797031 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18db2aafa5c048e98de27e15a5df6e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.799603 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a91f1d3cda4e78b61f1817a855f249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.816488 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 95a91f1d3cda4e78b61f1817a855f249 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
W20260709 13:19:48.814965 21057 tablet.cc:2406] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:48.815536 21301 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:48.825788 21302 raft_consensus.cc:359] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:48.826247 21299 tablet_bootstrap.cc:654] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.826586 21302 raft_consensus.cc:385] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.827029 21302 raft_consensus.cc:740] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.827837 21302 consensus_queue.cc:260] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:48.839881 21300 ts_tablet_manager.cc:1434] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.246s	user 0.016s	sys 0.033s
I20260709 13:19:48.841074 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a91f1d3cda4e78b61f1817a855f249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.841415 21300 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:48.851432 21019 tablet_service.cc:1511] Processing CreateTablet for tablet 3f74fadf9cfd46a09de882208a769f0f (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:48.853169 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f74fadf9cfd46a09de882208a769f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.856290 21091 tablet_service.cc:1511] Processing CreateTablet for tablet 18db2aafa5c048e98de27e15a5df6e61 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:48.857096 21092 tablet_service.cc:1511] Processing CreateTablet for tablet ed16ebc062ff4ee69c7071f6af842713 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:48.857779 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18db2aafa5c048e98de27e15a5df6e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.859081 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed16ebc062ff4ee69c7071f6af842713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.877810 21169 tablet_service.cc:1511] Processing CreateTablet for tablet ed16ebc062ff4ee69c7071f6af842713 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:48.879382 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed16ebc062ff4ee69c7071f6af842713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.882411 21309 raft_consensus.cc:493] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.883009 21309 raft_consensus.cc:515] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:48.886044 21088 tablet_service.cc:1511] Processing CreateTablet for tablet 3f74fadf9cfd46a09de882208a769f0f (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:48.882617 21300 tablet_bootstrap.cc:654] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.897603 21162 tablet_service.cc:1511] Processing CreateTablet for tablet 3f74fadf9cfd46a09de882208a769f0f (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:48.897634 21016 tablet_service.cc:1511] Processing CreateTablet for tablet 9f647f71210440f2b1c7811406423646 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:48.899281 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f74fadf9cfd46a09de882208a769f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.899364 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f647f71210440f2b1c7811406423646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.900936 21309 leader_election.cc:290] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:48.907122 21088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f74fadf9cfd46a09de882208a769f0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.914817 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:48.917012 21069 leader_election.cc:343] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.946982 21167 tablet_service.cc:1511] Processing CreateTablet for tablet 07889753a7dd4a42b31d46ef6a693f98 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:48.951128 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07889753a7dd4a42b31d46ef6a693f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.952121 21087 tablet_service.cc:1511] Processing CreateTablet for tablet 9f647f71210440f2b1c7811406423646 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:48.953640 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f647f71210440f2b1c7811406423646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.955585 21302 ts_tablet_manager.cc:1434] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.161s	user 0.017s	sys 0.003s
I20260709 13:19:48.956837 21302 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:48.964855 21237 tablet_service.cc:1511] Processing CreateTablet for tablet ed16ebc062ff4ee69c7071f6af842713 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:48.966892 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed16ebc062ff4ee69c7071f6af842713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.971966 21244 tablet_service.cc:1511] Processing CreateTablet for tablet 9f647f71210440f2b1c7811406423646 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:48.973973 21244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f647f71210440f2b1c7811406423646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.977660 21241 tablet_service.cc:1511] Processing CreateTablet for tablet 95a91f1d3cda4e78b61f1817a855f249 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:48.978718 21014 tablet_service.cc:1511] Processing CreateTablet for tablet 07889753a7dd4a42b31d46ef6a693f98 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:48.979549 21299 tablet_bootstrap.cc:492] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:48.980079 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07889753a7dd4a42b31d46ef6a693f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:48.980074 21299 ts_tablet_manager.cc:1403] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.204s	user 0.009s	sys 0.007s
I20260709 13:19:48.984022 21299 raft_consensus.cc:359] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:48.964394 21301 tablet_bootstrap.cc:654] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.979239 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95a91f1d3cda4e78b61f1817a855f249. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.002789 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:48.987458 21299 raft_consensus.cc:385] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:49.006270 21071 leader_election.cc:343] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.006947 21071 leader_election.cc:304] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:49.008186 21308 raft_consensus.cc:2749] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.005753 21300 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:49.009555 21300 ts_tablet_manager.cc:1403] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.168s	user 0.011s	sys 0.005s
I20260709 13:19:49.015956 21302 tablet_bootstrap.cc:654] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.019946 21239 tablet_service.cc:1511] Processing CreateTablet for tablet 07889753a7dd4a42b31d46ef6a693f98 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:49.021435 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07889753a7dd4a42b31d46ef6a693f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.022338 21243 tablet_service.cc:1511] Processing CreateTablet for tablet 06e0d65d4b8e468085b0a5a2d280c36c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:49.006268 21299 raft_consensus.cc:740] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.023706 21243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e0d65d4b8e468085b0a5a2d280c36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.024329 21299 consensus_queue.cc:260] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.026659 21299 ts_tablet_manager.cc:1434] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:19:49.030325 21164 tablet_service.cc:1511] Processing CreateTablet for tablet 06e0d65d4b8e468085b0a5a2d280c36c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:49.031705 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e0d65d4b8e468085b0a5a2d280c36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.033725 21092 tablet_service.cc:1511] Processing CreateTablet for tablet 06e0d65d4b8e468085b0a5a2d280c36c (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:49.039510 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e0d65d4b8e468085b0a5a2d280c36c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.043325 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf371fb66e4871bfbcf50de978af7d" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:49.045220 21300 raft_consensus.cc:359] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.046051 21300 raft_consensus.cc:385] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:49.046227 20994 leader_election.cc:343] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.046440 21300 raft_consensus.cc:740] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.047719 21300 consensus_queue.cc:260] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.048477 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf371fb66e4871bfbcf50de978af7d" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
W20260709 13:19:49.050673 20996 leader_election.cc:343] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.051218 20996 leader_election.cc:304] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:49.052099 21309 raft_consensus.cc:2749] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.053809 21300 ts_tablet_manager.cc:1434] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:19:49.054906 21300 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:49.063166 21019 tablet_service.cc:1511] Processing CreateTablet for tablet 62cd665cde99440fbd2d8bbd52fbadec (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:49.064816 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cd665cde99440fbd2d8bbd52fbadec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.078172 21299 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:49.079528 21300 tablet_bootstrap.cc:654] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.088063 21299 tablet_bootstrap.cc:654] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.089507 21088 tablet_service.cc:1511] Processing CreateTablet for tablet 62cd665cde99440fbd2d8bbd52fbadec (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:49.091790 21088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cd665cde99440fbd2d8bbd52fbadec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.093983 21310 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.096801 21301 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:49.100139 21310 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.102246 21163 tablet_service.cc:1511] Processing CreateTablet for tablet 62cd665cde99440fbd2d8bbd52fbadec (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:49.103739 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62cd665cde99440fbd2d8bbd52fbadec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:49.106810 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:49.104882 21301 ts_tablet_manager.cc:1403] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.290s	user 0.013s	sys 0.007s
I20260709 13:19:49.111953 21301 raft_consensus.cc:359] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.103250 21310 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:49.133577 21310 raft_consensus.cc:493] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.134121 21310 raft_consensus.cc:515] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.123893 21301 raft_consensus.cc:385] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.135764 21301 raft_consensus.cc:740] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.136978 21301 consensus_queue.cc:260] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.138656 21167 tablet_service.cc:1511] Processing CreateTablet for tablet f389bd24ad6943419686b3110e876624 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:49.140962 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f389bd24ad6943419686b3110e876624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.144578 21087 tablet_service.cc:1511] Processing CreateTablet for tablet 8297f1726bad4a5dba767dc9d850ccb8 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:49.148296 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8297f1726bad4a5dba767dc9d850ccb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.144526 21014 tablet_service.cc:1511] Processing CreateTablet for tablet 8297f1726bad4a5dba767dc9d850ccb8 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:49.151021 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8297f1726bad4a5dba767dc9d850ccb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.151263 21302 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:49.151849 21302 ts_tablet_manager.cc:1403] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.014s
I20260709 13:19:49.155220 21302 raft_consensus.cc:359] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.156018 21302 raft_consensus.cc:385] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.156309 21302 raft_consensus.cc:740] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.157616 21310 leader_election.cc:290] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:49.158453 21302 consensus_queue.cc:260] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.159739 21299 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:49.157593 21301 ts_tablet_manager.cc:1434] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:19:49.166774 21301 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:49.166888 21016 tablet_service.cc:1511] Processing CreateTablet for tablet f389bd24ad6943419686b3110e876624 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:49.168390 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f389bd24ad6943419686b3110e876624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.168871 21094 tablet_service.cc:1511] Processing CreateTablet for tablet c0670515d5ba47de932640b46e77d7f3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:49.170173 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0670515d5ba47de932640b46e77d7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.172067 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 4e82b5b2abd94e6587289f0201891e8b (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:49.166888 21244 tablet_service.cc:1511] Processing CreateTablet for tablet f389bd24ad6943419686b3110e876624 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:49.173854 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e82b5b2abd94e6587289f0201891e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.174503 21244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f389bd24ad6943419686b3110e876624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.177600 21241 tablet_service.cc:1511] Processing CreateTablet for tablet c0670515d5ba47de932640b46e77d7f3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:49.179018 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0670515d5ba47de932640b46e77d7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.185930 21302 ts_tablet_manager.cc:1434] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.003s
I20260709 13:19:49.187093 21302 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:49.188112 21162 tablet_service.cc:1511] Processing CreateTablet for tablet c0670515d5ba47de932640b46e77d7f3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:49.192575 21300 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:49.193226 21300 ts_tablet_manager.cc:1403] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.005s
I20260709 13:19:49.193670 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0670515d5ba47de932640b46e77d7f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.189047 21299 ts_tablet_manager.cc:1403] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.111s	user 0.023s	sys 0.008s
I20260709 13:19:49.200436 21299 raft_consensus.cc:359] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.228847 21299 raft_consensus.cc:385] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.196403 21300 raft_consensus.cc:359] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.189616 21239 tablet_service.cc:1511] Processing CreateTablet for tablet 8297f1726bad4a5dba767dc9d850ccb8 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:49.230007 21300 raft_consensus.cc:385] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.230389 21300 raft_consensus.cc:740] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.230774 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8297f1726bad4a5dba767dc9d850ccb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.219384 21243 tablet_service.cc:1511] Processing CreateTablet for tablet 157364afaee148b998ca48df7e81225e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:49.230949 21087 tablet_service.cc:1511] Processing CreateTablet for tablet 4e82b5b2abd94e6587289f0201891e8b (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:49.231199 21300 consensus_queue.cc:260] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.232159 21243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157364afaee148b998ca48df7e81225e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.232297 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e82b5b2abd94e6587289f0201891e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.222008 21091 tablet_service.cc:1511] Processing CreateTablet for tablet 157364afaee148b998ca48df7e81225e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:49.231221 21237 tablet_service.cc:1511] Processing CreateTablet for tablet 230befbac66a43a5aad30976385b0944 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:49.234555 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230befbac66a43a5aad30976385b0944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.236016 21300 ts_tablet_manager.cc:1434] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 13:19:49.237174 21300 tablet_bootstrap.cc:492] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:49.222826 21301 tablet_bootstrap.cc:654] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.223119 21019 tablet_service.cc:1511] Processing CreateTablet for tablet 157364afaee148b998ca48df7e81225e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:49.224092 21163 tablet_service.cc:1511] Processing CreateTablet for tablet 4e82b5b2abd94e6587289f0201891e8b (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:49.227304 21164 tablet_service.cc:1511] Processing CreateTablet for tablet 230befbac66a43a5aad30976385b0944 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:49.247655 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230befbac66a43a5aad30976385b0944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.229497 21299 raft_consensus.cc:740] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.251539 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157364afaee148b998ca48df7e81225e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.253324 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e82b5b2abd94e6587289f0201891e8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.260040 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 157364afaee148b998ca48df7e81225e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.260541 21092 tablet_service.cc:1511] Processing CreateTablet for tablet d06f1aafd4c14193b9c2e305a7b38209 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:49.261332 21299 consensus_queue.cc:260] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.261938 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f1aafd4c14193b9c2e305a7b38209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.261874 21302 tablet_bootstrap.cc:654] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.271970 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:49.272241 21169 tablet_service.cc:1511] Processing CreateTablet for tablet d06f1aafd4c14193b9c2e305a7b38209 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:49.273686 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f1aafd4c14193b9c2e305a7b38209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.278996 21299 ts_tablet_manager.cc:1434] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.001s
I20260709 13:19:49.279124 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:49.281044 21299 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:49.281620 21315 raft_consensus.cc:493] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.282214 21315 raft_consensus.cc:515] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.292586 21308 raft_consensus.cc:493] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.293365 21315 leader_election.cc:290] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:49.293195 21308 raft_consensus.cc:515] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.325106 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 230befbac66a43a5aad30976385b0944 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:49.317564 21300 tablet_bootstrap.cc:654] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.332569 21016 tablet_service.cc:1511] Processing CreateTablet for tablet c9ec9a5e146a4779afbe72eb46e5c0c8 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:49.334652 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230befbac66a43a5aad30976385b0944. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.342669 21308 leader_election.cc:290] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:49.358017 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ec9a5e146a4779afbe72eb46e5c0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.361486 21094 tablet_service.cc:1511] Processing CreateTablet for tablet c9ec9a5e146a4779afbe72eb46e5c0c8 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:49.363015 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ec9a5e146a4779afbe72eb46e5c0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.373332 21241 tablet_service.cc:1511] Processing CreateTablet for tablet d06f1aafd4c14193b9c2e305a7b38209 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:49.375429 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06f1aafd4c14193b9c2e305a7b38209. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:49.376727 21219 leader_election.cc:343] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:49.377545 21219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 80723.6us
W20260709 13:19:49.378423 21219 leader_election.cc:343] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.384039 21299 tablet_bootstrap.cc:654] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.352972 21308 raft_consensus.cc:493] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.389427 21315 raft_consensus.cc:493] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.390183 21315 raft_consensus.cc:515] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.402756 21315 leader_election.cc:290] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:49.385095 21308 raft_consensus.cc:515] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.398399 21167 tablet_service.cc:1511] Processing CreateTablet for tablet c9ec9a5e146a4779afbe72eb46e5c0c8 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:49.404665 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ec9a5e146a4779afbe72eb46e5c0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.405313 21308 leader_election.cc:290] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:49.406111 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:49.408977 21071 leader_election.cc:343] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.420962 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f17fd17b854429c8d54b89098c0498e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:49.413542 21237 tablet_service.cc:1511] Processing CreateTablet for tablet b5ea23e9d27e4929a6b8615fc593610e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:49.424212 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ea23e9d27e4929a6b8615fc593610e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.423913 21014 tablet_service.cc:1511] Processing CreateTablet for tablet b5ea23e9d27e4929a6b8615fc593610e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:49.425314 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ea23e9d27e4929a6b8615fc593610e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.437739 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:49.440196 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
W20260709 13:19:49.442056 21219 leader_election.cc:343] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.442543 21219 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
W20260709 13:19:49.444494 21219 leader_election.cc:343] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.454708 21326 raft_consensus.cc:2749] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.449572 21219 leader_election.cc:304] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:49.461380 21326 raft_consensus.cc:2749] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.462630 21087 tablet_service.cc:1511] Processing CreateTablet for tablet b5ea23e9d27e4929a6b8615fc593610e (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:49.464394 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5ea23e9d27e4929a6b8615fc593610e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.465526 21301 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:49.473160 21301 ts_tablet_manager.cc:1403] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.307s	user 0.028s	sys 0.033s
W20260709 13:19:49.442358 21069 leader_election.cc:343] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.476490 21301 raft_consensus.cc:359] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.481176 21301 raft_consensus.cc:385] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.481612 21301 raft_consensus.cc:740] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.482849 21300 tablet_bootstrap.cc:492] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:49.482677 21301 consensus_queue.cc:260] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.483631 21300 ts_tablet_manager.cc:1403] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.247s	user 0.014s	sys 0.005s
I20260709 13:19:49.490499 21326 raft_consensus.cc:493] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.493312 21326 raft_consensus.cc:515] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.495674 21326 leader_election.cc:290] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:49.497627 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:49.499202 21219 leader_election.cc:343] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.500785 21239 tablet_service.cc:1511] Processing CreateTablet for tablet 69c0be6c701f4fae9083797282669fe3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:49.502755 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c0be6c701f4fae9083797282669fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.508234 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:49.509068 21105 raft_consensus.cc:2468] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:49.501820 21302 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:49.503400 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f8bda438ea43dfa50e131788b83ebd" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:49.499359 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:49.513566 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:49.514245 21302 ts_tablet_manager.cc:1403] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.327s	user 0.009s	sys 0.017s
I20260709 13:19:49.515161 21301 ts_tablet_manager.cc:1434] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 13:19:49.517719 21302 raft_consensus.cc:359] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.518569 21302 raft_consensus.cc:385] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.519248 21301 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
W20260709 13:19:49.522704 21145 leader_election.cc:343] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.523588 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f8bda438ea43dfa50e131788b83ebd" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
W20260709 13:19:49.526186 21146 leader_election.cc:343] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.527567 21300 raft_consensus.cc:359] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.528406 21300 raft_consensus.cc:385] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.528756 21300 raft_consensus.cc:740] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.524183 21162 tablet_service.cc:1511] Processing CreateTablet for tablet 69c0be6c701f4fae9083797282669fe3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:49.533479 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c0be6c701f4fae9083797282669fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.529737 21145 leader_election.cc:304] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:49.531503 21302 raft_consensus.cc:740] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.536334 21315 raft_consensus.cc:2804] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.536777 21315 raft_consensus.cc:493] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:49.536909 21145 leader_election.cc:343] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.537051 21302 consensus_queue.cc:260] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.529703 21300 consensus_queue.cc:260] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:49.537577 21219 leader_election.cc:343] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.538192 21326 raft_consensus.cc:493] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.538229 21219 leader_election.cc:304] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:49.537492 21145 leader_election.cc:304] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:49.534266 21014 tablet_service.cc:1511] Processing CreateTablet for tablet 69c0be6c701f4fae9083797282669fe3 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:49.537194 21315 raft_consensus.cc:3060] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.538853 21326 raft_consensus.cc:515] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.540776 21310 raft_consensus.cc:2749] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.541879 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69c0be6c701f4fae9083797282669fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.567636 21341 raft_consensus.cc:2749] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.569947 21309 raft_consensus.cc:493] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.570778 21309 raft_consensus.cc:515] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.576943 21315 raft_consensus.cc:515] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.578531 21163 tablet_service.cc:1511] Processing CreateTablet for tablet 8802f602125f45849d52951cb35a2e51 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:49.579095 21315 leader_election.cc:290] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:49.579218 21237 tablet_service.cc:1511] Processing CreateTablet for tablet 8802f602125f45849d52951cb35a2e51 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:49.579967 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8802f602125f45849d52951cb35a2e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.581367 21091 tablet_service.cc:1511] Processing CreateTablet for tablet 8802f602125f45849d52951cb35a2e51 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:49.581816 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8802f602125f45849d52951cb35a2e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.582674 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8802f602125f45849d52951cb35a2e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.582612 21309 leader_election.cc:290] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:49.583359 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547414adb8447f6989687a1f99ce241" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:49.584914 20994 leader_election.cc:343] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.585042 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:49.585770 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547414adb8447f6989687a1f99ce241" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
W20260709 13:19:49.587242 20996 leader_election.cc:343] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.587699 20996 leader_election.cc:304] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
W20260709 13:19:49.589231 21219 leader_election.cc:343] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.590065 21326 leader_election.cc:290] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:49.593709 21301 tablet_bootstrap.cc:654] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:49.596836 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 59970.3us
I20260709 13:19:49.598733 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:49.603107 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:49.603780 21106 raft_consensus.cc:3060] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.604885 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f17fd17b854429c8d54b89098c0498e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:49.606284 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
W20260709 13:19:49.608192 21072 leader_election.cc:343] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.608683 21072 leader_election.cc:304] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
W20260709 13:19:49.609884 21072 leader_election.cc:343] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.610306 21072 leader_election.cc:304] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:49.596405 21309 raft_consensus.cc:2749] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.610606 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 428efef8d3454b9f894a316ef6c5576a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:49.612648 21334 raft_consensus.cc:2749] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.613108 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428efef8d3454b9f894a316ef6c5576a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.615417 21300 ts_tablet_manager.cc:1434] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.131s	user 0.016s	sys 0.003s
I20260709 13:19:49.615809 21106 raft_consensus.cc:2468] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:49.610623 21299 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:49.616693 21308 raft_consensus.cc:2749] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.617954 21299 ts_tablet_manager.cc:1403] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.338s	user 0.021s	sys 0.002s
I20260709 13:19:49.622977 21091 tablet_service.cc:1511] Processing CreateTablet for tablet 428efef8d3454b9f894a316ef6c5576a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:49.624241 21300 tablet_bootstrap.cc:492] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:49.623884 21299 raft_consensus.cc:359] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.625044 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428efef8d3454b9f894a316ef6c5576a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.625352 21145 leader_election.cc:304] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:49.633858 21302 ts_tablet_manager.cc:1434] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.009s
I20260709 13:19:49.648770 21016 tablet_service.cc:1511] Processing CreateTablet for tablet 1c02b59a16cf441888ce492581a48536 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:49.649621 21302 tablet_bootstrap.cc:492] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:49.650206 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c02b59a16cf441888ce492581a48536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.640306 21239 tablet_service.cc:1511] Processing CreateTablet for tablet 1c02b59a16cf441888ce492581a48536 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:49.631042 21299 raft_consensus.cc:385] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.643273 21300 tablet_bootstrap.cc:654] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.656504 21340 raft_consensus.cc:2804] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.657199 21340 raft_consensus.cc:697] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:49.658209 21340 consensus_queue.cc:237] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:49.658457 21087 tablet_service.cc:1511] Processing CreateTablet for tablet 1c02b59a16cf441888ce492581a48536 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:49.659858 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c02b59a16cf441888ce492581a48536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.653478 21299 raft_consensus.cc:740] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
W20260709 13:19:49.662012 21145 leader_election.cc:343] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.661422 21299 consensus_queue.cc:260] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.674546 21309 raft_consensus.cc:493] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.675390 21302 tablet_bootstrap.cc:654] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.675092 21309 raft_consensus.cc:515] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.675935 21019 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7eae6372364e919b8c6f1a4d358a77 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:49.677326 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7eae6372364e919b8c6f1a4d358a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.674238 21237 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7eae6372364e919b8c6f1a4d358a77 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:49.680662 21299 ts_tablet_manager.cc:1434] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:19:49.680891 21309 leader_election.cc:290] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:49.681782 21299 tablet_bootstrap.cc:492] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:49.681682 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:49.682626 21106 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:49.683897 20996 leader_election.cc:304] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:49.684930 21309 raft_consensus.cc:2804] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.685448 21309 raft_consensus.cc:493] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.685920 21309 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.691354 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 10ac20c373724f3baf9ca9b75bc62765 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:49.692993 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ac20c373724f3baf9ca9b75bc62765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.653100 21239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c02b59a16cf441888ce492581a48536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.695808 21167 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7eae6372364e919b8c6f1a4d358a77 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:49.697328 21167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7eae6372364e919b8c6f1a4d358a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.697557 21163 tablet_service.cc:1511] Processing CreateTablet for tablet 428efef8d3454b9f894a316ef6c5576a (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:49.698979 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 428efef8d3454b9f894a316ef6c5576a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.694140 21299 tablet_bootstrap.cc:654] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.739900 21301 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:49.734695 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7eae6372364e919b8c6f1a4d358a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.740494 21301 ts_tablet_manager.cc:1403] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.222s	user 0.025s	sys 0.029s
I20260709 13:19:49.749284 21309 raft_consensus.cc:515] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.754066 21302 tablet_bootstrap.cc:492] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:49.754693 21302 ts_tablet_manager.cc:1403] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.017s
I20260709 13:19:49.757830 21162 tablet_service.cc:1511] Processing CreateTablet for tablet 10ac20c373724f3baf9ca9b75bc62765 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:49.758066 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:49.759260 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ac20c373724f3baf9ca9b75bc62765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.760298 21241 tablet_service.cc:1511] Processing CreateTablet for tablet 10ac20c373724f3baf9ca9b75bc62765 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:49.761664 21241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ac20c373724f3baf9ca9b75bc62765. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.762411 20927 catalog_manager.cc:5697] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.769510 21243 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebfe18bcecc49198cbf0d3721f65dc7 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:49.770753 21300 tablet_bootstrap.cc:492] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:49.771004 21243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebfe18bcecc49198cbf0d3721f65dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.771386 21300 ts_tablet_manager.cc:1403] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.149s	user 0.003s	sys 0.027s
I20260709 13:19:49.762858 21301 raft_consensus.cc:359] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.775024 21091 tablet_service.cc:1511] Processing CreateTablet for tablet bf91f39c6153492a8fd05d9918062caa (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 13:19:49.776257 21217 leader_election.cc:343] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.776953 21217 leader_election.cc:304] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:49.777840 21169 tablet_service.cc:1511] Processing CreateTablet for tablet bf91f39c6153492a8fd05d9918062caa (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:49.778191 21326 raft_consensus.cc:2749] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.778679 21014 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebfe18bcecc49198cbf0d3721f65dc7 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:49.779425 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf91f39c6153492a8fd05d9918062caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.779978 21014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebfe18bcecc49198cbf0d3721f65dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.781049 21302 raft_consensus.cc:359] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.781831 21302 raft_consensus.cc:385] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.781658 21016 tablet_service.cc:1511] Processing CreateTablet for tablet bf91f39c6153492a8fd05d9918062caa (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:49.782161 21302 raft_consensus.cc:740] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.783011 21302 consensus_queue.cc:260] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.789894 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:49.790656 21253 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:49.790887 21300 raft_consensus.cc:359] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.791555 21300 raft_consensus.cc:385] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.791858 21300 raft_consensus.cc:740] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.776424 21091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf91f39c6153492a8fd05d9918062caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.783025 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf91f39c6153492a8fd05d9918062caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.792702 21300 consensus_queue.cc:260] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.800004 21244 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc5ba4c765c48d49d6e392427a3303d (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:49.800966 21309 leader_election.cc:290] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:49.801482 21244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc5ba4c765c48d49d6e392427a3303d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.802592 21087 tablet_service.cc:1511] Processing CreateTablet for tablet 2ebfe18bcecc49198cbf0d3721f65dc7 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:49.804129 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:49.804754 21106 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.772796 21301 raft_consensus.cc:385] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.808956 21301 raft_consensus.cc:740] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.809738 21301 consensus_queue.cc:260] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.812088 21301 ts_tablet_manager.cc:1434] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.002s
I20260709 13:19:49.816798 21087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebfe18bcecc49198cbf0d3721f65dc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.818531 21106 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:49.822182 20996 leader_election.cc:304] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:49.823212 21309 raft_consensus.cc:2804] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.819926 21302 ts_tablet_manager.cc:1434] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.003s
I20260709 13:19:49.819628 21162 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc5ba4c765c48d49d6e392427a3303d (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:49.827293 21162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc5ba4c765c48d49d6e392427a3303d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.827524 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:49.828186 21253 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.820559 21300 ts_tablet_manager.cc:1434] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.004s
I20260709 13:19:49.825559 21302 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:49.829825 21301 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:49.844911 21300 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:49.848394 21012 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc5ba4c765c48d49d6e392427a3303d (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:49.850346 21012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc5ba4c765c48d49d6e392427a3303d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.866895 21299 tablet_bootstrap.cc:492] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:49.867543 21299 ts_tablet_manager.cc:1403] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.003s
I20260709 13:19:49.875427 21092 tablet_service.cc:1511] Processing CreateTablet for tablet a2fc8ae4e5ba4be69acf20c7759745ec (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:49.876853 21092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fc8ae4e5ba4be69acf20c7759745ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.878605 21242 tablet_service.cc:1511] Processing CreateTablet for tablet a2fc8ae4e5ba4be69acf20c7759745ec (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:49.879913 21242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fc8ae4e5ba4be69acf20c7759745ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.881047 21088 tablet_service.cc:1511] Processing CreateTablet for tablet 65a4c18f2b744dccb42a3da937d648f6 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:49.882381 21088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a4c18f2b744dccb42a3da937d648f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.882221 21164 tablet_service.cc:1511] Processing CreateTablet for tablet 65a4c18f2b744dccb42a3da937d648f6 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:49.883528 21164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a4c18f2b744dccb42a3da937d648f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.886900 21299 raft_consensus.cc:359] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.887719 21299 raft_consensus.cc:385] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.888041 21299 raft_consensus.cc:740] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.892083 21235 tablet_service.cc:1511] Processing CreateTablet for tablet 08de2d3846974898b85e48b736d45cd0 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:49.892917 21300 tablet_bootstrap.cc:654] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.892789 21169 tablet_service.cc:1511] Processing CreateTablet for tablet a2fc8ae4e5ba4be69acf20c7759745ec (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:49.893585 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08de2d3846974898b85e48b736d45cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.894200 21169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2fc8ae4e5ba4be69acf20c7759745ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.896879 21302 tablet_bootstrap.cc:654] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.941669 21299 consensus_queue.cc:260] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:49.946117 21350 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.946661 21350 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.947178 21309 raft_consensus.cc:697] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:49.949747 21299 ts_tablet_manager.cc:1434] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.082s	user 0.014s	sys 0.007s
W20260709 13:19:49.956321 20916 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.41.68:37887, user_credentials={real_user=slave}} blocked reactor thread for 53704.3us
I20260709 13:19:49.956658 21299 tablet_bootstrap.cc:492] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:49.948222 21309 consensus_queue.cc:237] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:49.958585 21094 tablet_service.cc:1511] Processing CreateTablet for tablet 08de2d3846974898b85e48b736d45cd0 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:49.960021 21094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08de2d3846974898b85e48b736d45cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.970721 21299 tablet_bootstrap.cc:654] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.021206 21326 raft_consensus.cc:493] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.021895 21326 raft_consensus.cc:515] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.022550 21163 tablet_service.cc:1511] Processing CreateTablet for tablet 317b739931ab4905ba1a212e8abe5207 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:50.022902 21016 tablet_service.cc:1511] Processing CreateTablet for tablet 65a4c18f2b744dccb42a3da937d648f6 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:50.024075 21163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317b739931ab4905ba1a212e8abe5207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.025585 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f17fd17b854429c8d54b89098c0498e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:50.025810 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:50.026336 21106 raft_consensus.cc:2468] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
W20260709 13:19:50.027437 20996 leader_election.cc:343] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.028249 21219 leader_election.cc:304] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:50.029274 21310 raft_consensus.cc:2804] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.029693 21310 raft_consensus.cc:493] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.030021 21310 raft_consensus.cc:3060] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.034360 21300 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:50.034953 21300 ts_tablet_manager.cc:1403] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.190s	user 0.020s	sys 0.002s
I20260709 13:19:50.036273 21340 raft_consensus.cc:493] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.036846 21340 raft_consensus.cc:515] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.037120 21019 tablet_service.cc:1511] Processing CreateTablet for tablet 08de2d3846974898b85e48b736d45cd0 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:50.038069 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f17fd17b854429c8d54b89098c0498e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.038769 21180 raft_consensus.cc:2468] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:50.039121 21340 leader_election.cc:290] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:50.040248 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.040851 21016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65a4c18f2b744dccb42a3da937d648f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.040966 21254 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:50.042418 21020 tablet_service.cc:1511] Processing CreateTablet for tablet 317b739931ab4905ba1a212e8abe5207 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:50.042780 21326 leader_election.cc:290] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:50.043819 21020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317b739931ab4905ba1a212e8abe5207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.044366 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.049499 21300 raft_consensus.cc:359] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:50.049978 21146 leader_election.cc:343] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.050217 21300 raft_consensus.cc:385] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.007529 21350 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:50.045267 20997 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:50.046350 21237 tablet_service.cc:1511] Processing CreateTablet for tablet 317b739931ab4905ba1a212e8abe5207 (DEFAULT_TABLE table=test-workload [id=109854c94cc24ec7a05d998d8782e150]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:50.053936 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317b739931ab4905ba1a212e8abe5207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.054188 21350 raft_consensus.cc:2804] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.054629 21350 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.054977 21350 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.050565 21300 raft_consensus.cc:740] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.062139 21253 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:50.063448 21308 raft_consensus.cc:493] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.064294 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:50.068993 21300 consensus_queue.cc:260] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.070590 21310 raft_consensus.cc:515] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.090333 21300 ts_tablet_manager.cc:1434] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:19:50.091553 21300 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:50.087103 21019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08de2d3846974898b85e48b736d45cd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.074553 21308 raft_consensus.cc:515] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:50.101397 21145 leader_election.cc:343] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.102038 21145 leader_election.cc:304] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:50.103410 21315 raft_consensus.cc:2749] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.104007 21350 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.109978 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:50.110656 21253 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.098560 21340 consensus_queue.cc:1048] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:19:50.118844 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.121847 21308 leader_election.cc:290] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:50.122331 21302 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:50.127068 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:50.128675 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.129451 21254 raft_consensus.cc:2468] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:50.129611 21350 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
W20260709 13:19:50.129477 20996 leader_election.cc:343] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.131974 21072 leader_election.cc:304] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:50.132892 21302 ts_tablet_manager.cc:1403] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.308s	user 0.024s	sys 0.019s
W20260709 13:19:50.120246 21145 consensus_peers.cc:597] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:50.134110 21300 tablet_bootstrap.cc:654] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:50.141261 21069 leader_election.cc:343] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.141435 21308 raft_consensus.cc:2804] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.141956 21308 raft_consensus.cc:493] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.142347 21308 raft_consensus.cc:3060] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.143960 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f17fd17b854429c8d54b89098c0498e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:50.144639 21180 raft_consensus.cc:3060] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.155321 21301 tablet_bootstrap.cc:654] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.157505 21310 leader_election.cc:290] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:50.160033 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f17fd17b854429c8d54b89098c0498e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:50.160745 21104 raft_consensus.cc:3060] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:50.161397 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:50.147161 20929 catalog_manager.cc:5697] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.183599 21180 raft_consensus.cc:2468] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:50.185289 21217 leader_election.cc:304] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:50.186395 21310 raft_consensus.cc:2804] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.187248 21310 raft_consensus.cc:697] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:50.187886 21253 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:50.188246 21310 consensus_queue.cc:237] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.189527 20997 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:50.190959 21350 raft_consensus.cc:2804] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.191460 21350 raft_consensus.cc:697] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:50.204093 21350 consensus_queue.cc:237] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.219534 21302 raft_consensus.cc:359] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.220494 21302 raft_consensus.cc:385] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.220791 21299 tablet_bootstrap.cc:492] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:50.221069 21300 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:50.221719 21299 ts_tablet_manager.cc:1403] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.265s	user 0.029s	sys 0.007s
I20260709 13:19:50.221763 21300 ts_tablet_manager.cc:1403] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.022s
I20260709 13:19:50.225905 21300 raft_consensus.cc:359] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.226826 21300 raft_consensus.cc:385] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.227320 21300 raft_consensus.cc:740] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.226609 21299 raft_consensus.cc:359] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.220901 21302 raft_consensus.cc:740] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.227841 21299 raft_consensus.cc:385] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.235795 21308 raft_consensus.cc:515] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.240391 21302 consensus_queue.cc:260] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.241019 21308 leader_election.cc:290] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:50.242122 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:50.234768 21299 raft_consensus.cc:740] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.242389 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:50.243165 21253 raft_consensus.cc:3060] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.243368 21299 consensus_queue.cc:260] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:50.243966 21069 leader_election.cc:343] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.245067 21302 ts_tablet_manager.cc:1434] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.001s
I20260709 13:19:50.245674 21299 ts_tablet_manager.cc:1434] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:19:50.246410 21302 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:50.246526 21299 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:50.250398 21104 raft_consensus.cc:2468] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:50.238263 21300 consensus_queue.cc:260] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.253475 20929 catalog_manager.cc:5697] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.262466 21300 ts_tablet_manager.cc:1434] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:19:50.263814 21300 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:50.267226 21299 tablet_bootstrap.cc:654] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.274223 21301 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:50.275034 21301 ts_tablet_manager.cc:1403] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.445s	user 0.003s	sys 0.031s
I20260709 13:19:50.275547 21302 tablet_bootstrap.cc:654] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.280076 21301 raft_consensus.cc:359] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.294610 21301 raft_consensus.cc:385] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.295085 21301 raft_consensus.cc:740] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.300230 21301 consensus_queue.cc:260] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.301714 21253 raft_consensus.cc:2468] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:50.305951 21300 tablet_bootstrap.cc:654] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.304471 21072 leader_election.cc:304] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:50.309983 21359 raft_consensus.cc:2804] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.311151 21359 raft_consensus.cc:697] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:50.312357 21359 consensus_queue.cc:237] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.313346 21302 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:50.333233 21302 ts_tablet_manager.cc:1403] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.008s
I20260709 13:19:50.318823 20928 catalog_manager.cc:5697] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.317904 21301 ts_tablet_manager.cc:1434] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 13:19:50.338436 21301 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:50.332243 21299 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:50.339398 21299 ts_tablet_manager.cc:1403] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.002s
I20260709 13:19:50.343022 21299 raft_consensus.cc:359] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.343917 21299 raft_consensus.cc:385] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.344310 21299 raft_consensus.cc:740] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.338085 21302 raft_consensus.cc:359] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.345201 21302 raft_consensus.cc:385] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.345552 21302 raft_consensus.cc:740] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.346590 21302 consensus_queue.cc:260] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.361675 21300 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:50.362267 21300 ts_tablet_manager.cc:1403] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.099s	user 0.030s	sys 0.033s
I20260709 13:19:50.363641 21301 tablet_bootstrap.cc:654] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.365387 21300 raft_consensus.cc:359] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.366214 21300 raft_consensus.cc:385] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.366485 21300 raft_consensus.cc:740] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.367605 21300 consensus_queue.cc:260] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.370152 21300 ts_tablet_manager.cc:1434] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:19:50.370464 20928 catalog_manager.cc:5697] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.371426 21300 tablet_bootstrap.cc:492] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:50.368208 21299 consensus_queue.cc:260] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.373126 21302 ts_tablet_manager.cc:1434] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 13:19:50.374459 21302 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:50.379292 21299 ts_tablet_manager.cc:1434] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:19:50.380981 21299 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:50.392398 21301 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:50.393100 21301 ts_tablet_manager.cc:1403] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.006s
I20260709 13:19:50.393430 21302 tablet_bootstrap.cc:654] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.396836 21300 tablet_bootstrap.cc:654] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.396539 21301 raft_consensus.cc:359] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.397703 21301 raft_consensus.cc:385] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.398134 21301 raft_consensus.cc:740] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.399055 21301 consensus_queue.cc:260] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.400854 21350 raft_consensus.cc:493] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.401541 21350 raft_consensus.cc:515] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.404548 21350 leader_election.cc:290] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:50.406476 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.407191 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:50.407204 21253 raft_consensus.cc:2468] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:50.407893 21106 raft_consensus.cc:2468] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:50.409075 20997 leader_election.cc:304] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:50.409935 21301 ts_tablet_manager.cc:1434] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:19:50.411128 21301 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:50.415580 21302 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:50.416924 21350 raft_consensus.cc:2804] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.417318 21302 ts_tablet_manager.cc:1403] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.006s
I20260709 13:19:50.417421 21350 raft_consensus.cc:493] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.417970 21350 raft_consensus.cc:3060] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.419178 21301 tablet_bootstrap.cc:654] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.421196 21302 raft_consensus.cc:359] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.422107 21302 raft_consensus.cc:385] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.422456 21302 raft_consensus.cc:740] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.423775 21299 tablet_bootstrap.cc:654] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.423427 21302 consensus_queue.cc:260] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.427510 21350 raft_consensus.cc:515] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.431484 21300 tablet_bootstrap.cc:492] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:50.431507 21301 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:50.432192 21300 ts_tablet_manager.cc:1403] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.006s
I20260709 13:19:50.432276 21301 ts_tablet_manager.cc:1403] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:19:50.435302 21300 raft_consensus.cc:359] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.435879 21302 ts_tablet_manager.cc:1434] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:19:50.436069 21300 raft_consensus.cc:385] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.436879 21300 raft_consensus.cc:740] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.437674 21300 consensus_queue.cc:260] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.438813 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:50.439445 21253 raft_consensus.cc:3060] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.439785 21300 ts_tablet_manager.cc:1434] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:19:50.440821 21300 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:50.447600 21300 tablet_bootstrap.cc:654] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.448437 21302 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:50.458630 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:50.461380 21106 raft_consensus.cc:3060] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.461958 21299 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:50.462697 21299 ts_tablet_manager.cc:1403] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.027s
I20260709 13:19:50.465898 21299 raft_consensus.cc:359] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.466728 21299 raft_consensus.cc:385] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.467039 21299 raft_consensus.cc:740] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.467931 21299 consensus_queue.cc:260] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.468776 21350 leader_election.cc:290] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:50.469632 21302 tablet_bootstrap.cc:654] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.469892 21301 raft_consensus.cc:359] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.470988 21301 raft_consensus.cc:385] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.471382 21301 raft_consensus.cc:740] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.456115 21253 raft_consensus.cc:2468] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:50.473865 20997 leader_election.cc:304] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:50.475117 21350 raft_consensus.cc:2804] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.477770 21350 raft_consensus.cc:697] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:50.479095 21350 consensus_queue.cc:237] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.482880 21302 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:50.483596 21302 ts_tablet_manager.cc:1403] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.006s
I20260709 13:19:50.484807 21299 ts_tablet_manager.cc:1434] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:19:50.487136 21106 raft_consensus.cc:2468] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:50.487203 21302 raft_consensus.cc:359] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.488336 21302 raft_consensus.cc:385] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.488756 21302 raft_consensus.cc:740] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.489652 21302 consensus_queue.cc:260] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.484275 21301 consensus_queue.cc:260] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.493235 21301 ts_tablet_manager.cc:1434] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:19:50.494585 21299 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:50.495069 21301 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:50.495898 21302 ts_tablet_manager.cc:1434] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:19:50.497067 21302 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:50.501580 21300 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:50.502184 21300 ts_tablet_manager.cc:1403] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.037s
I20260709 13:19:50.502110 21359 raft_consensus.cc:493] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.502938 21359 raft_consensus.cc:515] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.506767 21299 tablet_bootstrap.cc:654] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.507108 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf371fb66e4871bfbcf50de978af7d" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.507851 21180 raft_consensus.cc:2468] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:50.508371 21340 raft_consensus.cc:493] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.508929 21340 raft_consensus.cc:515] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.509250 21069 leader_election.cc:304] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:50.510396 21308 raft_consensus.cc:2804] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.510834 21308 raft_consensus.cc:493] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.510265 20927 catalog_manager.cc:5697] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.511312 21359 leader_election.cc:290] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:50.513604 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf371fb66e4871bfbcf50de978af7d" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:50.514005 21301 tablet_bootstrap.cc:654] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.514707 21300 raft_consensus.cc:359] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.515520 21300 raft_consensus.cc:385] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.515790 21300 raft_consensus.cc:740] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.516685 21300 consensus_queue.cc:260] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.517591 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:50.522056 21145 leader_election.cc:343] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.511209 21308 raft_consensus.cc:3060] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.524022 21300 ts_tablet_manager.cc:1434] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:19:50.525247 21300 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:50.514405 21031 raft_consensus.cc:2468] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:50.527248 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:50.527776 21310 raft_consensus.cc:493] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.528302 21310 raft_consensus.cc:515] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.528856 21301 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:50.528106 21106 raft_consensus.cc:2468] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:50.529711 21301 ts_tablet_manager.cc:1403] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.004s
I20260709 13:19:50.530932 21350 raft_consensus.cc:493] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.531576 21310 leader_election.cc:290] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:50.531502 21350 raft_consensus.cc:515] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.546478 21350 leader_election.cc:290] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:50.532358 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01db0747d94dc08454b218e6dca7be" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:50.548413 21217 leader_election.cc:343] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.549091 21302 tablet_bootstrap.cc:654] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.532769 21326 raft_consensus.cc:493] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.550009 21326 raft_consensus.cc:515] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.533447 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01db0747d94dc08454b218e6dca7be" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:50.534631 21315 raft_consensus.cc:493] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.536430 21300 tablet_bootstrap.cc:654] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.537276 21145 leader_election.cc:304] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:50.511147 21340 leader_election.cc:290] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:50.538633 21308 raft_consensus.cc:515] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.555014 21315 raft_consensus.cc:515] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.542737 21301 raft_consensus.cc:359] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.543860 21309 consensus_queue.cc:1048] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.558831 21299 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:50.558964 21308 leader_election.cc:290] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:50.556950 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.560180 21326 leader_election.cc:290] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:50.559360 21299 ts_tablet_manager.cc:1403] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.003s
I20260709 13:19:50.560006 21253 raft_consensus.cc:2468] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:50.558040 21315 leader_election.cc:290] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:50.561427 21340 raft_consensus.cc:2804] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.562141 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.556550 21301 raft_consensus.cc:385] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.564466 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.566073 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:50.568590 21301 raft_consensus.cc:740] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.572057 21301 consensus_queue.cc:260] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.575279 21301 ts_tablet_manager.cc:1434] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:19:50.575682 21302 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:50.576521 21302 ts_tablet_manager.cc:1403] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.002s
I20260709 13:19:50.576525 21301 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:50.580861 21180 raft_consensus.cc:2468] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:50.585770 21299 raft_consensus.cc:359] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.586877 21302 raft_consensus.cc:359] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.567740 21340 raft_consensus.cc:493] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.589493 21340 raft_consensus.cc:3060] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.589726 20997 leader_election.cc:304] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:50.591115 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf371fb66e4871bfbcf50de978af7d" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:50.588196 21302 raft_consensus.cc:385] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.587316 21252 raft_consensus.cc:2468] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:50.592284 21179 raft_consensus.cc:3060] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.592729 21326 raft_consensus.cc:493] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.593411 21145 leader_election.cc:343] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.593319 21326 raft_consensus.cc:515] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.594436 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.595166 21180 raft_consensus.cc:2468] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:50.596442 21326 leader_election.cc:290] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:50.591106 21217 leader_election.cc:304] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:50.598078 21308 raft_consensus.cc:493] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.598790 21310 raft_consensus.cc:2804] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.598645 21308 raft_consensus.cc:515] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.587987 21299 raft_consensus.cc:385] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.597636 21146 leader_election.cc:304] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:50.599591 21299 raft_consensus.cc:740] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.599413 21350 consensus_queue.cc:1048] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.599278 21310 raft_consensus.cc:493] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.602823 21310 raft_consensus.cc:3060] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.601022 21315 raft_consensus.cc:2804] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.603624 21315 raft_consensus.cc:493] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.604071 21315 raft_consensus.cc:3060] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.604171 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f8bda438ea43dfa50e131788b83ebd" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.605053 21178 raft_consensus.cc:2468] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:50.591384 21382 raft_consensus.cc:2804] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.606225 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f8bda438ea43dfa50e131788b83ebd" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.606832 21382 raft_consensus.cc:493] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.607149 21252 raft_consensus.cc:2468] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:50.607286 21382 raft_consensus.cc:3060] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.589046 21301 tablet_bootstrap.cc:654] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.608847 21072 leader_election.cc:304] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:50.611193 21359 raft_consensus.cc:2804] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.611572 21359 raft_consensus.cc:493] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.611944 21359 raft_consensus.cc:3060] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.613667 21300 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:50.614290 21300 ts_tablet_manager.cc:1403] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.012s
W20260709 13:19:50.614970 21219 leader_election.cc:343] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.615478 21219 leader_election.cc:304] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:50.616300 21326 raft_consensus.cc:2749] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.600530 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.609642 21308 leader_election.cc:290] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:50.617625 21299 consensus_queue.cc:260] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.609151 21302 raft_consensus.cc:740] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.625681 21315 raft_consensus.cc:515] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.629899 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:50.630820 21252 raft_consensus.cc:3060] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.632797 21302 consensus_queue.cc:260] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.641724 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1cf371fb66e4871bfbcf50de978af7d" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:50.642390 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:50.642553 21031 raft_consensus.cc:3060] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.646457 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:50.648279 20996 consensus_peers.cc:597] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:50.654685 21219 leader_election.cc:343] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.657608 21180 raft_consensus.cc:2393] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:50.664858 21217 leader_election.cc:304] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:50.657912 21310 raft_consensus.cc:515] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.672206 21310 leader_election.cc:290] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:50.682595 21300 raft_consensus.cc:359] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.684383 21300 raft_consensus.cc:385] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.684882 21300 raft_consensus.cc:740] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.666014 21382 raft_consensus.cc:515] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.691610 21300 consensus_queue.cc:260] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.693881 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:50.696060 21350 raft_consensus.cc:493] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.696416 21180 raft_consensus.cc:3060] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.696985 21350 raft_consensus.cc:515] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.694006 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:50.689553 21315 leader_election.cc:290] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:50.699371 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:50.700021 21350 leader_election.cc:290] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:50.699635 21315 raft_consensus.cc:493] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.701016 21315 raft_consensus.cc:515] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.701339 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.702219 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbecd21568da4cba91bf43b4ce59a28c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:50.705500 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01db0747d94dc08454b218e6dca7be" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.705637 20996 leader_election.cc:304] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:50.706568 21253 raft_consensus.cc:2468] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:50.706712 21350 raft_consensus.cc:2749] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:50.707674 21145 leader_election.cc:343] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.708475 21315 leader_election.cc:290] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:50.710985 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01db0747d94dc08454b218e6dca7be" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:50.712806 21145 leader_election.cc:343] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.713258 21252 raft_consensus.cc:2468] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:50.715062 21031 raft_consensus.cc:2468] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:50.714931 21146 leader_election.cc:304] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:50.716861 21359 raft_consensus.cc:515] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.664363 21340 raft_consensus.cc:515] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.718962 21299 ts_tablet_manager.cc:1434] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.156s	user 0.011s	sys 0.029s
I20260709 13:19:50.723969 21301 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:50.724536 21301 ts_tablet_manager.cc:1403] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.148s	user 0.032s	sys 0.026s
I20260709 13:19:50.719075 21326 raft_consensus.cc:2749] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.727988 21179 raft_consensus.cc:2468] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:50.729038 21300 ts_tablet_manager.cc:1434] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.114s	user 0.011s	sys 0.000s
I20260709 13:19:50.729681 21299 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:50.731299 21301 raft_consensus.cc:359] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.732308 21301 raft_consensus.cc:385] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.732843 21301 raft_consensus.cc:740] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.733867 21301 consensus_queue.cc:260] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.735460 21071 leader_election.cc:304] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:50.737397 21300 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:50.724996 21030 raft_consensus.cc:2393] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 1: Already voted for candidate 1d804ce9949645b19a0ccc1faf258ec7 in this term.
I20260709 13:19:50.738468 21301 ts_tablet_manager.cc:1434] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:19:50.745313 21302 ts_tablet_manager.cc:1434] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.168s	user 0.007s	sys 0.044s
I20260709 13:19:50.745030 21387 raft_consensus.cc:2804] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.732764 21315 raft_consensus.cc:2804] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.746156 21301 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:50.746376 21387 raft_consensus.cc:697] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:50.746572 21315 raft_consensus.cc:493] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.747030 21315 raft_consensus.cc:3060] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.747417 21387 consensus_queue.cc:237] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
W20260709 13:19:50.753153 21069 consensus_peers.cc:597] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:50.753196 21299 tablet_bootstrap.cc:654] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.755298 21359 leader_election.cc:290] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:50.732118 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
W20260709 13:19:50.758910 21145 leader_election.cc:343] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.759334 21382 leader_election.cc:290] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:50.760565 21300 tablet_bootstrap.cc:654] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.760349 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f8bda438ea43dfa50e131788b83ebd" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:50.762892 21253 raft_consensus.cc:3060] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.765499 21340 leader_election.cc:290] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:50.761005 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:50.761845 21315 raft_consensus.cc:515] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.767119 21251 raft_consensus.cc:2393] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in this term.
I20260709 13:19:50.766927 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1f8bda438ea43dfa50e131788b83ebd" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:50.766963 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e039db49ff4c319e42dc1783ed2045" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:50.770211 21302 tablet_bootstrap.cc:492] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:50.773455 21315 leader_election.cc:290] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:50.774753 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01db0747d94dc08454b218e6dca7be" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:50.775336 21028 raft_consensus.cc:3060] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.778507 21302 tablet_bootstrap.cc:654] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.783269 21301 tablet_bootstrap.cc:654] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.785390 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:50.786069 21104 raft_consensus.cc:3060] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.766369 21146 leader_election.cc:304] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:50.783901 21178 raft_consensus.cc:3060] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.788710 21326 consensus_queue.cc:1048] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.796384 21340 raft_consensus.cc:2804] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.806030 21340 raft_consensus.cc:697] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:50.807489 21340 consensus_queue.cc:237] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.810122 20997 leader_election.cc:304] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:50.811101 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd01db0747d94dc08454b218e6dca7be" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:50.816524 21180 raft_consensus.cc:2468] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:50.797374 21315 raft_consensus.cc:493] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.821346 21251 raft_consensus.cc:3060] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.829577 21300 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:50.832077 21217 leader_election.cc:304] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:50.824213 21382 raft_consensus.cc:2749] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.826843 21310 consensus_queue.cc:1048] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:50.833518 21253 raft_consensus.cc:2468] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:50.854645 21326 raft_consensus.cc:2804] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.834745 21299 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:50.856062 21299 ts_tablet_manager.cc:1403] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.022s
I20260709 13:19:50.848593 21104 raft_consensus.cc:2468] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:50.857844 21145 leader_election.cc:304] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:50.853055 21300 ts_tablet_manager.cc:1403] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.120s	user 0.022s	sys 0.022s
I20260709 13:19:50.859548 21391 raft_consensus.cc:2804] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.824975 21315 raft_consensus.cc:515] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.857878 21072 leader_election.cc:304] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:50.874617 21387 raft_consensus.cc:2804] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.875326 21387 raft_consensus.cc:697] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:50.876746 21391 raft_consensus.cc:697] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:50.877878 21391 consensus_queue.cc:237] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.871796 21350 consensus_queue.cc:1048] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:19:50.880127 21178 raft_consensus.cc:2468] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:50.874639 21301 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:50.881523 21301 ts_tablet_manager.cc:1403] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.136s	user 0.011s	sys 0.010s
I20260709 13:19:50.890295 21300 raft_consensus.cc:359] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.891215 21300 raft_consensus.cc:385] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.891549 21300 raft_consensus.cc:740] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.893015 21300 consensus_queue.cc:260] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.895790 21301 raft_consensus.cc:359] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.896970 21301 raft_consensus.cc:385] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.897303 21301 raft_consensus.cc:740] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.898130 21301 consensus_queue.cc:260] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:50.900118 21301 ts_tablet_manager.cc:1434] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:19:50.898334 21299 raft_consensus.cc:359] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.876313 21387 consensus_queue.cc:237] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.901396 21301 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:50.901592 21299 raft_consensus.cc:385] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.908805 21359 consensus_queue.cc:1048] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.909725 21028 raft_consensus.cc:2468] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:50.906420 21299 raft_consensus.cc:740] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.911583 21299 consensus_queue.cc:260] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:50.911841 21145 leader_election.cc:304] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:50.903496 21251 raft_consensus.cc:2468] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:50.913568 21300 ts_tablet_manager.cc:1434] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 13:19:50.923346 21300 tablet_bootstrap.cc:492] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:50.929188 21028 raft_consensus.cc:3060] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.933388 21390 raft_consensus.cc:2804] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.934000 21390 raft_consensus.cc:697] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:50.934873 21390 consensus_queue.cc:237] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.938115 21400 consensus_queue.cc:1048] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.944155 21302 tablet_bootstrap.cc:492] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:50.945204 21302 ts_tablet_manager.cc:1403] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.177s	user 0.033s	sys 0.011s
I20260709 13:19:50.952215 21299 ts_tablet_manager.cc:1434] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.096s	user 0.009s	sys 0.000s
I20260709 13:19:50.961223 21326 raft_consensus.cc:697] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:50.962853 21326 consensus_queue.cc:237] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:50.965286 21299 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:50.963274 20929 catalog_manager.cc:5697] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.966790 21400 raft_consensus.cc:493] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.985203 21400 raft_consensus.cc:515] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:50.989881 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:50.990060 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:50.984388 21300 tablet_bootstrap.cc:654] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.988277 21400 leader_election.cc:290] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
W20260709 13:19:51.003468 20997 leader_election.cc:343] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.004925 20994 leader_election.cc:343] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.005627 21398 log.cc:927] Time spent T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:51.005548 20994 leader_election.cc:304] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.006501 21301 tablet_bootstrap.cc:654] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.004933 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547414adb8447f6989687a1f99ce241" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.007582 21030 raft_consensus.cc:2468] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:51.004467 21299 tablet_bootstrap.cc:654] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.009029 21145 leader_election.cc:304] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:51.009984 21340 raft_consensus.cc:2804] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.010380 21340 raft_consensus.cc:493] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.010758 21340 raft_consensus.cc:3060] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.019054 21400 raft_consensus.cc:2749] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.035744 21315 leader_election.cc:290] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.038890 21302 raft_consensus.cc:359] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.039728 21302 raft_consensus.cc:385] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.040035 21302 raft_consensus.cc:740] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.040791 21302 consensus_queue.cc:260] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.042905 21302 ts_tablet_manager.cc:1434] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.001s
I20260709 13:19:51.045928 21350 consensus_queue.cc:1048] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.059680 21302 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:51.035203 21387 raft_consensus.cc:493] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.068470 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547414adb8447f6989687a1f99ce241" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.069279 21105 raft_consensus.cc:2468] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:51.064559 21315 raft_consensus.cc:493] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.083298 20929 catalog_manager.cc:5697] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.063674 21340 raft_consensus.cc:515] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.074445 21387 raft_consensus.cc:515] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.095419 21387 leader_election.cc:290] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.097596 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.099093 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547414adb8447f6989687a1f99ce241" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
W20260709 13:19:51.099443 21071 leader_election.cc:343] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.099797 21105 raft_consensus.cc:3060] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.085793 21315 raft_consensus.cc:515] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.102433 21315 leader_election.cc:290] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.106772 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.107376 21302 tablet_bootstrap.cc:654] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.097844 21340 leader_election.cc:290] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.108824 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.110281 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3547414adb8447f6989687a1f99ce241" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:51.110868 21105 raft_consensus.cc:2468] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:51.111016 21030 raft_consensus.cc:3060] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:51.112046 21072 leader_election.cc:343] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.116866 21410 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.117166 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.117434 21072 leader_election.cc:304] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:51.117856 21145 leader_election.cc:304] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:51.119977 21387 raft_consensus.cc:2749] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.120532 21340 raft_consensus.cc:2804] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.121044 21340 raft_consensus.cc:697] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:51.122195 21301 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:51.122792 21301 ts_tablet_manager.cc:1403] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.222s	user 0.019s	sys 0.010s
I20260709 13:19:51.122296 21340 consensus_queue.cc:237] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.124788 21146 leader_election.cc:304] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
W20260709 13:19:51.125136 21409 log.cc:927] Time spent T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:51.126174 21315 raft_consensus.cc:2749] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.081139 20927 catalog_manager.cc:5697] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.118520 21410 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.128010 21299 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:51.128539 21299 ts_tablet_manager.cc:1403] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.174s	user 0.003s	sys 0.016s
I20260709 13:19:51.130192 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.130612 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:51.132226 21217 leader_election.cc:343] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.132859 21219 leader_election.cc:343] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.133334 21219 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.133460 21301 raft_consensus.cc:359] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.134212 21301 raft_consensus.cc:385] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.134358 21401 raft_consensus.cc:2749] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.134507 21301 raft_consensus.cc:740] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.135394 21301 consensus_queue.cc:260] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.133503 21410 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.136878 21299 raft_consensus.cc:359] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.137746 21299 raft_consensus.cc:385] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.138095 21299 raft_consensus.cc:740] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.139261 21300 tablet_bootstrap.cc:492] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:51.139775 21300 ts_tablet_manager.cc:1403] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.217s	user 0.025s	sys 0.000s
I20260709 13:19:51.138978 21299 consensus_queue.cc:260] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.142174 21299 ts_tablet_manager.cc:1434] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:51.145155 21299 tablet_bootstrap.cc:492] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:51.142473 21300 raft_consensus.cc:359] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.143090 21030 raft_consensus.cc:2468] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:51.146521 21300 raft_consensus.cc:385] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.148630 21300 raft_consensus.cc:740] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.149485 21300 consensus_queue.cc:260] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.150800 21301 ts_tablet_manager.cc:1434] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:51.153571 21387 consensus_queue.cc:1048] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.154048 21301 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:51.163244 21299 tablet_bootstrap.cc:654] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:51.171986 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:51.173341 21300 ts_tablet_manager.cc:1434] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:19:51.173616 21387 consensus_queue.cc:1048] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.174589 21300 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:51.176225 21301 tablet_bootstrap.cc:654] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.181948 21302 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:51.182538 21302 ts_tablet_manager.cc:1403] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.005s
I20260709 13:19:51.185398 21300 tablet_bootstrap.cc:654] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.197752 21302 raft_consensus.cc:359] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.198807 21302 raft_consensus.cc:385] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.199213 21302 raft_consensus.cc:740] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.200889 21302 consensus_queue.cc:260] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.203193 21302 ts_tablet_manager.cc:1434] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:19:51.204545 21387 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.205271 21299 tablet_bootstrap.cc:492] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:51.205093 21387 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.206161 21299 ts_tablet_manager.cc:1403] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.009s
I20260709 13:19:51.209172 21299 raft_consensus.cc:359] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.209932 21299 raft_consensus.cc:385] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.210222 21299 raft_consensus.cc:740] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.210940 21299 consensus_queue.cc:260] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.213327 21299 ts_tablet_manager.cc:1434] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:19:51.214469 21299 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:51.214512 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.205204 20929 catalog_manager.cc:5697] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.216805 21400 raft_consensus.cc:493] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.217638 21400 raft_consensus.cc:515] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.222962 21387 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.226275 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.202917 20928 catalog_manager.cc:5697] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.228518 20928 catalog_manager.cc:5697] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.231328 20928 catalog_manager.cc:5697] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.233834 21400 leader_election.cc:290] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.205426 21302 tablet_bootstrap.cc:492] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:51.223176 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.235615 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d033c5d43dee4eaca81ac47cdb061f0b" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.237244 21254 raft_consensus.cc:2393] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:51.239835 20997 leader_election.cc:304] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.240267 21301 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:51.240815 21301 ts_tablet_manager.cc:1403] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.013s
I20260709 13:19:51.242208 21072 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:51.243584 21387 raft_consensus.cc:2749] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.244557 21400 raft_consensus.cc:3060] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.249660 21315 consensus_queue.cc:1048] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.252111 21301 raft_consensus.cc:359] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.252976 21301 raft_consensus.cc:385] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.253273 21301 raft_consensus.cc:740] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.256992 21301 consensus_queue.cc:260] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.260160 21301 ts_tablet_manager.cc:1434] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:19:51.260941 21382 raft_consensus.cc:493] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.261633 21382 raft_consensus.cc:515] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.267037 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.270752 21382 leader_election.cc:290] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:51.271745 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.272629 21302 tablet_bootstrap.cc:654] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.273025 21104 raft_consensus.cc:2393] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:51.274457 20996 leader_election.cc:304] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:51.277947 21301 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:51.276861 21350 raft_consensus.cc:3060] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.281104 21104 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.284504 21326 raft_consensus.cc:493] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.285143 21326 raft_consensus.cc:515] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.286909 21300 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:51.287405 21326 leader_election.cc:290] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:51.287461 21300 ts_tablet_manager.cc:1403] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.113s	user 0.034s	sys 0.003s
I20260709 13:19:51.289366 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.289754 21301 tablet_bootstrap.cc:654] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:51.291043 21217 leader_election.cc:343] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.291908 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.292625 21300 raft_consensus.cc:359] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.293001 21105 raft_consensus.cc:2468] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:51.293406 21300 raft_consensus.cc:385] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.293771 21300 raft_consensus.cc:740] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.294533 21300 consensus_queue.cc:260] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.295529 21219 leader_election.cc:304] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.297171 21400 raft_consensus.cc:2749] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.305914 21178 raft_consensus.cc:3060] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.308360 21350 raft_consensus.cc:2749] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.309103 21410 raft_consensus.cc:2804] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.315817 21300 ts_tablet_manager.cc:1434] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:19:51.321689 21300 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:51.317250 21410 raft_consensus.cc:493] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.327147 21410 raft_consensus.cc:3060] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.328019 21300 tablet_bootstrap.cc:654] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.329737 21387 consensus_queue.cc:1048] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.339709 21300 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:51.340299 21300 ts_tablet_manager.cc:1403] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 13:19:51.344506 21300 raft_consensus.cc:359] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.345458 21300 raft_consensus.cc:385] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.345759 21300 raft_consensus.cc:740] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.349022 21410 raft_consensus.cc:515] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.349459 21387 consensus_queue.cc:1048] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.350145 21300 consensus_queue.cc:260] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.364955 21300 ts_tablet_manager.cc:1434] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:19:51.365989 21300 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:51.351639 21326 raft_consensus.cc:493] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.358613 21391 consensus_queue.cc:1048] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.367635 21390 consensus_queue.cc:1048] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.368845 21326 raft_consensus.cc:515] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.372267 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:51.374003 21217 leader_election.cc:343] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.374092 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:51.375608 21219 leader_election.cc:343] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.376109 21219 leader_election.cc:304] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.377118 21401 raft_consensus.cc:2749] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.378175 21326 leader_election.cc:290] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.378515 21300 tablet_bootstrap.cc:654] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.284547 21299 tablet_bootstrap.cc:654] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.385572 21390 consensus_queue.cc:1048] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.393597 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:51.394335 21106 raft_consensus.cc:3060] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.395735 21300 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:51.396253 21300 ts_tablet_manager.cc:1403] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.007s
I20260709 13:19:51.399432 21300 raft_consensus.cc:359] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.400245 21300 raft_consensus.cc:385] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.400553 21300 raft_consensus.cc:740] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.401312 21300 consensus_queue.cc:260] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.403148 21326 consensus_queue.cc:1048] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.404533 21401 raft_consensus.cc:493] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.404732 21106 raft_consensus.cc:2468] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:51.405144 21401 raft_consensus.cc:515] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.406397 21300 ts_tablet_manager.cc:1434] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:51.407775 21401 leader_election.cc:290] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.407951 21300 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:51.411142 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.412954 21219 leader_election.cc:304] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
W20260709 13:19:51.414101 21219 leader_election.cc:343] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.414662 21401 raft_consensus.cc:2804] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.415884 21401 raft_consensus.cc:697] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:51.416853 21401 consensus_queue.cc:237] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.424754 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.428200 21391 consensus_queue.cc:1048] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.431078 21106 raft_consensus.cc:2468] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:51.448797 21340 consensus_queue.cc:1048] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.470798 21301 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:51.471309 21301 ts_tablet_manager.cc:1403] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.195s	user 0.040s	sys 0.051s
I20260709 13:19:51.474144 21301 raft_consensus.cc:359] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.474903 21301 raft_consensus.cc:385] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.475201 21301 raft_consensus.cc:740] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.477228 21219 leader_election.cc:304] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:51.481482 21326 raft_consensus.cc:2804] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.482379 21301 consensus_queue.cc:260] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.486153 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:51.487203 21300 tablet_bootstrap.cc:654] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:51.487949 21217 leader_election.cc:343] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.489717 21301 ts_tablet_manager.cc:1434] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:19:51.491241 21301 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:51.481923 21326 raft_consensus.cc:493] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.470676 21410 leader_election.cc:290] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:51.507526 21302 tablet_bootstrap.cc:492] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:51.508093 21302 ts_tablet_manager.cc:1403] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.303s	user 0.039s	sys 0.070s
I20260709 13:19:51.494241 21326 raft_consensus.cc:3060] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.511713 21302 raft_consensus.cc:359] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.522277 21302 raft_consensus.cc:385] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.522632 21302 raft_consensus.cc:740] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.525208 21302 consensus_queue.cc:260] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.540077 21301 tablet_bootstrap.cc:654] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.546669 21302 ts_tablet_manager.cc:1434] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:19:51.545758 21340 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.547957 21302 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:51.546885 21299 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:51.547565 21340 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
W20260709 13:19:51.549220 21439 log.cc:927] Time spent T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.003s
I20260709 13:19:51.550455 21340 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.548931 21299 ts_tablet_manager.cc:1403] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.335s	user 0.018s	sys 0.032s
I20260709 13:19:51.551030 21400 raft_consensus.cc:493] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.552881 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.552680 21400 raft_consensus.cc:515] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:51.557442 21145 leader_election.cc:343] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.559520 21299 raft_consensus.cc:359] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.560150 21315 raft_consensus.cc:493] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.560305 21299 raft_consensus.cc:385] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.564932 21315 raft_consensus.cc:515] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.567111 21400 leader_election.cc:290] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.557116 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.570287 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.571005 21252 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:51.562831 21299 raft_consensus.cc:740] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.571153 21326 raft_consensus.cc:515] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.567114 21315 leader_election.cc:290] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.573153 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.573426 20997 leader_election.cc:304] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:51.572407 20929 catalog_manager.cc:5697] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.574219 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.575052 21299 consensus_queue.cc:260] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:51.577893 21145 leader_election.cc:343] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.578020 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.578482 21145 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
W20260709 13:19:51.579732 21145 leader_election.cc:343] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.578135 21315 consensus_queue.cc:1048] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:51.580366 21340 raft_consensus.cc:2749] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.583842 21300 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:51.584364 21300 ts_tablet_manager.cc:1403] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.177s	user 0.017s	sys 0.006s
I20260709 13:19:51.585872 21105 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:51.574738 21400 raft_consensus.cc:2804] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.592198 21301 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:51.592788 21301 ts_tablet_manager.cc:1403] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.000s
W20260709 13:19:51.593209 21146 leader_election.cc:343] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.593907 21146 leader_election.cc:304] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:51.595535 21315 raft_consensus.cc:2749] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.595935 21410 consensus_queue.cc:1048] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.595553 21301 raft_consensus.cc:359] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.602028 21301 raft_consensus.cc:385] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.602646 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:51.603006 21301 raft_consensus.cc:740] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.603333 21106 raft_consensus.cc:3060] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.603499 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:51.598749 21400 raft_consensus.cc:493] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.604019 21301 consensus_queue.cc:260] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.606977 21299 ts_tablet_manager.cc:1434] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.001s
I20260709 13:19:51.608362 21299 tablet_bootstrap.cc:492] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:51.605060 21400 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:51.609906 21219 leader_election.cc:343] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.614919 21302 tablet_bootstrap.cc:654] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.618238 21300 raft_consensus.cc:359] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.621742 21301 ts_tablet_manager.cc:1434] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 13:19:51.622888 21301 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:51.629913 21301 tablet_bootstrap.cc:654] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.622032 21300 raft_consensus.cc:385] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.630558 21300 raft_consensus.cc:740] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.631887 21300 consensus_queue.cc:260] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.602376 21326 leader_election.cc:290] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.638907 21106 raft_consensus.cc:2468] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:51.649103 21400 raft_consensus.cc:515] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.659759 21219 leader_election.cc:304] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:51.660440 21400 leader_election.cc:290] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.650041 21300 ts_tablet_manager.cc:1434] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.065s	user 0.011s	sys 0.000s
I20260709 13:19:51.650828 21299 tablet_bootstrap.cc:654] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.661842 21300 tablet_bootstrap.cc:492] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:51.652020 21340 consensus_queue.cc:1048] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.654120 21302 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:51.663100 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:51.660981 21301 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:51.668082 21301 ts_tablet_manager.cc:1403] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.005s
I20260709 13:19:51.664291 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:51.684491 21106 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.687947 21301 raft_consensus.cc:359] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.689072 21301 raft_consensus.cc:385] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.689441 21301 raft_consensus.cc:740] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.690400 21301 consensus_queue.cc:260] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.668751 21300 tablet_bootstrap.cc:654] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.693112 21106 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:51.694398 20996 leader_election.cc:304] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:51.666945 21254 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.695492 21400 raft_consensus.cc:2804] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.696053 21400 raft_consensus.cc:697] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:51.696940 21400 consensus_queue.cc:237] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.667280 21302 ts_tablet_manager.cc:1403] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.006s
I20260709 13:19:51.703099 21302 raft_consensus.cc:359] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.704006 21302 raft_consensus.cc:385] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.667551 21326 raft_consensus.cc:2804] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.705394 21326 raft_consensus.cc:697] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:51.706599 21326 consensus_queue.cc:237] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.704329 21302 raft_consensus.cc:740] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.712621 21302 consensus_queue.cc:260] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.715627 21302 ts_tablet_manager.cc:1434] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:51.716732 21302 tablet_bootstrap.cc:492] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:51.718350 21350 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.718662 21310 raft_consensus.cc:493] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.719234 21350 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.722656 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.730350 21300 tablet_bootstrap.cc:492] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:51.726389 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.728735 21301 ts_tablet_manager.cc:1434] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 13:19:51.718551 21254 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
W20260709 13:19:51.730818 20996 leader_election.cc:343] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.732537 21301 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:51.731654 21180 raft_consensus.cc:2468] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:51.725154 21350 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:51.733973 20994 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:51.723327 21302 tablet_bootstrap.cc:654] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.719476 21310 raft_consensus.cc:515] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:51.736295 21310 leader_election.cc:290] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.730917 21300 ts_tablet_manager.cc:1403] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.000s
I20260709 13:19:51.737519 21350 raft_consensus.cc:2804] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.738018 21350 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.738364 21350 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.739449 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.739449 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.739888 21300 raft_consensus.cc:359] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.744837 21300 raft_consensus.cc:385] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:51.741254 21219 leader_election.cc:343] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.791460 21219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 50246.6us
I20260709 13:19:51.768225 21310 raft_consensus.cc:493] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.757691 21326 raft_consensus.cc:493] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.752731 21301 tablet_bootstrap.cc:654] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.793979 21310 raft_consensus.cc:515] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.794039 21326 raft_consensus.cc:515] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:51.794377 21219 leader_election.cc:343] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.795272 21219 leader_election.cc:304] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:51.747342 21299 tablet_bootstrap.cc:492] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:51.796429 21310 leader_election.cc:290] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.771438 21400 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.797070 21299 ts_tablet_manager.cc:1403] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.029s
I20260709 13:19:51.797406 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.797225 21400 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.791659 21300 raft_consensus.cc:740] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
W20260709 13:19:51.799132 21217 leader_election.cc:343] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.799988 21410 raft_consensus.cc:2749] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.800660 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.801308 21299 raft_consensus.cc:359] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.802011 21299 raft_consensus.cc:385] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.798983 21300 consensus_queue.cc:260] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:51.802243 20994 leader_election.cc:343] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.803241 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.803432 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.803615 21300 ts_tablet_manager.cc:1434] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.008s
I20260709 13:19:51.804054 21254 raft_consensus.cc:2468] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:51.804687 21300 tablet_bootstrap.cc:492] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:51.805637 20997 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.806610 21309 raft_consensus.cc:2804] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.806977 21309 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.807337 21309 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.807284 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.796452 21326 leader_election.cc:290] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:51.746243 21350 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.776350 21302 tablet_bootstrap.cc:492] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
W20260709 13:19:51.809227 21219 leader_election.cc:343] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.809508 21302 ts_tablet_manager.cc:1403] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.093s	user 0.015s	sys 0.004s
W20260709 13:19:51.810137 21219 leader_election.cc:343] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.811304 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:51.811546 21350 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:51.805749 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.812480 21302 raft_consensus.cc:359] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.814248 21302 raft_consensus.cc:385] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.814330 21031 raft_consensus.cc:2468] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
W20260709 13:19:51.813373 20996 leader_election.cc:343] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.810621 21219 leader_election.cc:304] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:51.814580 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:51.814855 21302 raft_consensus.cc:740] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.815523 21180 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.816421 21302 consensus_queue.cc:260] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.817756 21309 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.756675 20927 catalog_manager.cc:5697] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.820907 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:51.826078 21180 raft_consensus.cc:2468] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:51.827456 21326 raft_consensus.cc:2749] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.827940 21219 leader_election.cc:304] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.828871 21326 raft_consensus.cc:2804] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.802275 21299 raft_consensus.cc:740] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.829398 21326 raft_consensus.cc:493] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.829952 21326 raft_consensus.cc:3060] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:51.830416 20994 leader_election.cc:343] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.830137 21299 consensus_queue.cc:260] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.832373 20994 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:51.833244 21350 raft_consensus.cc:2804] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.767858 20926 catalog_manager.cc:5697] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.838912 21386 raft_consensus.cc:493] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.839727 21309 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.839495 21386 raft_consensus.cc:515] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.842793 21299 ts_tablet_manager.cc:1434] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:19:51.841810 21386 leader_election.cc:290] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.843757 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.844477 21180 raft_consensus.cc:2468] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:51.845016 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.845654 21069 leader_election.cc:304] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
W20260709 13:19:51.846623 21072 leader_election.cc:343] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.847267 21299 tablet_bootstrap.cc:492] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:51.846633 21386 raft_consensus.cc:2804] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.848534 21386 raft_consensus.cc:493] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.848896 21386 raft_consensus.cc:3060] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.848942 21391 raft_consensus.cc:493] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.849676 21391 raft_consensus.cc:515] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.851820 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:51.852478 21254 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.853600 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:51.855988 21391 leader_election.cc:290] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.857780 21302 ts_tablet_manager.cc:1434] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:19:51.859105 21302 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:51.857429 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.861073 21350 raft_consensus.cc:697] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:51.862002 21350 consensus_queue.cc:237] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.868921 21254 raft_consensus.cc:2468] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:51.873467 21146 leader_election.cc:304] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:51.876247 20997 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.879740 21302 tablet_bootstrap.cc:654] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.882056 21391 raft_consensus.cc:2749] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.880455 21326 raft_consensus.cc:515] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.889562 21326 leader_election.cc:290] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.894302 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
W20260709 13:19:51.895819 21217 leader_election.cc:343] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.896734 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:51.897433 21031 raft_consensus.cc:3060] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.856516 21400 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.901799 21300 tablet_bootstrap.cc:654] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.899456 21309 raft_consensus.cc:493] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.906350 21299 tablet_bootstrap.cc:654] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.899626 21310 consensus_queue.cc:1048] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:19:51.907502 21315 raft_consensus.cc:493] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.907672 21457 raft_consensus.cc:2804] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.908241 21457 raft_consensus.cc:697] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:51.908104 21315 raft_consensus.cc:515] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.911429 21315 leader_election.cc:290] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.912678 21386 raft_consensus.cc:515] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.913103 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:51.914662 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.916168 21254 raft_consensus.cc:2468] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:51.907186 21309 raft_consensus.cc:515] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.916718 21386 leader_election.cc:290] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.917098 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:51.917706 21180 raft_consensus.cc:3060] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.918227 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:51.918695 21302 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:51.919198 21302 ts_tablet_manager.cc:1403] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.000s
W20260709 13:19:51.919701 21072 leader_election.cc:343] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.914682 21031 raft_consensus.cc:2468] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:51.921135 21178 raft_consensus.cc:3060] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.921309 21219 leader_election.cc:304] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:51.922428 21310 raft_consensus.cc:2804] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.922780 21030 raft_consensus.cc:2468] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:51.924054 21146 leader_election.cc:304] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:51.924772 21310 raft_consensus.cc:697] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:51.925099 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:51.925719 21179 raft_consensus.cc:2468] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:51.925684 21310 consensus_queue.cc:237] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.926503 21402 raft_consensus.cc:2804] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.927008 21402 raft_consensus.cc:493] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.927448 21402 raft_consensus.cc:3060] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.927563 20994 leader_election.cc:304] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:51.930132 21309 leader_election.cc:290] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:51.930284 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:51.931237 21252 raft_consensus.cc:2468] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:51.921994 21302 raft_consensus.cc:359] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.936133 21302 raft_consensus.cc:385] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.936473 21302 raft_consensus.cc:740] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.937414 21301 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:51.937204 21302 consensus_queue.cc:260] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.937933 21301 ts_tablet_manager.cc:1403] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.206s	user 0.028s	sys 0.027s
I20260709 13:19:51.939422 21302 ts_tablet_manager.cc:1434] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:19:51.940392 21302 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:51.949352 21301 raft_consensus.cc:359] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.950143 21301 raft_consensus.cc:385] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.930680 21309 raft_consensus.cc:2804] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.950417 21301 raft_consensus.cc:740] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.950620 21309 raft_consensus.cc:493] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.953007 21301 consensus_queue.cc:260] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:51.954715 21301 ts_tablet_manager.cc:1434] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:19:51.952000 21309 raft_consensus.cc:3060] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.914682 21457 consensus_queue.cc:237] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.957355 21326 consensus_queue.cc:1048] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.965200 21300 tablet_bootstrap.cc:492] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:51.964972 21402 raft_consensus.cc:515] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:51.965715 21300 ts_tablet_manager.cc:1403] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.003s
I20260709 13:19:51.966331 21180 raft_consensus.cc:2468] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:51.955665 21301 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:51.972257 21069 leader_election.cc:304] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:51.979380 21386 raft_consensus.cc:2804] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.980399 21386 raft_consensus.cc:697] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:51.981787 21386 consensus_queue.cc:237] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:51.967298 21402 leader_election.cc:290] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:51.998045 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:51.998970 21252 raft_consensus.cc:3060] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.003726 21300 raft_consensus.cc:359] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.004819 21300 raft_consensus.cc:385] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.008908 21302 tablet_bootstrap.cc:654] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.005182 21300 raft_consensus.cc:740] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.009323 21301 tablet_bootstrap.cc:654] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.004195 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:52.017427 21457 raft_consensus.cc:493] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.018280 21457 raft_consensus.cc:515] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.024569 21299 tablet_bootstrap.cc:492] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:52.025151 21299 ts_tablet_manager.cc:1403] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.178s	user 0.026s	sys 0.028s
I20260709 13:19:52.026782 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:52.028075 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
W20260709 13:19:52.028313 20994 leader_election.cc:343] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.029371 21457 leader_election.cc:290] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
W20260709 13:19:52.033087 20996 leader_election.cc:343] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.037365 20928 catalog_manager.cc:5697] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.039618 21309 raft_consensus.cc:515] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.041829 21252 raft_consensus.cc:2468] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:52.038756 20928 catalog_manager.cc:5697] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.036137 21300 consensus_queue.cc:260] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.047325 21299 raft_consensus.cc:359] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.047932 21299 raft_consensus.cc:385] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.048197 21299 raft_consensus.cc:740] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.048906 21299 consensus_queue.cc:260] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.056288 21299 ts_tablet_manager.cc:1434] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:19:52.034901 20996 leader_election.cc:304] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.056249 21030 raft_consensus.cc:2393] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc329a3e3d74a618ce2b4749aaafec8 in current term 1: Already voted for candidate 1d804ce9949645b19a0ccc1faf258ec7 in this term.
I20260709 13:19:52.057600 21299 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:52.057788 21300 ts_tablet_manager.cc:1434] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.000s
I20260709 13:19:52.058764 21146 leader_election.cc:304] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:52.069226 21300 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:52.071383 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:52.069059 21391 raft_consensus.cc:2804] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.073056 21391 raft_consensus.cc:697] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:52.068162 21309 leader_election.cc:290] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:52.058367 20926 catalog_manager.cc:5697] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.066358 21457 raft_consensus.cc:2749] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.101148 21299 tablet_bootstrap.cc:654] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.102056 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:52.102931 21252 raft_consensus.cc:2393] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:52.098850 21391 consensus_queue.cc:237] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.111541 21300 tablet_bootstrap.cc:654] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.115204 21400 consensus_queue.cc:1048] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.137344 20929 catalog_manager.cc:5697] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.147090 21302 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:52.147620 21302 ts_tablet_manager.cc:1403] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.207s	user 0.030s	sys 0.003s
I20260709 13:19:52.145085 21326 raft_consensus.cc:493] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.151190 21326 raft_consensus.cc:515] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.153460 21326 leader_election.cc:290] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:52.156994 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c297a12f6a8d4cebb87de531c02e7944" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:52.157848 21302 raft_consensus.cc:359] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.158702 21302 raft_consensus.cc:385] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.158986 21302 raft_consensus.cc:740] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
W20260709 13:19:52.159281 21217 leader_election.cc:343] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.159970 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c297a12f6a8d4cebb87de531c02e7944" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.160684 21104 raft_consensus.cc:2468] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:52.161706 21302 consensus_queue.cc:260] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.162551 21219 leader_election.cc:304] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:52.164497 21302 ts_tablet_manager.cc:1434] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:19:52.166067 21302 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:52.168638 20994 leader_election.cc:304] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:52.168937 21326 raft_consensus.cc:2804] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.169386 21326 raft_consensus.cc:493] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.169725 21326 raft_consensus.cc:3060] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.172855 21400 raft_consensus.cc:2749] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.181614 21326 raft_consensus.cc:515] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.189383 20927 catalog_manager.cc:5697] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.201109 21326 leader_election.cc:290] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:52.202112 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c297a12f6a8d4cebb87de531c02e7944" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:52.202569 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c297a12f6a8d4cebb87de531c02e7944" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:52.204550 21104 raft_consensus.cc:3060] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:52.208083 21217 leader_election.cc:343] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.215268 21300 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:52.215761 21300 ts_tablet_manager.cc:1403] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.045s
W20260709 13:19:52.213629 21466 log.cc:927] Time spent T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:19:52.219480 21302 tablet_bootstrap.cc:654] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.231678 21301 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:52.232318 21301 ts_tablet_manager.cc:1403] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.277s	user 0.027s	sys 0.019s
I20260709 13:19:52.239323 21104 raft_consensus.cc:2468] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:52.241744 21219 leader_election.cc:304] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:52.242960 21326 raft_consensus.cc:2804] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.243474 21326 raft_consensus.cc:697] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:52.244283 21326 consensus_queue.cc:237] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.254210 21301 raft_consensus.cc:359] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.255735 21301 raft_consensus.cc:385] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.256336 21301 raft_consensus.cc:740] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.257579 21301 consensus_queue.cc:260] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.267114 21299 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:52.267922 21299 ts_tablet_manager.cc:1403] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.211s	user 0.023s	sys 0.000s
I20260709 13:19:52.273075 21300 raft_consensus.cc:359] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.276062 21300 raft_consensus.cc:385] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.276562 21300 raft_consensus.cc:740] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.275516 21301 ts_tablet_manager.cc:1434] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:19:52.278357 21301 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
W20260709 13:19:52.286358 21219 consensus_peers.cc:597] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:52.287819 21410 consensus_queue.cc:1048] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.290089 21299 raft_consensus.cc:359] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.290838 21299 raft_consensus.cc:385] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.291406 21299 raft_consensus.cc:740] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.292160 21299 consensus_queue.cc:260] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
W20260709 13:19:52.290942 20996 consensus_peers.cc:597] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:52.295346 21299 ts_tablet_manager.cc:1434] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
W20260709 13:19:52.296947 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:52.297205 21299 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:52.297722 21300 consensus_queue.cc:260] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.269966 21400 consensus_queue.cc:1048] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:19:52.301282 21300 ts_tablet_manager.cc:1434] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.085s	user 0.014s	sys 0.005s
I20260709 13:19:52.305385 21300 tablet_bootstrap.cc:492] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:52.312021 21302 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:52.312523 21302 ts_tablet_manager.cc:1403] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.147s	user 0.033s	sys 0.030s
I20260709 13:19:52.317071 21299 tablet_bootstrap.cc:654] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.321910 21300 tablet_bootstrap.cc:654] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.325670 20928 catalog_manager.cc:5697] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.333730 21302 raft_consensus.cc:359] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.334574 21302 raft_consensus.cc:385] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.334883 21302 raft_consensus.cc:740] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.329752 21301 tablet_bootstrap.cc:654] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.338977 21302 consensus_queue.cc:260] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.341344 21302 ts_tablet_manager.cc:1434] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:19:52.342554 21302 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:52.348824 21391 raft_consensus.cc:493] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.349454 21391 raft_consensus.cc:515] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.350872 21302 tablet_bootstrap.cc:654] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.351717 21391 leader_election.cc:290] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:52.354290 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:52.355252 21030 raft_consensus.cc:2393] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc329a3e3d74a618ce2b4749aaafec8 in current term 1: Already voted for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in this term.
I20260709 13:19:52.363849 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18c983bfb97d4996978143ed268649ca" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:52.365589 21299 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:52.366182 21299 ts_tablet_manager.cc:1403] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.009s
I20260709 13:19:52.366781 21146 leader_election.cc:304] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:52.369261 21299 raft_consensus.cc:359] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.370010 21391 raft_consensus.cc:3060] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.375903 21299 raft_consensus.cc:385] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.376330 21299 raft_consensus.cc:740] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.377038 21299 consensus_queue.cc:260] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.384263 21301 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:52.384871 21301 ts_tablet_manager.cc:1403] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.012s
I20260709 13:19:52.386049 21386 consensus_queue.cc:1048] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.387298 21301 raft_consensus.cc:359] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.387867 21301 raft_consensus.cc:385] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.388109 21301 raft_consensus.cc:740] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.390152 21302 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:52.390659 21302 ts_tablet_manager.cc:1403] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.006s
I20260709 13:19:52.394486 21302 raft_consensus.cc:359] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.395193 21302 raft_consensus.cc:385] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.395481 21302 raft_consensus.cc:740] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.396145 21302 consensus_queue.cc:260] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.390808 21326 consensus_queue.cc:1048] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:52.397782 21301 consensus_queue.cc:260] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.398317 21326 raft_consensus.cc:493] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.398944 21326 raft_consensus.cc:515] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.400226 21301 ts_tablet_manager.cc:1434] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:19:52.400466 21402 raft_consensus.cc:493] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.401245 21301 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:52.401072 21402 raft_consensus.cc:515] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.403208 21457 raft_consensus.cc:493] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.403512 21402 leader_election.cc:290] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:52.403733 21457 raft_consensus.cc:515] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.401582 21178 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.405481 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e2322c978e431ab9ce24d58bf8177a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:52.406023 21457 leader_election.cc:290] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.407733 21301 tablet_bootstrap.cc:654] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.407981 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.409624 21302 ts_tablet_manager.cc:1434] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
W20260709 13:19:52.409936 21145 leader_election.cc:343] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:52.410086 20996 leader_election.cc:343] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.410624 21302 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:52.414669 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e2322c978e431ab9ce24d58bf8177a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:52.415421 21254 raft_consensus.cc:2468] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:52.416401 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:52.416932 21302 tablet_bootstrap.cc:654] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.417115 21252 raft_consensus.cc:2468] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:52.418217 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.419664 21146 leader_election.cc:304] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:52.420493 20997 leader_election.cc:304] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.421026 21402 raft_consensus.cc:2804] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.421495 21402 raft_consensus.cc:493] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.421886 21402 raft_consensus.cc:3060] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.422474 21457 raft_consensus.cc:2804] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.423050 21457 raft_consensus.cc:493] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.423516 21457 raft_consensus.cc:3060] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.430557 21302 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:52.431106 21302 ts_tablet_manager.cc:1403] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 13:19:52.433241 21252 raft_consensus.cc:3060] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.433905 21302 raft_consensus.cc:359] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.434638 21302 raft_consensus.cc:385] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.434922 21302 raft_consensus.cc:740] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.438293 21386 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.439097 21386 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.441498 21302 consensus_queue.cc:260] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.445482 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:52.449393 21302 ts_tablet_manager.cc:1434] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:19:52.450536 21302 tablet_bootstrap.cc:492] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:52.449527 21326 leader_election.cc:290] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:52.455391 21217 leader_election.cc:304] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.457782 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:52.470367 21302 tablet_bootstrap.cc:654] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.465261 21326 raft_consensus.cc:2749] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.486979 21402 raft_consensus.cc:515] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.487305 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:52.490274 21299 ts_tablet_manager.cc:1434] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 13:19:52.491842 21299 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:52.478559 21386 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:52.506232 21180 raft_consensus.cc:2393] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 1: Already voted for candidate 1d804ce9949645b19a0ccc1faf258ec7 in this term.
I20260709 13:19:52.518069 21309 consensus_queue.cc:1048] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:52.529652 21069 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:52.498605 21457 raft_consensus.cc:515] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.534420 21391 raft_consensus.cc:2749] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.538017 21301 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:52.539400 21301 ts_tablet_manager.cc:1403] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.138s	user 0.023s	sys 0.020s
I20260709 13:19:52.545745 21300 tablet_bootstrap.cc:492] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:52.546491 21300 ts_tablet_manager.cc:1403] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.244s	user 0.035s	sys 0.053s
I20260709 13:19:52.531903 21308 consensus_queue.cc:1048] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:52.557948 21390 raft_consensus.cc:493] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.558704 21390 raft_consensus.cc:515] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.561201 21390 leader_election.cc:290] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.562155 21302 tablet_bootstrap.cc:492] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:52.562212 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:52.562831 21302 ts_tablet_manager.cc:1403] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.113s	user 0.012s	sys 0.015s
W20260709 13:19:52.564783 21145 leader_election.cc:343] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.568467 21309 consensus_queue.cc:1048] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.568850 21350 consensus_queue.cc:1048] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.571498 21457 leader_election.cc:290] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.578114 21302 raft_consensus.cc:359] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.580739 21302 raft_consensus.cc:385] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.587388 21301 raft_consensus.cc:359] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.598227 21301 raft_consensus.cc:385] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.598598 21301 raft_consensus.cc:740] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.581152 21391 consensus_queue.cc:1048] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:19:52.600419 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:52.601191 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:52.601343 21254 raft_consensus.cc:3060] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:52.602780 20996 leader_election.cc:343] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.589149 21487 raft_consensus.cc:493] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.590966 21402 leader_election.cc:290] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:52.592307 21310 consensus_queue.cc:1048] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.610570 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e2322c978e431ab9ce24d58bf8177a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:52.597337 21299 tablet_bootstrap.cc:654] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.598135 21302 raft_consensus.cc:740] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.599359 21301 consensus_queue.cc:260] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.624069 21302 consensus_queue.cc:260] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.626101 21301 ts_tablet_manager.cc:1434] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:19:52.627297 21301 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:52.607071 21308 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.618983 21390 raft_consensus.cc:493] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.631322 21302 ts_tablet_manager.cc:1434] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:19:52.632464 21302 tablet_bootstrap.cc:492] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
W20260709 13:19:52.621014 21069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 91449.6us
I20260709 13:19:52.618993 21487 raft_consensus.cc:515] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.639020 21487 leader_election.cc:290] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:52.639603 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.640347 21106 raft_consensus.cc:2468] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:52.631971 21390 raft_consensus.cc:515] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.639572 21302 tablet_bootstrap.cc:654] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.646020 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:52.647753 21071 leader_election.cc:343] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.654028 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:52.654948 21178 raft_consensus.cc:2468] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:52.635388 21300 raft_consensus.cc:359] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.672996 21390 leader_election.cc:290] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.674391 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e2322c978e431ab9ce24d58bf8177a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:52.675100 21251 raft_consensus.cc:3060] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.676047 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:52.676829 21030 raft_consensus.cc:2468] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
W20260709 13:19:52.673033 21145 leader_election.cc:343] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.678987 21145 leader_election.cc:304] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:52.679731 21254 raft_consensus.cc:2468] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:52.680946 21350 raft_consensus.cc:493] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.681684 21350 raft_consensus.cc:515] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.684193 21350 leader_election.cc:290] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.684355 21308 raft_consensus.cc:2749] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.685365 20997 leader_election.cc:304] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.685752 21390 raft_consensus.cc:2804] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.685855 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.686559 21301 tablet_bootstrap.cc:654] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.672454 21300 raft_consensus.cc:385] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.691543 21145 leader_election.cc:304] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:52.697266 21300 raft_consensus.cc:740] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.703667 21300 consensus_queue.cc:260] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.698117 21390 raft_consensus.cc:493] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.702420 21457 raft_consensus.cc:2804] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.702373 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c088f6c59e3d40e28bfb3005f3fe8930" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:52.707674 21391 raft_consensus.cc:2804] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.715919 21391 raft_consensus.cc:493] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.716279 21391 raft_consensus.cc:3060] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.718338 21457 raft_consensus.cc:697] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:52.718963 21302 tablet_bootstrap.cc:492] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:52.719468 21302 ts_tablet_manager.cc:1403] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.008s
I20260709 13:19:52.719305 21457 consensus_queue.cc:237] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.707794 21390 raft_consensus.cc:3060] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.724978 21300 ts_tablet_manager.cc:1434] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.178s	user 0.009s	sys 0.000s
I20260709 13:19:52.725853 21300 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:52.726545 21494 consensus_queue.cc:1048] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.733341 20997 leader_election.cc:304] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.734251 21350 raft_consensus.cc:2749] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.708860 21069 leader_election.cc:304] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:52.736866 21490 raft_consensus.cc:2804] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.737279 21490 raft_consensus.cc:493] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.737633 21490 raft_consensus.cc:3060] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.739712 21495 raft_consensus.cc:493] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.740290 21495 raft_consensus.cc:515] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:52.752209 21069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 48552.8us
I20260709 13:19:52.753327 21391 raft_consensus.cc:515] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.750981 21251 raft_consensus.cc:2468] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:52.757277 21302 raft_consensus.cc:359] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.759531 21302 raft_consensus.cc:385] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.759800 21302 raft_consensus.cc:740] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.762696 21146 leader_election.cc:304] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:52.764381 21494 raft_consensus.cc:2804] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.765061 21494 raft_consensus.cc:697] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:52.765195 21300 tablet_bootstrap.cc:654] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.766615 21302 consensus_queue.cc:260] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.768529 21391 leader_election.cc:290] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.769665 21302 ts_tablet_manager.cc:1434] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:19:52.770484 21302 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:52.771708 21494 consensus_queue.cc:237] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.773232 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c297a12f6a8d4cebb87de531c02e7944" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:52.773904 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.775364 21301 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:52.766031 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:52.776049 21301 ts_tablet_manager.cc:1403] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.149s	user 0.020s	sys 0.021s
W20260709 13:19:52.778118 21145 leader_election.cc:343] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.764081 21495 leader_election.cc:290] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:52.783528 21390 raft_consensus.cc:515] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.788381 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c297a12f6a8d4cebb87de531c02e7944" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.789206 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:52.790560 21310 consensus_queue.cc:1048] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.802868 21104 raft_consensus.cc:2393] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc329a3e3d74a618ce2b4749aaafec8 in current term 1: Already voted for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in this term.
W20260709 13:19:52.791553 21145 leader_election.cc:343] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.805311 21180 raft_consensus.cc:3060] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.805477 21145 leader_election.cc:304] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.817682 21315 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:19:52.818542 21315 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:52.819365 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:52.820003 21391 raft_consensus.cc:2749] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:52.821005 21145 leader_election.cc:343] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.824038 21030 raft_consensus.cc:3060] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.830101 21390 leader_election.cc:290] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.832986 21301 raft_consensus.cc:359] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.834046 21301 raft_consensus.cc:385] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.834385 21301 raft_consensus.cc:740] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.796432 21490 raft_consensus.cc:515] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.799985 21299 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:52.837133 21299 ts_tablet_manager.cc:1403] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.346s	user 0.015s	sys 0.014s
I20260709 13:19:52.837364 21106 raft_consensus.cc:2393] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9bc329a3e3d74a618ce2b4749aaafec8 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:19:52.838924 21490 leader_election.cc:290] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:52.839701 21301 consensus_queue.cc:260] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.840270 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:52.840942 21028 raft_consensus.cc:3060] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.842115 21401 consensus_queue.cc:1048] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.843461 21301 ts_tablet_manager.cc:1434] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 13:19:52.844466 21301 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:52.847482 21145 leader_election.cc:304] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.850047 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:52.851065 21176 raft_consensus.cc:2393] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:52.852735 21391 raft_consensus.cc:2749] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.854175 21315 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:52.857511 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:52.856748 21301 tablet_bootstrap.cc:654] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.872299 21326 raft_consensus.cc:493] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.873085 21326 raft_consensus.cc:515] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.875389 21326 leader_election.cc:290] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:52.872251 21028 raft_consensus.cc:2468] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:52.876789 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d5cd05e2f349d8b1916f974171fb46" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:52.876981 21071 leader_election.cc:304] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:52.877661 21176 raft_consensus.cc:2468] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:52.879271 21217 leader_election.cc:304] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:52.840843 21299 raft_consensus.cc:359] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.880434 21299 raft_consensus.cc:385] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.881546 21299 raft_consensus.cc:740] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.885811 21299 consensus_queue.cc:260] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.889132 21299 ts_tablet_manager.cc:1434] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:19:52.881635 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d5cd05e2f349d8b1916f974171fb46" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.882125 21490 raft_consensus.cc:2804] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.890931 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:52.891407 21490 raft_consensus.cc:697] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:52.891649 21031 raft_consensus.cc:3060] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.881021 21326 raft_consensus.cc:2804] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.892354 21326 raft_consensus.cc:493] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.892855 21326 raft_consensus.cc:3060] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:52.890933 21219 leader_election.cc:343] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.902402 21490 consensus_queue.cc:237] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.903542 21031 raft_consensus.cc:2468] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:52.905556 21299 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:52.914992 21400 raft_consensus.cc:493] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.921128 21400 raft_consensus.cc:515] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.922593 21145 leader_election.cc:304] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:52.925599 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:52.926332 20928 catalog_manager.cc:5697] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.929872 21302 tablet_bootstrap.cc:700] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent opening tablet: real 0.113s	user 0.004s	sys 0.000s
I20260709 13:19:52.930826 21302 tablet_bootstrap.cc:654] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.935029 21494 raft_consensus.cc:2804] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.943606 21299 tablet_bootstrap.cc:654] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.944325 21494 raft_consensus.cc:697] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:52.944516 21300 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:52.945279 21300 ts_tablet_manager.cc:1403] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.220s	user 0.017s	sys 0.002s
I20260709 13:19:52.945413 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:52.946120 21254 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:52.944540 21145 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:52.948060 21300 raft_consensus.cc:359] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.948576 21315 raft_consensus.cc:2749] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:52.949129 21300 raft_consensus.cc:385] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.949548 21300 raft_consensus.cc:740] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.950448 21300 consensus_queue.cc:260] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.953152 20997 leader_election.cc:304] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:52.954308 21309 raft_consensus.cc:2804] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.954741 21309 raft_consensus.cc:493] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.955089 21309 raft_consensus.cc:3060] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.955188 21300 ts_tablet_manager.cc:1434] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:19:52.955987 21494 consensus_queue.cc:237] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.956566 21300 tablet_bootstrap.cc:492] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:52.960659 21400 leader_election.cc:290] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.967890 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:52.973510 21104 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:52.980875 21301 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:52.981767 21301 ts_tablet_manager.cc:1403] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.137s	user 0.032s	sys 0.034s
I20260709 13:19:52.985688 21301 raft_consensus.cc:359] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.992825 21301 raft_consensus.cc:385] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.993435 21301 raft_consensus.cc:740] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.994454 21301 consensus_queue.cc:260] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:52.987313 21309 raft_consensus.cc:515] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:52.960954 21326 raft_consensus.cc:515] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:52.999202 21309 leader_election.cc:290] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:52.999871 21326 leader_election.cc:290] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:53.000525 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d5cd05e2f349d8b1916f974171fb46" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
W20260709 13:19:53.002620 21219 leader_election.cc:343] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.002882 21301 ts_tablet_manager.cc:1434] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 13:19:53.003546 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:53.004186 21254 raft_consensus.cc:3060] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.004587 21301 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:53.005910 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d5cd05e2f349d8b1916f974171fb46" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:53.006529 21180 raft_consensus.cc:3060] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.007901 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:53.009703 21105 raft_consensus.cc:3060] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.013643 21300 tablet_bootstrap.cc:654] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.026243 21299 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.026690 21299 ts_tablet_manager.cc:1403] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.004s
I20260709 13:19:53.027452 21105 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:53.029352 21180 raft_consensus.cc:2468] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:53.029635 20996 leader_election.cc:304] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:53.030740 21217 leader_election.cc:304] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:53.033413 21326 raft_consensus.cc:2804] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.034242 21299 raft_consensus.cc:359] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.034837 21302 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:53.035553 21302 ts_tablet_manager.cc:1403] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.265s	user 0.015s	sys 0.003s
I20260709 13:19:53.035099 21299 raft_consensus.cc:385] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.035959 21299 raft_consensus.cc:740] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.034057 21326 raft_consensus.cc:697] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:53.037195 21299 consensus_queue.cc:260] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.032091 21400 raft_consensus.cc:2804] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.041575 21299 ts_tablet_manager.cc:1434] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:19:53.042626 21299 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.043680 21302 raft_consensus.cc:359] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.044420 21302 raft_consensus.cc:385] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.045820 21302 raft_consensus.cc:740] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.044866 21400 raft_consensus.cc:697] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:53.050261 21254 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:53.046520 21302 consensus_queue.cc:260] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.052135 21299 tablet_bootstrap.cc:654] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.053342 21302 ts_tablet_manager.cc:1434] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:19:53.054450 21302 tablet_bootstrap.cc:492] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:53.065680 21326 consensus_queue.cc:237] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.048422 21400 consensus_queue.cc:237] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.068982 21300 tablet_bootstrap.cc:492] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:53.069597 21300 ts_tablet_manager.cc:1403] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.019s
I20260709 13:19:53.072633 21300 raft_consensus.cc:359] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.073468 21300 raft_consensus.cc:385] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.073803 21300 raft_consensus.cc:740] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.074556 21300 consensus_queue.cc:260] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.076339 21302 tablet_bootstrap.cc:654] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.076510 21299 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.076879 21301 tablet_bootstrap.cc:654] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.079084 21299 ts_tablet_manager.cc:1403] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.006s
I20260709 13:19:53.076980 21300 ts_tablet_manager.cc:1434] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:53.080459 21300 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:53.085424 20929 catalog_manager.cc:5697] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.083351 21299 raft_consensus.cc:359] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.093324 20927 catalog_manager.cc:5697] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.103880 21299 raft_consensus.cc:385] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.104251 21299 raft_consensus.cc:740] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.105000 21299 consensus_queue.cc:260] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.097355 21302 tablet_bootstrap.cc:492] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:53.106516 21302 ts_tablet_manager.cc:1403] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 13:19:53.106976 21299 ts_tablet_manager.cc:1434] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.004s
I20260709 13:19:53.109427 21300 tablet_bootstrap.cc:654] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.109498 21302 raft_consensus.cc:359] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.110396 21302 raft_consensus.cc:385] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.110679 21302 raft_consensus.cc:740] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.111368 21302 consensus_queue.cc:260] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.113642 21302 ts_tablet_manager.cc:1434] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:53.114598 21302 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:53.102910 21301 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:53.119999 21301 ts_tablet_manager.cc:1403] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.013s
I20260709 13:19:53.120688 21302 tablet_bootstrap.cc:654] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.123651 21301 raft_consensus.cc:359] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.124735 21301 raft_consensus.cc:385] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.125178 21301 raft_consensus.cc:740] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.131029 21299 tablet_bootstrap.cc:492] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.132128 20928 catalog_manager.cc:5697] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.140153 21299 tablet_bootstrap.cc:654] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.143143 21300 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:53.143698 21300 ts_tablet_manager.cc:1403] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.010s
I20260709 13:19:53.145170 21302 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:53.145701 21302 ts_tablet_manager.cc:1403] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.000s
I20260709 13:19:53.148486 21302 raft_consensus.cc:359] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.149174 21302 raft_consensus.cc:385] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.149451 21302 raft_consensus.cc:740] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.150291 21302 consensus_queue.cc:260] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.151870 21301 consensus_queue.cc:260] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.152714 21302 ts_tablet_manager.cc:1434] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:53.155512 20928 catalog_manager.cc:5697] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.156152 21302 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:53.156069 21300 raft_consensus.cc:359] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.158397 21300 raft_consensus.cc:385] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.158692 21300 raft_consensus.cc:740] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.159489 21300 consensus_queue.cc:260] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.161674 21300 ts_tablet_manager.cc:1434] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 13:19:53.162596 21300 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:53.164403 21302 tablet_bootstrap.cc:654] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.156953 20926 catalog_manager.cc:5697] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.168470 21301 ts_tablet_manager.cc:1434] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 13:19:53.174449 21302 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:53.175015 21302 ts_tablet_manager.cc:1403] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:19:53.175197 21301 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:53.178283 21302 raft_consensus.cc:359] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.179160 21302 raft_consensus.cc:385] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.179493 21302 raft_consensus.cc:740] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.169430 21300 tablet_bootstrap.cc:654] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.171787 21299 tablet_bootstrap.cc:492] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.184895 21299 ts_tablet_manager.cc:1403] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.011s
I20260709 13:19:53.185105 21301 tablet_bootstrap.cc:654] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.188817 21299 raft_consensus.cc:359] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.189800 21299 raft_consensus.cc:385] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.190138 21299 raft_consensus.cc:740] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.181890 21302 consensus_queue.cc:260] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.190985 21299 consensus_queue.cc:260] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.195111 21299 ts_tablet_manager.cc:1434] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:19:53.196431 21299 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.203331 21299 tablet_bootstrap.cc:654] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.210376 21302 ts_tablet_manager.cc:1434] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:19:53.211535 21302 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:53.216127 21494 consensus_queue.cc:1048] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.216511 21299 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.217280 21299 ts_tablet_manager.cc:1403] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 13:19:53.218497 21302 tablet_bootstrap.cc:654] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.220515 21299 raft_consensus.cc:359] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.221273 21300 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:53.221238 21299 raft_consensus.cc:385] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.221875 21300 ts_tablet_manager.cc:1403] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.026s
I20260709 13:19:53.222039 21299 raft_consensus.cc:740] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.222932 21299 consensus_queue.cc:260] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.225198 21300 raft_consensus.cc:359] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.226016 21300 raft_consensus.cc:385] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.226295 21300 raft_consensus.cc:740] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.227087 21300 consensus_queue.cc:260] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.228988 21299 ts_tablet_manager.cc:1434] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:19:53.229252 21300 ts_tablet_manager.cc:1434] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:19:53.230337 21300 tablet_bootstrap.cc:492] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:53.232208 21299 tablet_bootstrap.cc:492] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.239046 21299 tablet_bootstrap.cc:654] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.239046 21300 tablet_bootstrap.cc:654] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.240736 21490 raft_consensus.cc:493] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.241318 21490 raft_consensus.cc:515] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.243585 21490 leader_election.cc:290] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:53.245421 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.246285 21029 raft_consensus.cc:2393] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:53.249015 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:53.252065 21069 leader_election.cc:304] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:53.252655 21300 tablet_bootstrap.cc:492] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:53.253270 21300 ts_tablet_manager.cc:1403] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:19:53.253983 21299 tablet_bootstrap.cc:492] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.254480 21299 ts_tablet_manager.cc:1403] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.002s
I20260709 13:19:53.256922 21028 raft_consensus.cc:3060] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.258311 21299 raft_consensus.cc:359] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.259075 21299 raft_consensus.cc:385] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.259341 21299 raft_consensus.cc:740] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.260248 21299 consensus_queue.cc:260] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.261224 21487 raft_consensus.cc:3060] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.267374 21391 raft_consensus.cc:493] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.267923 21391 raft_consensus.cc:515] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.268759 21302 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:53.269295 21302 ts_tablet_manager.cc:1403] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.009s
I20260709 13:19:53.270797 21495 consensus_queue.cc:1048] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.274698 21391 leader_election.cc:290] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:53.276198 21299 ts_tablet_manager.cc:1434] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:19:53.277494 21106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9de470b5d74977809dc2668fa67ae3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:53.278548 21301 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
W20260709 13:19:53.279049 21145 leader_election.cc:343] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.279983 21299 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.279064 21301 ts_tablet_manager.cc:1403] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.000s
I20260709 13:19:53.282915 21300 raft_consensus.cc:359] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.283753 21300 raft_consensus.cc:385] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.284070 21300 raft_consensus.cc:740] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.284394 21301 raft_consensus.cc:359] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.285085 21301 raft_consensus.cc:385] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.285357 21301 raft_consensus.cc:740] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.285961 21301 consensus_queue.cc:260] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.287129 21299 tablet_bootstrap.cc:654] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.287701 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9de470b5d74977809dc2668fa67ae3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.288167 21301 ts_tablet_manager.cc:1434] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:53.288439 21028 raft_consensus.cc:2468] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:53.290669 21145 leader_election.cc:304] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:53.291293 21106 raft_consensus.cc:3060] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.292078 21391 raft_consensus.cc:2804] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.292547 21391 raft_consensus.cc:493] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.292903 21391 raft_consensus.cc:3060] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.289181 21301 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:53.296504 21487 raft_consensus.cc:2749] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.289156 21300 consensus_queue.cc:260] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.307255 21495 raft_consensus.cc:493] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.307888 21495 raft_consensus.cc:515] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.310097 21495 leader_election.cc:290] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:53.311766 21400 consensus_queue.cc:1048] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.312024 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed16ebc062ff4ee69c7071f6af842713" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:53.312976 21105 raft_consensus.cc:2468] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:53.314843 21145 leader_election.cc:304] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:53.315641 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed16ebc062ff4ee69c7071f6af842713" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:53.318948 21254 raft_consensus.cc:2468] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:53.321480 21300 ts_tablet_manager.cc:1434] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:19:53.324038 21300 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:53.324925 21495 raft_consensus.cc:2804] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.326674 21495 raft_consensus.cc:493] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.327040 21495 raft_consensus.cc:3060] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.333014 21487 raft_consensus.cc:493] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.333815 21487 raft_consensus.cc:515] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.339090 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:53.337996 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.336714 21487 leader_election.cc:290] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:53.344650 21071 leader_election.cc:304] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:53.345376 21301 tablet_bootstrap.cc:654] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.341091 21391 raft_consensus.cc:515] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.336632 21302 raft_consensus.cc:359] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.347601 21302 raft_consensus.cc:385] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.348079 21400 consensus_queue.cc:1048] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.350947 21302 raft_consensus.cc:740] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.352725 21299 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.353232 21299 ts_tablet_manager.cc:1403] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.004s
I20260709 13:19:53.356143 21299 raft_consensus.cc:359] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.356977 21299 raft_consensus.cc:385] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.357251 21299 raft_consensus.cc:740] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.358003 21299 consensus_queue.cc:260] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.348528 21300 tablet_bootstrap.cc:654] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.348855 21487 raft_consensus.cc:2749] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:53.352208 21302 consensus_queue.cc:260] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.363646 21490 raft_consensus.cc:493] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.364223 21490 raft_consensus.cc:515] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.366029 21302 ts_tablet_manager.cc:1434] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.000s
I20260709 13:19:53.368642 21299 ts_tablet_manager.cc:1434] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:19:53.369715 21302 tablet_bootstrap.cc:492] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:53.376466 21299 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.383287 21487 consensus_queue.cc:1048] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.377225 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:53.386407 21180 raft_consensus.cc:2468] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:53.368547 21490 leader_election.cc:290] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:53.379477 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.388393 21069 leader_election.cc:304] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:53.388757 21315 raft_consensus.cc:493] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.389354 21490 raft_consensus.cc:2804] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.389820 21490 raft_consensus.cc:493] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.389420 21315 raft_consensus.cc:515] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.390218 21490 raft_consensus.cc:3060] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:53.390296 21071 leader_election.cc:343] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.392732 21315 leader_election.cc:290] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:53.395391 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9de470b5d74977809dc2668fa67ae3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:53.396131 21029 raft_consensus.cc:3060] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.396997 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a91f1d3cda4e78b61f1817a855f249" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.400103 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a91f1d3cda4e78b61f1817a855f249" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:53.400956 21251 raft_consensus.cc:2468] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
W20260709 13:19:53.405400 21145 leader_election.cc:343] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.405992 21391 leader_election.cc:290] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:53.407433 21146 leader_election.cc:304] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:53.408947 21315 raft_consensus.cc:2804] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.409876 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9de470b5d74977809dc2668fa67ae3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:53.416576 21487 raft_consensus.cc:493] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:53.416829 21145 leader_election.cc:343] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.417263 21487 raft_consensus.cc:515] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.411100 21315 raft_consensus.cc:493] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.419494 21487 leader_election.cc:290] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:53.419770 21315 raft_consensus.cc:3060] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.421599 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d5cd05e2f349d8b1916f974171fb46" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:53.422433 21180 raft_consensus.cc:2393] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 1: Already voted for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in this term.
I20260709 13:19:53.423811 21490 raft_consensus.cc:515] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.424917 21326 raft_consensus.cc:493] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.427157 21410 raft_consensus.cc:493] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.433851 21326 raft_consensus.cc:515] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.434093 21410 raft_consensus.cc:515] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.429378 21302 tablet_bootstrap.cc:654] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.379631 21495 raft_consensus.cc:515] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.436421 21410 leader_election.cc:290] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:53.436419 21326 leader_election.cc:290] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:53.431025 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d5cd05e2f349d8b1916f974171fb46" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:53.459960 21495 leader_election.cc:290] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:53.468750 21072 leader_election.cc:304] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:53.475170 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db2aafa5c048e98de27e15a5df6e61" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.476188 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:53.477133 21029 raft_consensus.cc:2468] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:53.494346 21299 tablet_bootstrap.cc:654] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.494882 21315 raft_consensus.cc:515] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.496460 21145 leader_election.cc:304] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:53.489182 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed16ebc062ff4ee69c7071f6af842713" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:53.497584 21251 raft_consensus.cc:3060] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.495246 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
W20260709 13:19:53.499161 21071 leader_election.cc:343] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.499686 21300 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
W20260709 13:19:53.499300 21217 leader_election.cc:343] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.499861 21494 raft_consensus.cc:2804] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.500186 21300 ts_tablet_manager.cc:1403] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.177s	user 0.022s	sys 0.001s
I20260709 13:19:53.500422 21494 raft_consensus.cc:697] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:53.501364 21494 consensus_queue.cc:237] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.504344 21300 raft_consensus.cc:359] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.505137 21300 raft_consensus.cc:385] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.505393 21300 raft_consensus.cc:740] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.487936 21030 raft_consensus.cc:2468] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:53.506891 21300 consensus_queue.cc:260] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.509533 21300 ts_tablet_manager.cc:1434] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:19:53.511631 21301 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:53.512163 21301 ts_tablet_manager.cc:1403] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.223s	user 0.028s	sys 0.024s
I20260709 13:19:53.513121 21300 tablet_bootstrap.cc:492] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:53.517526 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:53.519059 21299 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.519716 21299 ts_tablet_manager.cc:1403] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.004s
I20260709 13:19:53.521195 21491 raft_consensus.cc:3060] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.538842 21391 raft_consensus.cc:493] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.542819 21391 raft_consensus.cc:515] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.546851 21391 leader_election.cc:290] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:53.547037 21301 raft_consensus.cc:359] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.547784 21301 raft_consensus.cc:385] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.548080 21301 raft_consensus.cc:740] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.550915 21309 consensus_queue.cc:1048] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.551214 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a91f1d3cda4e78b61f1817a855f249" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:53.551867 21254 raft_consensus.cc:3060] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.552512 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07889753a7dd4a42b31d46ef6a693f98" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:53.553215 21250 raft_consensus.cc:2468] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:53.556731 21251 raft_consensus.cc:2468] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:53.559435 21146 leader_election.cc:304] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:53.560804 21391 raft_consensus.cc:2804] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.560006 21254 raft_consensus.cc:2468] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:53.561195 21146 leader_election.cc:304] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:53.561244 21391 raft_consensus.cc:493] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.562515 21401 raft_consensus.cc:493] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.562634 21391 raft_consensus.cc:3060] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.563059 21401 raft_consensus.cc:515] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.564790 21495 raft_consensus.cc:2804] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.571626 21401 leader_election.cc:290] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:53.572870 21315 leader_election.cc:290] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:53.573583 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f647f71210440f2b1c7811406423646" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.576959 21301 consensus_queue.cc:260] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.585110 21300 tablet_bootstrap.cc:654] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.582940 21309 raft_consensus.cc:493] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.590556 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db2aafa5c048e98de27e15a5df6e61" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:53.606262 21104 raft_consensus.cc:2468] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:53.562543 21146 leader_election.cc:304] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
W20260709 13:19:53.607985 21146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:37887, user_credentials={real_user=slave}} blocked reactor thread for 45517.5us
W20260709 13:19:53.588871 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 49944.8us
I20260709 13:19:53.622990 21495 raft_consensus.cc:697] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:53.622347 21494 raft_consensus.cc:2804] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.630446 21299 raft_consensus.cc:359] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.633725 21299 raft_consensus.cc:385] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.634018 21299 raft_consensus.cc:740] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.634788 21299 consensus_queue.cc:260] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.643405 21490 leader_election.cc:290] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:53.612409 21309 raft_consensus.cc:515] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.649068 21299 ts_tablet_manager.cc:1434] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.003s
I20260709 13:19:53.651839 21299 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.652777 21219 leader_election.cc:304] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:53.652925 21495 consensus_queue.cc:237] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.656342 21301 ts_tablet_manager.cc:1434] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.144s	user 0.008s	sys 0.004s
I20260709 13:19:53.657533 21301 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:53.638909 21494 raft_consensus.cc:697] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:53.658881 21302 tablet_bootstrap.cc:492] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:53.661130 21302 ts_tablet_manager.cc:1403] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.294s	user 0.035s	sys 0.006s
I20260709 13:19:53.662057 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f647f71210440f2b1c7811406423646" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:53.660279 21457 consensus_queue.cc:1048] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:53.660732 21326 raft_consensus.cc:2804] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.668907 21326 raft_consensus.cc:493] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.669276 21326 raft_consensus.cc:3060] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.669844 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:53.670117 21299 tablet_bootstrap.cc:654] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.670691 21103 raft_consensus.cc:2393] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:19:53.672868 21309 leader_election.cc:290] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:53.674314 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:53.676059 21180 raft_consensus.cc:2468] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:53.676991 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a91f1d3cda4e78b61f1817a855f249" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:53.655668 21391 raft_consensus.cc:515] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:53.690968 21219 leader_election.cc:343] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.688889 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07889753a7dd4a42b31d46ef6a693f98" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:53.697259 20926 catalog_manager.cc:5697] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.688119 21310 consensus_queue.cc:1048] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:19:53.698750 21315 consensus_queue.cc:1048] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:53.708307 21391 leader_election.cc:290] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:53.708742 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07889753a7dd4a42b31d46ef6a693f98" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:53.710466 21250 raft_consensus.cc:3060] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:53.713250 21219 leader_election.cc:343] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.713806 21219 leader_election.cc:304] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:53.682269 20994 leader_election.cc:304] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
W20260709 13:19:53.715126 21551 log.cc:927] Time spent T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:19:53.717183 21401 raft_consensus.cc:2749] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.710717 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:53.732728 21302 raft_consensus.cc:359] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.733551 21302 raft_consensus.cc:385] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.733817 21302 raft_consensus.cc:740] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.734951 21302 consensus_queue.cc:260] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.735380 21176 raft_consensus.cc:3060] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:53.737797 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:19:53.719508 21145 leader_election.cc:343] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.685109 21494 consensus_queue.cc:237] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:53.725006 21491 raft_consensus.cc:2749] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.732060 21552 raft_consensus.cc:2804] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.748541 21302 ts_tablet_manager.cc:1434] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
W20260709 13:19:53.724159 20994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 45210.4us
I20260709 13:19:53.758550 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed16ebc062ff4ee69c7071f6af842713" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:53.759413 21105 raft_consensus.cc:3060] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.751461 21552 raft_consensus.cc:493] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.772233 21299 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:53.772781 21299 ts_tablet_manager.cc:1403] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.010s
I20260709 13:19:53.774878 21302 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:53.776945 21301 tablet_bootstrap.cc:654] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:53.757135 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 55473.7us
I20260709 13:19:53.765910 21552 raft_consensus.cc:3060] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.796985 21299 raft_consensus.cc:359] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.798148 21299 raft_consensus.cc:385] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.798547 21299 raft_consensus.cc:740] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.801601 21176 raft_consensus.cc:2468] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
W20260709 13:19:53.800239 21219 leader_election.cc:343] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.802312 21219 leader_election.cc:304] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:53.803100 21401 raft_consensus.cc:2749] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.806612 21326 raft_consensus.cc:515] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.811465 21547 consensus_queue.cc:1048] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.799237 21250 raft_consensus.cc:2468] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:53.800323 21299 consensus_queue.cc:260] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.818188 21146 leader_election.cc:304] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:53.820365 21315 raft_consensus.cc:2804] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.822975 21315 raft_consensus.cc:697] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:53.823949 21315 consensus_queue.cc:237] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:53.824739 21145 leader_election.cc:343] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.825305 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07889753a7dd4a42b31d46ef6a693f98" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:53.811121 21069 leader_election.cc:304] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
W20260709 13:19:53.843075 21145 leader_election.cc:343] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.844215 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db2aafa5c048e98de27e15a5df6e61" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:53.844379 21310 consensus_queue.cc:1048] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.845391 21326 leader_election.cc:290] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:53.845530 21029 raft_consensus.cc:3060] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.848574 21299 ts_tablet_manager.cc:1434] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:19:53.849998 21299 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:53.839867 21547 raft_consensus.cc:2804] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.859009 21105 raft_consensus.cc:2468] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:53.854988 21547 raft_consensus.cc:697] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
W20260709 13:19:53.864746 21559 log.cc:927] Time spent T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:19:53.865682 21547 consensus_queue.cc:237] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.875299 21495 consensus_queue.cc:1048] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.874594 21552 raft_consensus.cc:515] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:53.879035 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:53.884548 21552 leader_election.cc:290] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:53.907346 21302 tablet_bootstrap.cc:654] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.897917 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18db2aafa5c048e98de27e15a5df6e61" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:53.930298 21301 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:53.931113 21301 ts_tablet_manager.cc:1403] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.274s	user 0.014s	sys 0.022s
I20260709 13:19:53.934801 21300 tablet_bootstrap.cc:492] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:53.935459 21300 ts_tablet_manager.cc:1403] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.423s	user 0.018s	sys 0.020s
I20260709 13:19:53.938441 21300 raft_consensus.cc:359] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.938616 21180 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f74fadf9cfd46a09de882208a769f0f" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:53.941924 21180 raft_consensus.cc:2393] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:19:53.943079 20994 leader_election.cc:304] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:53.944140 21400 raft_consensus.cc:2749] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.944674 21029 raft_consensus.cc:2468] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:53.945791 21300 raft_consensus.cc:385] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.946163 21300 raft_consensus.cc:740] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.923353 21104 raft_consensus.cc:3060] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.951471 21300 consensus_queue.cc:260] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:53.956665 21300 ts_tablet_manager.cc:1434] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:19:53.958495 21300 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:53.961124 21219 leader_election.cc:304] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:53.967537 21401 raft_consensus.cc:2804] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.968087 21401 raft_consensus.cc:697] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:53.969487 21401 consensus_queue.cc:237] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:53.999814 21545 raft_consensus.cc:493] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.000721 21545 raft_consensus.cc:515] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.011266 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9de470b5d74977809dc2668fa67ae3" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:54.012176 21030 raft_consensus.cc:2393] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:54.014655 21326 raft_consensus.cc:493] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.015450 21326 raft_consensus.cc:515] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.020018 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
W20260709 13:19:54.025164 21219 leader_election.cc:343] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.033169 21545 leader_election.cc:290] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:54.034844 21299 tablet_bootstrap.cc:654] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.036963 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae9de470b5d74977809dc2668fa67ae3" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:54.038906 21069 leader_election.cc:304] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:54.040150 21491 raft_consensus.cc:3060] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.041319 21315 consensus_queue.cc:1048] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.049809 21326 leader_election.cc:290] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:54.052280 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:54.055501 21217 leader_election.cc:343] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.056216 21217 leader_election.cc:304] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:54.057519 21410 raft_consensus.cc:2749] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.112829 21487 raft_consensus.cc:493] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.113626 21487 raft_consensus.cc:515] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.118328 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f647f71210440f2b1c7811406423646" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:54.121465 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f647f71210440f2b1c7811406423646" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.122447 21250 raft_consensus.cc:2468] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
W20260709 13:19:54.123903 21071 leader_election.cc:343] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.124570 21487 leader_election.cc:290] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:54.125738 21072 leader_election.cc:304] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:54.135257 20928 catalog_manager.cc:5697] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.138550 20928 catalog_manager.cc:5697] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.140226 21308 raft_consensus.cc:2804] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.140738 21308 raft_consensus.cc:493] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.141094 21308 raft_consensus.cc:3060] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.144273 20928 catalog_manager.cc:5697] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.150478 21308 raft_consensus.cc:515] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.153578 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f647f71210440f2b1c7811406423646" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:54.154230 21250 raft_consensus.cc:3060] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.154557 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f647f71210440f2b1c7811406423646" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:54.155584 21308 leader_election.cc:290] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
W20260709 13:19:54.156395 21071 leader_election.cc:343] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.161237 21302 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:54.162025 21302 ts_tablet_manager.cc:1403] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.387s	user 0.011s	sys 0.017s
I20260709 13:19:54.163295 21301 raft_consensus.cc:359] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.165004 21301 raft_consensus.cc:385] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.165311 21301 raft_consensus.cc:740] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.166138 21301 consensus_queue.cc:260] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.174606 21301 ts_tablet_manager.cc:1434] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.243s	user 0.008s	sys 0.003s
I20260709 13:19:54.175485 21301 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:54.163934 21104 raft_consensus.cc:2468] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:54.183393 21250 raft_consensus.cc:2468] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:54.183625 21491 raft_consensus.cc:2749] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.186163 21072 leader_election.cc:304] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:54.190416 21300 tablet_bootstrap.cc:654] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.187088 21391 consensus_queue.cc:1048] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:54.188865 21547 raft_consensus.cc:2804] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.187016 21494 raft_consensus.cc:493] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.193272 21547 raft_consensus.cc:697] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:54.195681 21547 consensus_queue.cc:237] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.198697 21494 raft_consensus.cc:515] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.198468 21302 raft_consensus.cc:359] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.201213 21302 raft_consensus.cc:385] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.201648 21302 raft_consensus.cc:740] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.202538 21302 consensus_queue.cc:260] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.206389 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:54.206670 21299 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:54.207121 21302 ts_tablet_manager.cc:1434] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:19:54.207553 21299 ts_tablet_manager.cc:1403] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.358s	user 0.009s	sys 0.012s
I20260709 13:19:54.208179 21302 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
W20260709 13:19:54.212461 21145 leader_election.cc:343] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.213984 21315 consensus_queue.cc:1048] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.215252 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.216038 21254 raft_consensus.cc:2468] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:54.218464 21494 leader_election.cc:290] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:54.221593 21146 leader_election.cc:304] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:54.230295 20927 catalog_manager.cc:5697] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.232703 21299 raft_consensus.cc:359] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.233526 21299 raft_consensus.cc:385] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.233825 21299 raft_consensus.cc:740] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.234565 21299 consensus_queue.cc:260] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.242887 21315 raft_consensus.cc:2804] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.243752 21315 raft_consensus.cc:493] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.244192 21315 raft_consensus.cc:3060] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.247139 20926 catalog_manager.cc:5697] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.252313 21301 tablet_bootstrap.cc:654] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.257488 21299 ts_tablet_manager.cc:1434] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:19:54.259024 21299 tablet_bootstrap.cc:492] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:54.269595 21299 tablet_bootstrap.cc:654] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.276131 21494 consensus_queue.cc:1048] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.280905 21302 tablet_bootstrap.cc:654] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.286932 21315 raft_consensus.cc:515] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.287153 21494 consensus_queue.cc:1048] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.289721 21029 raft_consensus.cc:3060] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.302083 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
W20260709 13:19:54.303674 21145 leader_election.cc:343] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.304747 21547 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.305562 21547 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.306492 21301 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:54.307075 21301 ts_tablet_manager.cc:1403] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.132s	user 0.007s	sys 0.004s
I20260709 13:19:54.308547 21547 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:54.309857 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:54.313694 21553 consensus_queue.cc:1048] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.310180 21315 leader_election.cc:290] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:54.310765 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
W20260709 13:19:54.315573 21071 leader_election.cc:343] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.315698 21302 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:54.316359 21302 ts_tablet_manager.cc:1403] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.004s
I20260709 13:19:54.319608 21302 raft_consensus.cc:359] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:54.324249 21072 leader_election.cc:343] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.324855 21072 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:54.320382 21302 raft_consensus.cc:385] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.325445 21302 raft_consensus.cc:740] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.326081 21491 raft_consensus.cc:2749] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.327505 21400 raft_consensus.cc:493] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.326222 21302 consensus_queue.cc:260] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.328052 21400 raft_consensus.cc:515] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.330749 21400 leader_election.cc:290] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:54.332736 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a91f1d3cda4e78b61f1817a855f249" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:54.331286 21302 ts_tablet_manager.cc:1434] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:19:54.332016 21553 consensus_queue.cc:1048] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.333590 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:54.339910 21254 raft_consensus.cc:3060] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:54.342177 21145 consensus_peers.cc:597] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.312083 21301 raft_consensus.cc:359] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.349537 21301 raft_consensus.cc:385] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.350564 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95a91f1d3cda4e78b61f1817a855f249" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.356419 21254 raft_consensus.cc:2468] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:54.336826 21302 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:54.362794 21301 raft_consensus.cc:740] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.364089 21301 consensus_queue.cc:260] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.328076 20929 catalog_manager.cc:5697] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.375008 21301 ts_tablet_manager.cc:1434] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.068s	user 0.011s	sys 0.000s
I20260709 13:19:54.377655 21301 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:54.385460 20994 leader_election.cc:304] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:54.387575 21457 raft_consensus.cc:2749] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:54.401335 21300 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:54.401901 21300 ts_tablet_manager.cc:1403] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.444s	user 0.027s	sys 0.020s
I20260709 13:19:54.402545 21401 consensus_queue.cc:1048] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.404948 21300 raft_consensus.cc:359] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.405743 21300 raft_consensus.cc:385] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.406051 21300 raft_consensus.cc:740] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.406319 21301 tablet_bootstrap.cc:654] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.406904 21300 consensus_queue.cc:260] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.409411 21300 ts_tablet_manager.cc:1434] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:54.410426 21300 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:54.412534 21146 leader_election.cc:304] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:54.417466 21553 raft_consensus.cc:2804] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.418059 21553 raft_consensus.cc:697] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:54.418982 21553 consensus_queue.cc:237] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.438212 21391 raft_consensus.cc:493] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.445608 21547 consensus_queue.cc:1048] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.444191 21299 tablet_bootstrap.cc:492] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:54.447832 21299 ts_tablet_manager.cc:1403] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.189s	user 0.028s	sys 0.074s
I20260709 13:19:54.457399 21302 tablet_bootstrap.cc:654] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.459656 21299 raft_consensus.cc:359] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.460779 21299 raft_consensus.cc:385] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.461189 21299 raft_consensus.cc:740] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.461966 21299 consensus_queue.cc:260] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.472005 21299 ts_tablet_manager.cc:1434] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 13:19:54.444154 21391 raft_consensus.cc:515] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.473107 21299 tablet_bootstrap.cc:492] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:54.474856 21391 leader_election.cc:290] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:54.480129 21299 tablet_bootstrap.cc:654] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.483079 21301 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:54.484552 21301 ts_tablet_manager.cc:1403] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.107s	user 0.024s	sys 0.011s
I20260709 13:19:54.488909 21299 tablet_bootstrap.cc:492] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:54.489456 21299 ts_tablet_manager.cc:1403] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:19:54.491511 21300 tablet_bootstrap.cc:654] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.492486 21299 raft_consensus.cc:359] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.493269 21299 raft_consensus.cc:385] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.493531 21299 raft_consensus.cc:740] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.494205 21299 consensus_queue.cc:260] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.495440 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:54.499341 21145 leader_election.cc:343] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.505297 21299 ts_tablet_manager.cc:1434] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:54.506402 21299 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:54.510412 21410 consensus_queue.cc:1048] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.510485 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.521996 21299 tablet_bootstrap.cc:654] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.523969 21487 consensus_queue.cc:1048] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.527889 21300 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:54.528429 21300 ts_tablet_manager.cc:1403] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.014s
I20260709 13:19:54.531281 21300 raft_consensus.cc:359] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.532004 21300 raft_consensus.cc:385] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.532275 21300 raft_consensus.cc:740] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
W20260709 13:19:54.534205 21146 leader_election.cc:343] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.535616 21146 leader_election.cc:304] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:54.535846 21300 consensus_queue.cc:260] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.537089 21390 raft_consensus.cc:2749] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.538138 21300 ts_tablet_manager.cc:1434] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:19:54.539350 21300 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:54.541328 21495 raft_consensus.cc:493] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.541985 21495 raft_consensus.cc:515] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.545585 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cd665cde99440fbd2d8bbd52fbadec" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:54.546945 21299 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
W20260709 13:19:54.547225 21145 leader_election.cc:343] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.547586 21299 ts_tablet_manager.cc:1403] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.003s
I20260709 13:19:54.548949 21495 leader_election.cc:290] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:54.550350 21299 raft_consensus.cc:359] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.550786 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cd665cde99440fbd2d8bbd52fbadec" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:54.551086 21299 raft_consensus.cc:385] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.551537 21299 raft_consensus.cc:740] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.552244 21299 consensus_queue.cc:260] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.553104 21103 raft_consensus.cc:2468] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:54.554322 21299 ts_tablet_manager.cc:1434] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:54.555259 21299 tablet_bootstrap.cc:492] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:54.557380 21145 leader_election.cc:304] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:54.558323 21391 raft_consensus.cc:2804] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.558804 21391 raft_consensus.cc:493] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.561299 21300 tablet_bootstrap.cc:654] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.565469 21299 tablet_bootstrap.cc:654] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.559887 21391 raft_consensus.cc:3060] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.579043 21391 raft_consensus.cc:515] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.583268 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cd665cde99440fbd2d8bbd52fbadec" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:54.584625 21391 leader_election.cc:290] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:54.577481 21301 raft_consensus.cc:359] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:54.585371 21592 log.cc:927] Time spent T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Append to log took a long time: real 0.118s	user 0.004s	sys 0.000s
I20260709 13:19:54.586133 21301 raft_consensus.cc:385] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.588065 21301 raft_consensus.cc:740] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.589497 21302 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:54.589243 21301 consensus_queue.cc:260] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.590052 21302 ts_tablet_manager.cc:1403] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.254s	user 0.014s	sys 0.001s
W20260709 13:19:54.594380 21145 leader_election.cc:343] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.594980 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cd665cde99440fbd2d8bbd52fbadec" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:54.604857 21105 raft_consensus.cc:3060] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.595357 21300 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:54.596506 21299 tablet_bootstrap.cc:492] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:54.601269 20926 catalog_manager.cc:5697] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.609889 21299 ts_tablet_manager.cc:1403] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.012s
I20260709 13:19:54.612985 21299 raft_consensus.cc:359] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.613747 21299 raft_consensus.cc:385] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.614588 21299 raft_consensus.cc:740] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.615167 21105 raft_consensus.cc:2468] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:54.614312 21300 ts_tablet_manager.cc:1403] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.006s
I20260709 13:19:54.616791 21145 leader_election.cc:304] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:54.620209 21301 ts_tablet_manager.cc:1434] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260709 13:19:54.618674 21300 raft_consensus.cc:359] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.620712 21553 raft_consensus.cc:2804] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.615445 21299 consensus_queue.cc:260] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.621508 21301 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:54.621693 21553 raft_consensus.cc:697] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:54.622740 21553 consensus_queue.cc:237] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.623296 21299 ts_tablet_manager.cc:1434] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:54.624439 21299 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:54.620779 21300 raft_consensus.cc:385] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.625763 21300 raft_consensus.cc:740] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.625847 21030 raft_consensus.cc:3060] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.626709 21300 consensus_queue.cc:260] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.628899 21301 tablet_bootstrap.cc:654] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.633852 21299 tablet_bootstrap.cc:654] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.638487 21547 consensus_queue.cc:1048] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.602669 21302 raft_consensus.cc:359] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.644186 21302 raft_consensus.cc:385] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.644522 21302 raft_consensus.cc:740] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.645399 21300 ts_tablet_manager.cc:1434] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:19:54.646637 21300 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:54.648023 21401 raft_consensus.cc:493] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.648571 21401 raft_consensus.cc:515] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.651551 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:54.653056 21219 leader_election.cc:343] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.654168 21401 leader_election.cc:290] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:54.655794 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
W20260709 13:19:54.657330 21219 leader_election.cc:343] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.657800 21219 leader_election.cc:304] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:54.659188 21401 raft_consensus.cc:2749] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.663200 21457 raft_consensus.cc:493] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.663820 21457 raft_consensus.cc:515] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.666695 21457 leader_election.cc:290] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:54.670799 21300 tablet_bootstrap.cc:654] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.673024 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07889753a7dd4a42b31d46ef6a693f98" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.675382 21301 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:54.675923 21301 ts_tablet_manager.cc:1403] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.012s
I20260709 13:19:54.675962 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07889753a7dd4a42b31d46ef6a693f98" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:54.678889 21301 raft_consensus.cc:359] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.679603 21301 raft_consensus.cc:385] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.679881 21301 raft_consensus.cc:740] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.680503 21301 consensus_queue.cc:260] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.682282 21547 consensus_queue.cc:1048] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.683207 20994 leader_election.cc:304] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:54.684269 21400 raft_consensus.cc:2749] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.688704 21301 ts_tablet_manager.cc:1434] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:19:54.689880 21301 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:54.695418 21300 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:54.696000 21300 ts_tablet_manager.cc:1403] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.050s	user 0.006s	sys 0.007s
I20260709 13:19:54.699625 21300 raft_consensus.cc:359] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.700393 21300 raft_consensus.cc:385] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.700714 21300 raft_consensus.cc:740] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.701409 21300 consensus_queue.cc:260] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.708781 21301 tablet_bootstrap.cc:654] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.712546 21300 ts_tablet_manager.cc:1434] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:54.713645 21300 tablet_bootstrap.cc:492] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:54.720001 21547 raft_consensus.cc:493] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.720662 21547 raft_consensus.cc:515] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.723896 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:54.724823 20926 catalog_manager.cc:5697] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.727283 21547 leader_election.cc:290] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:54.727860 21300 tablet_bootstrap.cc:654] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.727665 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.728667 21253 raft_consensus.cc:2393] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:54.730011 21072 leader_election.cc:304] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:54.731506 21547 raft_consensus.cc:3060] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.739531 21547 raft_consensus.cc:2749] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.726854 21302 consensus_queue.cc:260] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.781278 21391 raft_consensus.cc:493] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.781841 21391 raft_consensus.cc:515] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.789021 21391 leader_election.cc:290] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:54.788326 21401 raft_consensus.cc:493] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.789940 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.797851 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:54.798889 21401 raft_consensus.cc:515] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.800630 21253 raft_consensus.cc:2468] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:54.802824 21146 leader_election.cc:304] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:54.803498 21302 ts_tablet_manager.cc:1434] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.213s	user 0.009s	sys 0.001s
I20260709 13:19:54.803964 21553 raft_consensus.cc:2804] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.804704 21553 raft_consensus.cc:493] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.804930 21302 tablet_bootstrap.cc:492] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
W20260709 13:19:54.806102 21145 leader_election.cc:343] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.815574 21553 raft_consensus.cc:3060] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.848752 21301 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:54.849360 21300 tablet_bootstrap.cc:492] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:54.849409 21301 ts_tablet_manager.cc:1403] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.028s
I20260709 13:19:54.849995 21300 ts_tablet_manager.cc:1403] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.137s	user 0.009s	sys 0.035s
I20260709 13:19:54.847565 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:54.847647 21401 leader_election.cc:290] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:54.847875 21547 raft_consensus.cc:493] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.851320 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:54.851270 21547 raft_consensus.cc:515] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:54.852928 21219 leader_election.cc:343] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.855156 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:54.855532 21299 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:54.856078 21299 ts_tablet_manager.cc:1403] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.232s	user 0.060s	sys 0.098s
I20260709 13:19:54.856359 21553 raft_consensus.cc:515] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:54.857875 21069 leader_election.cc:343] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.860474 21176 raft_consensus.cc:2393] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:54.862275 21217 leader_election.cc:304] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:54.862658 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:54.863523 21401 raft_consensus.cc:3060] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:54.864058 21145 leader_election.cc:343] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.864884 21553 leader_election.cc:290] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:54.853933 21302 tablet_bootstrap.cc:654] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.858534 21300 raft_consensus.cc:359] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.865593 21300 raft_consensus.cc:385] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.865908 21300 raft_consensus.cc:740] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.864806 21547 leader_election.cc:290] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:54.858768 21299 raft_consensus.cc:359] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.866660 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:54.866974 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:54.877720 21299 raft_consensus.cc:385] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.878077 21253 raft_consensus.cc:2468] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:54.876952 21300 consensus_queue.cc:260] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.868954 21457 raft_consensus.cc:493] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.878988 21457 raft_consensus.cc:515] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.880208 21300 ts_tablet_manager.cc:1434] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:19:54.881356 21457 leader_election.cc:290] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:54.878152 21299 raft_consensus.cc:740] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.881484 21072 leader_election.cc:304] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:54.876590 21302 tablet_bootstrap.cc:492] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:54.882090 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cd665cde99440fbd2d8bbd52fbadec" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:54.882562 21302 ts_tablet_manager.cc:1403] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.003s
I20260709 13:19:54.882364 21299 consensus_queue.cc:260] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.882908 21105 raft_consensus.cc:2393] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:54.885794 21302 raft_consensus.cc:359] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.860126 21301 raft_consensus.cc:359] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.886786 21302 raft_consensus.cc:385] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.886996 21301 raft_consensus.cc:385] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.887322 21302 raft_consensus.cc:740] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.887394 21301 raft_consensus.cc:740] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.889665 21299 ts_tablet_manager.cc:1434] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.006s
I20260709 13:19:54.890854 21302 consensus_queue.cc:260] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.891768 21299 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:54.892565 21401 raft_consensus.cc:2749] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.893401 21300 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:54.889801 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62cd665cde99440fbd2d8bbd52fbadec" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:54.890084 21547 raft_consensus.cc:2804] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.895157 21547 raft_consensus.cc:493] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.895570 21547 raft_consensus.cc:3060] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.898511 21299 tablet_bootstrap.cc:654] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.894570 21302 ts_tablet_manager.cc:1434] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:19:54.899713 21302 tablet_bootstrap.cc:492] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:54.899362 21301 consensus_queue.cc:260] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.900169 21254 raft_consensus.cc:2468] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:54.901769 21301 ts_tablet_manager.cc:1434] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
W20260709 13:19:54.904140 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:54.909205 20994 leader_election.cc:304] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:54.914628 21146 leader_election.cc:304] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:54.917860 21457 raft_consensus.cc:3060] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.917913 21553 raft_consensus.cc:2804] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.918581 21553 raft_consensus.cc:697] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:54.919440 21553 consensus_queue.cc:237] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:54.914930 21301 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:54.945080 21300 tablet_bootstrap.cc:654] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.942386 21547 raft_consensus.cc:515] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.949280 21547 leader_election.cc:290] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:54.949864 21254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:54.950503 21254 raft_consensus.cc:3060] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.953102 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:54.953410 21457 raft_consensus.cc:2749] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:54.955106 21069 leader_election.cc:343] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.958215 21299 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:54.958750 21299 ts_tablet_manager.cc:1403] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.015s
I20260709 13:19:54.961561 21299 raft_consensus.cc:359] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.962229 21299 raft_consensus.cc:385] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.962508 21299 raft_consensus.cc:740] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.963135 21299 consensus_queue.cc:260] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:54.946120 21030 raft_consensus.cc:3060] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.964856 21302 tablet_bootstrap.cc:654] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.964890 21299 ts_tablet_manager.cc:1434] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:54.967515 21299 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:54.972508 21300 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:54.973119 21300 ts_tablet_manager.cc:1403] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.002s
I20260709 13:19:54.973623 21254 raft_consensus.cc:2468] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:54.975070 21299 tablet_bootstrap.cc:654] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.978250 21072 leader_election.cc:304] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:54.979450 21487 raft_consensus.cc:2804] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.979931 21487 raft_consensus.cc:697] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:54.976089 21300 raft_consensus.cc:359] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.980749 21487 consensus_queue.cc:237] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:54.980765 21300 raft_consensus.cc:385] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.986231 21300 raft_consensus.cc:740] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.987094 21300 consensus_queue.cc:260] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:54.989284 21300 ts_tablet_manager.cc:1434] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:54.995997 21300 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:54.977160 21301 tablet_bootstrap.cc:654] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.991307 20929 catalog_manager.cc:5697] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.010739 21487 raft_consensus.cc:493] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.011334 21487 raft_consensus.cc:515] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.011647 20926 catalog_manager.cc:5697] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.013984 21487 leader_election.cc:290] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:55.015831 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f1aafd4c14193b9c2e305a7b38209" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:55.016546 21176 raft_consensus.cc:2468] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:55.020668 21300 tablet_bootstrap.cc:654] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.022135 21069 leader_election.cc:304] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.025308 21547 raft_consensus.cc:2804] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.025972 21547 raft_consensus.cc:493] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.026309 21547 raft_consensus.cc:3060] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.024369 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f1aafd4c14193b9c2e305a7b38209" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:55.027014 21250 raft_consensus.cc:2468] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:55.025316 21410 raft_consensus.cc:493] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.029258 21410 raft_consensus.cc:515] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.031455 21410 leader_election.cc:290] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:55.032768 21400 raft_consensus.cc:493] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.033291 21400 raft_consensus.cc:515] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.167382 21302 tablet_bootstrap.cc:492] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:55.168056 21302 ts_tablet_manager.cc:1403] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.269s	user 0.007s	sys 0.020s
I20260709 13:19:55.186589 21299 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:55.187181 21299 ts_tablet_manager.cc:1403] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.220s	user 0.025s	sys 0.024s
I20260709 13:19:55.189929 21299 raft_consensus.cc:359] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.192801 21299 raft_consensus.cc:385] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.193104 21299 raft_consensus.cc:740] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.193778 21299 consensus_queue.cc:260] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.167078 21487 raft_consensus.cc:493] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.200083 21487 raft_consensus.cc:515] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.204671 21400 leader_election.cc:290] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:55.205943 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:55.206491 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:55.207130 21103 raft_consensus.cc:2468] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:55.208356 20996 leader_election.cc:304] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.209048 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:55.209928 21030 raft_consensus.cc:2468] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:55.210915 21487 leader_election.cc:290] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:55.211525 21071 leader_election.cc:304] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.035490 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:55.213907 21176 raft_consensus.cc:2468] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:55.217983 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:55.136162 21401 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.233582 21217 leader_election.cc:304] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:55.239526 21410 raft_consensus.cc:2804] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.239969 21410 raft_consensus.cc:493] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.240337 21410 raft_consensus.cc:3060] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.232870 21390 consensus_queue.cc:1048] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:55.072146 21547 raft_consensus.cc:515] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.227164 21400 raft_consensus.cc:2804] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.250695 21622 raft_consensus.cc:2804] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:55.235021 20994 leader_election.cc:343] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.230372 21401 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.262177 21299 ts_tablet_manager.cc:1434] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.005s
I20260709 13:19:55.259014 21622 raft_consensus.cc:493] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.265911 21622 raft_consensus.cc:3060] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.268028 21299 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:55.254196 21410 raft_consensus.cc:515] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.259076 21400 raft_consensus.cc:493] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.276077 21400 raft_consensus.cc:3060] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.273223 21410 leader_election.cc:290] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
W20260709 13:19:55.307667 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 79413.3us
I20260709 13:19:55.313777 21301 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:55.314338 21301 ts_tablet_manager.cc:1403] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.400s	user 0.021s	sys 0.034s
W20260709 13:19:55.295288 20994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 60400.4us
I20260709 13:19:55.321448 21491 raft_consensus.cc:493] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.322255 21491 raft_consensus.cc:515] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.326046 21491 leader_election.cc:290] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:55.327749 21391 consensus_queue.cc:1048] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.331048 21302 raft_consensus.cc:359] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.335575 21302 raft_consensus.cc:385] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.336161 21302 raft_consensus.cc:740] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.337095 21302 consensus_queue.cc:260] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.339556 21299 tablet_bootstrap.cc:654] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.340211 21302 ts_tablet_manager.cc:1434] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.172s	user 0.009s	sys 0.001s
I20260709 13:19:55.341995 21302 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:55.342353 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:55.335461 21219 leader_election.cc:343] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.360139 21300 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:55.360739 21300 ts_tablet_manager.cc:1403] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.365s	user 0.011s	sys 0.002s
I20260709 13:19:55.368571 21622 raft_consensus.cc:515] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.379504 21301 raft_consensus.cc:359] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.380134 21301 raft_consensus.cc:385] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.380381 21301 raft_consensus.cc:740] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.381095 21301 consensus_queue.cc:260] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.383746 21302 tablet_bootstrap.cc:654] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.388414 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f1aafd4c14193b9c2e305a7b38209" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:55.389204 21178 raft_consensus.cc:3060] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.392187 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:55.393174 21179 raft_consensus.cc:3060] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.396024 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:55.396908 21250 raft_consensus.cc:2468] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:55.362629 21627 consensus_queue.cc:1048] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:19:55.399438 21178 raft_consensus.cc:2468] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
W20260709 13:19:55.400687 21069 leader_election.cc:343] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.401926 21491 raft_consensus.cc:493] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.405179 21632 raft_consensus.cc:493] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.405988 21632 raft_consensus.cc:515] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.407258 21401 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:55.372516 21547 leader_election.cc:290] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:55.402413 21491 raft_consensus.cc:515] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.418267 21632 leader_election.cc:290] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:55.424947 21072 leader_election.cc:304] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.426808 21628 raft_consensus.cc:2804] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.427338 21628 raft_consensus.cc:493] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.427798 21628 raft_consensus.cc:3060] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.429855 21491 leader_election.cc:290] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:55.432482 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:55.436756 21494 consensus_queue.cc:1048] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:55.442909 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ec9a5e146a4779afbe72eb46e5c0c8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:55.444172 21300 raft_consensus.cc:359] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.444983 21300 raft_consensus.cc:385] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.444796 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:55.445289 21300 raft_consensus.cc:740] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.445538 21102 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:55.446172 21300 consensus_queue.cc:260] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.454655 21301 ts_tablet_manager.cc:1434] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.140s	user 0.008s	sys 0.000s
I20260709 13:19:55.456223 21301 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:55.447674 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06f1aafd4c14193b9c2e305a7b38209" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:55.375494 21622 leader_election.cc:290] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:55.473964 21300 ts_tablet_manager.cc:1434] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:19:55.474897 21300 tablet_bootstrap.cc:492] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:55.476383 21251 raft_consensus.cc:3060] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.469709 21069 leader_election.cc:304] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.492515 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:55.493299 21028 raft_consensus.cc:3060] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:55.497951 21145 consensus_peers.cc:597] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.499423 21251 raft_consensus.cc:2468] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:55.497591 21628 raft_consensus.cc:515] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.483021 21400 raft_consensus.cc:515] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.532327 21626 consensus_queue.cc:1048] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:55.537405 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:55.542829 21301 tablet_bootstrap.cc:654] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.529481 21547 raft_consensus.cc:2804] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:55.527793 21069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 58168.7us
I20260709 13:19:55.565447 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:55.566401 21299 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:55.566931 21299 ts_tablet_manager.cc:1403] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.299s	user 0.049s	sys 0.026s
I20260709 13:19:55.565488 21302 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:55.568941 21302 ts_tablet_manager.cc:1403] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.227s	user 0.010s	sys 0.004s
I20260709 13:19:55.550799 21547 raft_consensus.cc:697] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:55.555974 21628 leader_election.cc:290] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:55.585837 21028 raft_consensus.cc:2468] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
W20260709 13:19:55.586017 21072 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.68:37887, user_credentials={real_user=slave}} blocked reactor thread for 83980.3us
I20260709 13:19:55.591274 21299 raft_consensus.cc:359] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.593222 21299 raft_consensus.cc:385] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.593453 21299 raft_consensus.cc:740] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.595997 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:55.596246 21400 leader_election.cc:290] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:55.593899 21299 consensus_queue.cc:260] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.596859 21105 raft_consensus.cc:2393] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
W20260709 13:19:55.579066 21069 leader_election.cc:343] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.579946 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:55.597251 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:55.610384 21031 raft_consensus.cc:2393] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 1: Already voted for candidate 1d804ce9949645b19a0ccc1faf258ec7 in this term.
I20260709 13:19:55.614425 21621 raft_consensus.cc:493] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.615022 21621 raft_consensus.cc:515] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:55.617538 21219 leader_election.cc:343] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:55.618400 21219 leader_election.cc:343] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.619314 21621 leader_election.cc:290] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:55.620530 21071 leader_election.cc:304] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
W20260709 13:19:55.621893 21071 leader_election.cc:343] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.622777 21300 tablet_bootstrap.cc:654] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.624377 21621 raft_consensus.cc:2749] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.624593 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ec9a5e146a4779afbe72eb46e5c0c8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:55.625677 21302 raft_consensus.cc:359] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.626612 21302 raft_consensus.cc:385] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.626907 21302 raft_consensus.cc:740] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.631333 21302 consensus_queue.cc:260] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.636646 21299 ts_tablet_manager.cc:1434] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.000s
I20260709 13:19:55.603344 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:55.596998 21547 consensus_queue.cc:237] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.639777 21299 tablet_bootstrap.cc:492] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:55.645386 21179 raft_consensus.cc:2468] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
W20260709 13:19:55.640931 21069 leader_election.cc:343] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.620631 21219 leader_election.cc:304] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:55.653329 21302 ts_tablet_manager.cc:1434] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:19:55.654726 21302 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:55.657608 21249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:55.658334 21249 raft_consensus.cc:2468] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:55.659138 21628 consensus_queue.cc:1048] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.660826 21570 raft_consensus.cc:2804] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.661376 21570 raft_consensus.cc:697] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
W20260709 13:19:55.654276 21071 leader_election.cc:343] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.662180 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
W20260709 13:19:55.653322 21069 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 46692.8us
I20260709 13:19:55.673336 21253 raft_consensus.cc:3060] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.673254 21031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:55.665288 21570 consensus_queue.cc:237] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:55.668249 21219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 47752.1us
I20260709 13:19:55.671782 21072 leader_election.cc:304] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.704229 21300 tablet_bootstrap.cc:492] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:55.704811 21300 ts_tablet_manager.cc:1403] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.230s	user 0.012s	sys 0.011s
I20260709 13:19:55.709259 21628 raft_consensus.cc:2804] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.711952 21302 tablet_bootstrap.cc:654] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.714530 21300 raft_consensus.cc:359] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.715603 21300 raft_consensus.cc:385] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.716383 21300 raft_consensus.cc:740] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.717015 21300 consensus_queue.cc:260] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.718689 21300 ts_tablet_manager.cc:1434] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.004s
I20260709 13:19:55.713881 21628 raft_consensus.cc:493] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.712016 21071 leader_election.cc:304] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:55.719595 21300 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
W20260709 13:19:55.720307 21071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 74529.1us
I20260709 13:19:55.721303 21219 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:55.722761 21624 raft_consensus.cc:2749] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.724241 21629 raft_consensus.cc:2804] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.715149 21253 raft_consensus.cc:2468] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:55.726913 21629 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.727300 21629 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.727447 21072 leader_election.cc:304] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.733222 21301 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:55.733942 21301 ts_tablet_manager.cc:1403] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.278s	user 0.019s	sys 0.017s
I20260709 13:19:55.736057 21299 tablet_bootstrap.cc:654] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.736747 21301 raft_consensus.cc:359] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.740298 21301 raft_consensus.cc:385] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.740662 21301 raft_consensus.cc:740] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.742120 21491 raft_consensus.cc:2804] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.741341 21301 consensus_queue.cc:260] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.752975 21457 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.753417 21628 raft_consensus.cc:3060] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.753546 21457 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.755393 21491 raft_consensus.cc:697] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:55.756481 21491 consensus_queue.cc:237] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.757030 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:55.757746 21105 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
I20260709 13:19:55.759399 20996 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:55.760687 21457 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:55.762020 21457 raft_consensus.cc:2804] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.762964 21570 raft_consensus.cc:493] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.766332 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:55.766193 21570 raft_consensus.cc:515] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.769294 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:55.770802 21217 leader_election.cc:343] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.789000 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:55.789815 21178 raft_consensus.cc:3060] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.793722 21301 ts_tablet_manager.cc:1434] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:19:55.795003 21301 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:55.772464 21457 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.812096 21300 tablet_bootstrap.cc:654] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.820277 20926 catalog_manager.cc:5697] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.803849 21457 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.824520 21570 leader_election.cc:290] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:55.844379 21299 tablet_bootstrap.cc:492] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:55.845016 21299 ts_tablet_manager.cc:1403] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.207s	user 0.029s	sys 0.011s
I20260709 13:19:55.845094 21628 raft_consensus.cc:515] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.833421 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:55.849086 21103 raft_consensus.cc:2393] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:19:55.848039 21628 leader_election.cc:290] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:55.848037 21299 raft_consensus.cc:359] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.834645 21179 raft_consensus.cc:3060] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.856082 21299 raft_consensus.cc:385] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.856864 21299 raft_consensus.cc:740] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.857535 21299 consensus_queue.cc:260] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.858718 21219 leader_election.cc:304] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:55.861595 21630 raft_consensus.cc:3060] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.867501 21299 ts_tablet_manager.cc:1434] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:19:55.873910 21301 tablet_bootstrap.cc:654] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.876706 21249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:55.884202 21178 raft_consensus.cc:2468] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:55.876175 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:55.870934 21629 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.892751 21251 raft_consensus.cc:2393] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in this term.
I20260709 13:19:55.895314 21629 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:55.908218 21626 raft_consensus.cc:493] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.909163 21626 raft_consensus.cc:515] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:55.923945 20929 catalog_manager.cc:5697] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.925877 21457 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.930771 21547 consensus_queue.cc:1048] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.931814 21299 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
W20260709 13:19:55.934384 21071 leader_election.cc:343] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:55.935451 21071 leader_election.cc:343] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.939801 21299 tablet_bootstrap.cc:654] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.924408 21630 raft_consensus.cc:2749] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.941241 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:55.941953 21105 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.942605 20994 leader_election.cc:304] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:55.943713 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:55.945562 21400 raft_consensus.cc:2804] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.946133 21400 raft_consensus.cc:697] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:55.947029 21400 consensus_queue.cc:237] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:55.948712 21457 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:55.949153 21249 raft_consensus.cc:2468] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
W20260709 13:19:55.952126 21071 leader_election.cc:343] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.958452 21300 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:55.959013 21300 ts_tablet_manager.cc:1403] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.240s	user 0.010s	sys 0.013s
I20260709 13:19:55.963057 21105 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:55.966773 21072 leader_election.cc:304] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:55.967826 20996 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:55.968065 21624 raft_consensus.cc:2804] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.968652 21624 raft_consensus.cc:697] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:55.969597 21457 raft_consensus.cc:2804] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.969542 21624 consensus_queue.cc:237] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.970454 21457 raft_consensus.cc:697] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:55.971383 21457 consensus_queue.cc:237] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:55.994656 21300 raft_consensus.cc:359] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:55.995476 21300 raft_consensus.cc:385] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.995772 21300 raft_consensus.cc:740] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.996479 21300 consensus_queue.cc:260] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:56.006685 20994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 64186.2us
I20260709 13:19:56.017270 21300 ts_tablet_manager.cc:1434] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.002s
I20260709 13:19:56.020223 21300 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:56.026289 21626 leader_election.cc:290] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:56.029045 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:56.030122 21300 tablet_bootstrap.cc:654] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:56.040817 21219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 145368us
I20260709 13:19:56.048581 21023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:56.052150 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:56.064968 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:56.066084 21102 raft_consensus.cc:2393] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 1: Already voted for candidate 1d804ce9949645b19a0ccc1faf258ec7 in this term.
I20260709 13:19:56.041317 21302 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:56.041183 21301 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:56.079370 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:56.081595 20926 catalog_manager.cc:5697] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.080041 21302 ts_tablet_manager.cc:1403] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.426s	user 0.042s	sys 0.063s
I20260709 13:19:56.083632 20926 catalog_manager.cc:5697] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:56.080511 21301 ts_tablet_manager.cc:1403] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.286s	user 0.014s	sys 0.005s
W20260709 13:19:56.074465 21219 leader_election.cc:343] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.100384 21299 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:56.101094 21299 ts_tablet_manager.cc:1403] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.023s
I20260709 13:19:56.102924 20927 catalog_manager.cc:5697] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.104056 21299 raft_consensus.cc:359] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.104900 21299 raft_consensus.cc:385] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.105214 20927 catalog_manager.cc:5697] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.092133 21219 leader_election.cc:304] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:56.108124 21632 raft_consensus.cc:2749] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.105201 21299 raft_consensus.cc:740] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.109753 21219 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:56.110188 21299 consensus_queue.cc:260] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.110733 21629 raft_consensus.cc:2749] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.088011 21301 raft_consensus.cc:359] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.113854 21301 raft_consensus.cc:385] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.114188 21301 raft_consensus.cc:740] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.114998 21299 ts_tablet_manager.cc:1434] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:19:56.116458 21302 raft_consensus.cc:359] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.117286 21302 raft_consensus.cc:385] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.117580 21302 raft_consensus.cc:740] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.118369 21299 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:56.118304 21302 consensus_queue.cc:260] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.123661 21301 consensus_queue.cc:260] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:56.124452 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:56.127070 21300 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:56.127213 21301 ts_tablet_manager.cc:1434] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:19:56.127642 21300 ts_tablet_manager.cc:1403] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.015s
I20260709 13:19:56.129446 21302 ts_tablet_manager.cc:1434] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:19:56.130386 21301 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:56.137410 21302 tablet_bootstrap.cc:492] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:56.137714 21632 raft_consensus.cc:493] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.138269 21632 raft_consensus.cc:515] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.141693 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:56.141722 21632 leader_election.cc:290] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
W20260709 13:19:56.144165 21217 leader_election.cc:343] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.144369 21300 raft_consensus.cc:359] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.145197 21300 raft_consensus.cc:385] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.145519 21300 raft_consensus.cc:740] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.146384 21300 consensus_queue.cc:260] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.148895 21300 ts_tablet_manager.cc:1434] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:19:56.150427 21299 tablet_bootstrap.cc:654] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.152475 21145 leader_election.cc:304] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:56.153381 21494 raft_consensus.cc:2749] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:56.155745 21624 raft_consensus.cc:493] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.155505 21301 tablet_bootstrap.cc:654] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.156349 21624 raft_consensus.cc:515] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:56.158598 21219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 46242.1us
I20260709 13:19:56.164755 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:56.165537 21252 raft_consensus.cc:2468] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:56.166474 21624 leader_election.cc:290] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:56.168063 21072 leader_election.cc:304] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:56.169734 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:56.171550 21069 leader_election.cc:343] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.172194 21301 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:56.172575 21624 raft_consensus.cc:2804] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.173161 21624 raft_consensus.cc:493] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.174096 21624 raft_consensus.cc:3060] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.175604 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:56.144158 21302 tablet_bootstrap.cc:654] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.180402 21491 consensus_queue.cc:1048] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.172776 21301 ts_tablet_manager.cc:1403] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.005s
I20260709 13:19:56.186914 21629 raft_consensus.cc:493] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.187674 21629 raft_consensus.cc:515] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.192241 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7eae6372364e919b8c6f1a4d358a77" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:56.192806 21300 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:56.196344 21301 raft_consensus.cc:359] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.200031 21301 raft_consensus.cc:385] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.200356 21301 raft_consensus.cc:740] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
W20260709 13:19:56.203487 21217 leader_election.cc:343] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.210161 21629 leader_election.cc:290] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:56.211447 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7eae6372364e919b8c6f1a4d358a77" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:56.211628 21621 consensus_queue.cc:1048] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.212433 21301 consensus_queue.cc:260] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:56.219225 21219 leader_election.cc:343] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.219815 21219 leader_election.cc:304] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:56.220578 21301 ts_tablet_manager.cc:1434] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:19:56.220870 21660 raft_consensus.cc:2749] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.221618 21301 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:56.211335 21624 raft_consensus.cc:515] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.226171 21104 raft_consensus.cc:2393] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:19:56.226449 21632 consensus_queue.cc:1048] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.235437 21632 raft_consensus.cc:493] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.236084 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:56.236012 21632 raft_consensus.cc:515] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:56.241009 21069 leader_election.cc:343] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.245807 21632 leader_election.cc:290] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:56.245937 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:56.246837 21219 leader_election.cc:304] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
W20260709 13:19:56.247820 21217 leader_election.cc:343] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.249357 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:56.251968 21219 leader_election.cc:343] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.254031 21300 tablet_bootstrap.cc:654] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.258875 21302 tablet_bootstrap.cc:492] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:56.259349 21302 ts_tablet_manager.cc:1403] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.018s
I20260709 13:19:56.262019 21302 raft_consensus.cc:359] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.262691 21302 raft_consensus.cc:385] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.262965 21302 raft_consensus.cc:740] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.263748 21302 consensus_queue.cc:260] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.252682 21219 leader_election.cc:304] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:56.278203 21299 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:56.250869 21632 raft_consensus.cc:3060] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.279541 21630 raft_consensus.cc:2749] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.288276 21401 consensus_queue.cc:1048] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.289786 21626 raft_consensus.cc:493] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.290575 21299 ts_tablet_manager.cc:1403] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.003s
I20260709 13:19:56.290346 21626 raft_consensus.cc:515] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.280079 21624 leader_election.cc:290] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:56.293669 21626 leader_election.cc:290] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:56.294847 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:56.295787 21102 raft_consensus.cc:2393] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9bc329a3e3d74a618ce2b4749aaafec8 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:19:56.295899 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:56.298003 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:56.299733 21302 ts_tablet_manager.cc:1434] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 13:19:56.301455 21302 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:56.301726 21145 leader_election.cc:304] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:56.303333 21301 tablet_bootstrap.cc:654] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.306038 21390 raft_consensus.cc:3060] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.314108 21299 raft_consensus.cc:359] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.314879 21299 raft_consensus.cc:385] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.315148 21299 raft_consensus.cc:740] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.331581 21390 raft_consensus.cc:2749] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.324105 21299 consensus_queue.cc:260] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.345264 21632 raft_consensus.cc:2749] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.344630 21491 raft_consensus.cc:493] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.347146 21491 raft_consensus.cc:515] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.350840 21491 leader_election.cc:290] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:56.354772 21299 ts_tablet_manager.cc:1434] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.001s
I20260709 13:19:56.356292 21299 tablet_bootstrap.cc:492] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:56.367117 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:56.369261 21071 leader_election.cc:343] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.369935 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
W20260709 13:19:56.372651 21072 leader_election.cc:343] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.373179 21072 leader_election.cc:304] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:56.374369 21624 raft_consensus.cc:2749] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.387267 21301 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:56.387889 21301 ts_tablet_manager.cc:1403] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.010s
I20260709 13:19:56.387758 21250 raft_consensus.cc:2468] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:56.391446 21302 tablet_bootstrap.cc:654] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.395803 21301 raft_consensus.cc:359] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.397893 21072 leader_election.cc:304] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:56.399344 21491 raft_consensus.cc:2804] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:56.399925 21491 raft_consensus.cc:697] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:56.400734 21302 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:56.401335 21302 ts_tablet_manager.cc:1403] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.100s	user 0.004s	sys 0.008s
I20260709 13:19:56.400768 21491 consensus_queue.cc:237] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.401727 21301 raft_consensus.cc:385] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.402104 21301 raft_consensus.cc:740] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.402887 21301 consensus_queue.cc:260] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.404196 21302 raft_consensus.cc:359] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.404922 21302 raft_consensus.cc:385] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.405189 21302 raft_consensus.cc:740] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.405512 21301 ts_tablet_manager.cc:1434] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.005s
I20260709 13:19:56.401778 21300 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:56.405947 21302 consensus_queue.cc:260] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.406495 21300 ts_tablet_manager.cc:1403] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.214s	user 0.022s	sys 0.039s
I20260709 13:19:56.408452 21301 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:56.410401 21299 tablet_bootstrap.cc:654] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.414640 21301 tablet_bootstrap.cc:654] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.411808 21302 ts_tablet_manager.cc:1434] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:56.415745 21302 tablet_bootstrap.cc:492] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:56.412761 21300 raft_consensus.cc:359] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.422554 21300 raft_consensus.cc:385] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.422431 21624 consensus_queue.cc:1048] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.426405 21300 raft_consensus.cc:740] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.429513 21300 consensus_queue.cc:260] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.432948 21300 ts_tablet_manager.cc:1434] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:19:56.433624 21301 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:56.434166 21301 ts_tablet_manager.cc:1403] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:19:56.434194 21300 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:56.437084 21301 raft_consensus.cc:359] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.437801 21301 raft_consensus.cc:385] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.438086 21301 raft_consensus.cc:740] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.438953 21301 consensus_queue.cc:260] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.441164 21299 tablet_bootstrap.cc:492] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:56.442126 21299 ts_tablet_manager.cc:1403] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.001s
I20260709 13:19:56.442442 21301 ts_tablet_manager.cc:1434] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:56.443449 21301 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:56.445654 21299 raft_consensus.cc:359] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.449609 21301 tablet_bootstrap.cc:654] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.450979 21299 raft_consensus.cc:385] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.451287 21299 raft_consensus.cc:740] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.452041 21299 consensus_queue.cc:260] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.454353 21299 ts_tablet_manager.cc:1434] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:19:56.458734 21300 tablet_bootstrap.cc:654] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.462011 21299 tablet_bootstrap.cc:492] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:56.464612 21302 tablet_bootstrap.cc:654] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.538048 21299 tablet_bootstrap.cc:654] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.542501 21491 raft_consensus.cc:493] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.546133 21629 raft_consensus.cc:493] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.548563 21629 raft_consensus.cc:515] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.549579 21028 raft_consensus.cc:3060] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.544000 21491 raft_consensus.cc:515] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.561978 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:56.571044 21069 leader_election.cc:343] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.560112 21400 raft_consensus.cc:493] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.573299 21400 raft_consensus.cc:515] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.585011 21547 raft_consensus.cc:493] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.586275 21547 raft_consensus.cc:515] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.564859 21457 raft_consensus.cc:493] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.590848 21457 raft_consensus.cc:515] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.594559 21457 leader_election.cc:290] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:56.596971 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:56.601356 21491 leader_election.cc:290] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:56.602008 21491 consensus_queue.cc:1048] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.606776 21400 leader_election.cc:290] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:56.609387 21547 leader_election.cc:290] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:56.618604 21031 raft_consensus.cc:3060] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.623621 21494 raft_consensus.cc:493] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.624734 21494 raft_consensus.cc:515] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.628036 21494 leader_election.cc:290] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:56.634379 20927 catalog_manager.cc:5697] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.637338 21626 raft_consensus.cc:493] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.638470 21626 raft_consensus.cc:515] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:56.642793 21626 leader_election.cc:290] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:56.670626 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:56.672772 21219 leader_election.cc:343] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.710831 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:56.711992 21250 raft_consensus.cc:2468] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:56.714365 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:56.720955 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:56.724910 21400 consensus_queue.cc:1048] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:19:56.736207 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ec9a5e146a4779afbe72eb46e5c0c8" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:56.739948 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ec9a5e146a4779afbe72eb46e5c0c8" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:56.742642 21629 leader_election.cc:290] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:56.755427 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5ea23e9d27e4929a6b8615fc593610e" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:56.755649 21101 raft_consensus.cc:2468] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:56.758764 21253 raft_consensus.cc:2393] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:19:56.759253 21026 raft_consensus.cc:2468] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:56.763163 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:56.766995 21300 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:56.767946 21300 ts_tablet_manager.cc:1403] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.334s	user 0.013s	sys 0.005s
W20260709 13:19:56.769065 21069 leader_election.cc:343] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:56.773353 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 92821.1us
I20260709 13:19:56.781495 21689 consensus_queue.cc:1048] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:19:56.782207 21301 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:56.783180 21301 ts_tablet_manager.cc:1403] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.340s	user 0.014s	sys 0.016s
I20260709 13:19:56.783286 21023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:56.783916 21026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:56.788995 21252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:56.793658 21029 raft_consensus.cc:3060] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.801753 21105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:56.802718 21105 raft_consensus.cc:2468] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:56.811153 21302 tablet_bootstrap.cc:492] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:56.812029 21302 ts_tablet_manager.cc:1403] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.396s	user 0.016s	sys 0.002s
I20260709 13:19:56.817894 21219 leader_election.cc:304] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:56.820729 21145 leader_election.cc:304] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
W20260709 13:19:56.840169 21071 leader_election.cc:343] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.849447 20997 leader_election.cc:304] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:56.850991 20997 leader_election.cc:304] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:56.853111 21146 leader_election.cc:304] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:56.857986 21391 raft_consensus.cc:2804] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.858633 21391 raft_consensus.cc:493] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.859043 21391 raft_consensus.cc:3060] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:56.865756 21072 leader_election.cc:343] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.866420 21072 leader_election.cc:304] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:56.868186 21624 raft_consensus.cc:2749] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.853976 21071 leader_election.cc:304] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:56.864203 21626 raft_consensus.cc:2804] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.873471 21626 raft_consensus.cc:493] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.873893 21626 raft_consensus.cc:3060] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.881868 21401 raft_consensus.cc:2804] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.882520 21401 raft_consensus.cc:493] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.882977 21401 raft_consensus.cc:3060] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:56.893664 21145 leader_election.cc:343] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.899199 21301 raft_consensus.cc:359] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.900310 21301 raft_consensus.cc:385] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.902426 21302 raft_consensus.cc:359] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.907121 21302 raft_consensus.cc:385] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.906450 21301 raft_consensus.cc:740] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.912333 21302 raft_consensus.cc:740] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.920429 21301 consensus_queue.cc:260] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:56.925037 21302 consensus_queue.cc:260] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:56.934578 21299 tablet_bootstrap.cc:492] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:56.936893 21690 raft_consensus.cc:2749] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.957305 21634 raft_consensus.cc:493] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.960345 21301 ts_tablet_manager.cc:1434] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.177s	user 0.008s	sys 0.002s
I20260709 13:19:56.962736 21302 ts_tablet_manager.cc:1434] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.150s	user 0.009s	sys 0.001s
I20260709 13:19:56.972903 21401 raft_consensus.cc:515] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.973932 21300 raft_consensus.cc:359] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:56.989084 21300 raft_consensus.cc:385] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.989429 21300 raft_consensus.cc:740] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.980031 21624 consensus_queue.cc:1048] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.991899 21457 raft_consensus.cc:2749] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.997793 21690 consensus_queue.cc:1048] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.000310 21300 consensus_queue.cc:260] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.001026 21391 raft_consensus.cc:515] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.008213 21400 raft_consensus.cc:2749] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.002175 21634 raft_consensus.cc:515] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:57.013805 20996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 47128us
I20260709 13:19:57.015369 21695 consensus_queue.cc:1048] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.018961 21626 raft_consensus.cc:515] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.019836 21302 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:57.021134 21301 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:57.021605 21299 ts_tablet_manager.cc:1403] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.560s	user 0.025s	sys 0.007s
I20260709 13:19:57.029024 21624 consensus_queue.cc:1048] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.029444 21401 leader_election.cc:290] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:57.032465 21299 raft_consensus.cc:359] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.037353 21391 leader_election.cc:290] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:57.042866 21302 tablet_bootstrap.cc:654] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.036827 21299 raft_consensus.cc:385] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.044998 21299 raft_consensus.cc:740] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.046175 21299 consensus_queue.cc:260] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.048527 21626 leader_election.cc:290] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:57.057015 21301 tablet_bootstrap.cc:654] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.063715 21634 leader_election.cc:290] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:57.083178 21299 ts_tablet_manager.cc:1434] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 13:19:57.124496 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:57.125453 21250 raft_consensus.cc:3060] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.080914 21547 consensus_queue.cc:1048] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.064s
I20260709 13:19:57.170451 21299 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:57.170943 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:57.206243 21299 tablet_bootstrap.cc:654] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.207828 21300 ts_tablet_manager.cc:1434] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.439s	user 0.016s	sys 0.019s
I20260709 13:19:57.214890 21301 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:57.215530 21301 ts_tablet_manager.cc:1403] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.195s	user 0.005s	sys 0.016s
I20260709 13:19:57.216661 21302 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:57.217196 21302 ts_tablet_manager.cc:1403] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.009s
I20260709 13:19:57.213261 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:57.225629 21099 raft_consensus.cc:3060] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.228777 21709 raft_consensus.cc:493] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.229427 21709 raft_consensus.cc:515] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.230003 21300 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:57.233112 21097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:57.233847 21097 raft_consensus.cc:2468] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 0.
W20260709 13:19:57.236208 21701 log.cc:927] Time spent T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Append to log took a long time: real 0.127s	user 0.000s	sys 0.003s
I20260709 13:19:57.228183 21302 raft_consensus.cc:359] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.238237 21302 raft_consensus.cc:385] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.238618 21302 raft_consensus.cc:740] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.245887 20996 leader_election.cc:304] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:57.249959 21023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:57.251438 21103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "157364afaee148b998ca48df7e81225e" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:57.254778 21302 consensus_queue.cc:260] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.259284 21301 raft_consensus.cc:359] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.262388 21301 raft_consensus.cc:385] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.262662 21301 raft_consensus.cc:740] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.261667 21634 consensus_queue.cc:1048] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:19:57.276232 21099 raft_consensus.cc:2468] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:57.282677 21219 leader_election.cc:304] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:57.284039 21401 raft_consensus.cc:2804] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.257743 21457 raft_consensus.cc:2804] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.297772 20997 leader_election.cc:304] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:57.297688 21301 consensus_queue.cc:260] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.259018 21709 leader_election.cc:290] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:57.295583 21457 raft_consensus.cc:493] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.284649 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ec9a5e146a4779afbe72eb46e5c0c8" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:57.324914 21102 raft_consensus.cc:3060] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.325270 21301 ts_tablet_manager.cc:1434] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.001s
I20260709 13:19:57.326593 21301 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:57.330415 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ec9a5e146a4779afbe72eb46e5c0c8" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:57.331203 21024 raft_consensus.cc:3060] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.332051 21300 tablet_bootstrap.cc:654] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.335147 21553 raft_consensus.cc:493] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.335676 21553 raft_consensus.cc:515] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.337780 21302 ts_tablet_manager.cc:1434] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.000s
I20260709 13:19:57.339025 21553 leader_election.cc:290] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:57.339582 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:57.284714 21401 raft_consensus.cc:697] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:57.341274 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:57.341462 21401 consensus_queue.cc:237] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.342017 21101 raft_consensus.cc:2468] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:57.324165 21457 raft_consensus.cc:3060] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.345260 21145 leader_election.cc:304] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:57.347347 21390 raft_consensus.cc:2804] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.347723 21390 raft_consensus.cc:493] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.348063 21390 raft_consensus.cc:3060] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.349318 21024 raft_consensus.cc:2468] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:57.354224 21632 raft_consensus.cc:493] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.354806 21632 raft_consensus.cc:515] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.357626 21632 leader_election.cc:290] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:57.339071 21302 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:57.362615 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
W20260709 13:19:57.368182 21146 leader_election.cc:343] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:57.370594 20997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:37887, user_credentials={real_user=slave}} blocked reactor thread for 67809.4us
W20260709 13:19:57.381127 20996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 58810.7us
I20260709 13:19:57.395685 21250 raft_consensus.cc:2468] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:57.398236 21102 raft_consensus.cc:2468] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:57.402122 21146 leader_election.cc:304] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:57.420948 21301 tablet_bootstrap.cc:654] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:57.422241 21145 leader_election.cc:343] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.410305 21098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:57.419348 21390 raft_consensus.cc:515] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.426065 21553 raft_consensus.cc:2804] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:57.458817 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 50759.5us
I20260709 13:19:57.459362 21390 leader_election.cc:290] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:57.461012 21689 raft_consensus.cc:493] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.461611 21689 raft_consensus.cc:515] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.465133 21708 raft_consensus.cc:2749] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:57.466886 21249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
W20260709 13:19:57.467175 21219 leader_election.cc:343] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.468137 21689 leader_election.cc:290] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:57.446795 21553 raft_consensus.cc:697] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
W20260709 13:19:57.472118 21146 leader_election.cc:343] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.486691 21457 raft_consensus.cc:515] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.480782 21624 raft_consensus.cc:493] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.490556 21624 raft_consensus.cc:515] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.478789 21553 consensus_queue.cc:237] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.497643 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fc8ae4e5ba4be69acf20c7759745ec" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:57.501755 21390 raft_consensus.cc:493] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.502316 21390 raft_consensus.cc:515] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.506476 21302 tablet_bootstrap.cc:654] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.480113 21145 leader_election.cc:304] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
W20260709 13:19:57.523139 20997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:37887, user_credentials={real_user=slave}} blocked reactor thread for 67017.9us
W20260709 13:19:57.532738 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:57.533269 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91f39c6153492a8fd05d9918062caa" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:57.533610 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:57.534583 21253 raft_consensus.cc:2393] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:57.535826 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:57.504480 21390 leader_election.cc:290] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:57.543826 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91f39c6153492a8fd05d9918062caa" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:57.541442 21102 raft_consensus.cc:3060] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.562070 21704 raft_consensus.cc:2804] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.562834 21704 raft_consensus.cc:697] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:57.563585 21249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fc8ae4e5ba4be69acf20c7759745ec" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:57.539520 21098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:57.568027 21098 raft_consensus.cc:3060] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:57.541811 21069 leader_election.cc:343] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:57.577355 21145 leader_election.cc:343] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:57.592442 21728 log.cc:927] Time spent T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:19:57.528836 21624 leader_election.cc:290] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:19:57.600978 21299 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:57.601558 21299 ts_tablet_manager.cc:1403] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.431s	user 0.031s	sys 0.024s
W20260709 13:19:57.602003 21145 leader_election.cc:343] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:57.612053 21072 leader_election.cc:343] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.612774 21072 leader_election.cc:304] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:57.615298 21547 raft_consensus.cc:2749] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.583412 21457 leader_election.cc:290] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:57.603996 21145 leader_election.cc:304] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:57.564103 21704 consensus_queue.cc:237] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.625012 21626 raft_consensus.cc:2749] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.637720 21300 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:57.638260 21300 ts_tablet_manager.cc:1403] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.409s	user 0.013s	sys 0.008s
I20260709 13:19:57.642136 21299 raft_consensus.cc:359] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.643046 21299 raft_consensus.cc:385] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.643333 21299 raft_consensus.cc:740] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.649024 21301 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:57.649776 21301 ts_tablet_manager.cc:1403] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.323s	user 0.024s	sys 0.010s
I20260709 13:19:57.642302 21302 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:57.651508 21302 ts_tablet_manager.cc:1403] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.313s	user 0.020s	sys 0.022s
I20260709 13:19:57.653362 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:57.659655 21300 raft_consensus.cc:359] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.663524 21300 raft_consensus.cc:385] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.663983 21300 raft_consensus.cc:740] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.660877 21299 consensus_queue.cc:260] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:57.630450 21731 log.cc:927] Time spent T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:19:57.666947 21300 consensus_queue.cc:260] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:19:57.677743 20994 leader_election.cc:343] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.680521 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:57.678778 21302 raft_consensus.cc:359] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.684942 21302 raft_consensus.cc:385] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.685365 21302 raft_consensus.cc:740] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.685424 20926 catalog_manager.cc:5697] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.686818 21302 consensus_queue.cc:260] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.690652 21302 ts_tablet_manager.cc:1434] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 13:19:57.693095 21302 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:57.697857 21299 ts_tablet_manager.cc:1434] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 13:19:57.699411 21299 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:57.687321 21098 raft_consensus.cc:2468] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:57.694392 21624 raft_consensus.cc:493] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.700950 21624 raft_consensus.cc:515] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.693818 21301 raft_consensus.cc:359] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.705061 21301 raft_consensus.cc:385] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.705474 21301 raft_consensus.cc:740] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.706527 21624 leader_election.cc:290] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:57.706301 21301 consensus_queue.cc:260] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.707357 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:57.708105 21253 raft_consensus.cc:2468] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:57.708743 21301 ts_tablet_manager.cc:1434] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260709 13:19:57.709568 21072 leader_election.cc:304] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:57.709918 21301 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:57.695240 21300 ts_tablet_manager.cc:1434] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.005s
I20260709 13:19:57.711585 21300 tablet_bootstrap.cc:492] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:57.679934 21102 raft_consensus.cc:2468] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:57.719276 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69c0be6c701f4fae9083797282669fe3" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:57.721792 20996 leader_election.cc:304] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:57.722518 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:57.722842 21689 raft_consensus.cc:2804] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.723217 21179 raft_consensus.cc:3060] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.723387 21689 raft_consensus.cc:697] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:19:57.724337 21689 consensus_queue.cc:237] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.725951 21300 tablet_bootstrap.cc:654] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.727583 21624 raft_consensus.cc:2804] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:57.728035 21624 raft_consensus.cc:493] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:57.728415 21624 raft_consensus.cc:3060] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.732589 21179 raft_consensus.cc:2468] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 1.
I20260709 13:19:57.739274 21145 leader_election.cc:304] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:19:57.745487 21390 raft_consensus.cc:2804] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.762993 21390 raft_consensus.cc:697] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:57.765616 20994 leader_election.cc:304] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:57.766175 21390 consensus_queue.cc:237] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.767210 21709 raft_consensus.cc:3060] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:57.763321 21219 leader_election.cc:343] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.773545 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:57.775767 21734 raft_consensus.cc:493] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:57.772423 21219 leader_election.cc:343] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.777271 21219 leader_election.cc:304] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
W20260709 13:19:57.777561 21071 leader_election.cc:343] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.776386 21734 raft_consensus.cc:515] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.791501 21029 raft_consensus.cc:3060] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.797511 21249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:57.802688 21302 tablet_bootstrap.cc:654] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.795562 21632 raft_consensus.cc:2749] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.809206 21734 leader_election.cc:290] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:57.810456 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:57.811326 21102 raft_consensus.cc:2393] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in this term.
I20260709 13:19:57.812675 20996 leader_election.cc:304] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:57.817817 21300 tablet_bootstrap.cc:492] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:57.818420 21300 ts_tablet_manager.cc:1403] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.005s
I20260709 13:19:57.804203 21624 raft_consensus.cc:515] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.832124 21299 tablet_bootstrap.cc:654] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.838707 21300 raft_consensus.cc:359] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.839507 21300 raft_consensus.cc:385] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.839785 21300 raft_consensus.cc:740] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.840824 21300 consensus_queue.cc:260] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.843626 21300 ts_tablet_manager.cc:1434] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:19:57.846079 21624 leader_election.cc:290] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:57.849722 21709 raft_consensus.cc:2749] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.856277 21247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:57.857703 21247 raft_consensus.cc:3060] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.862038 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
W20260709 13:19:57.864225 21071 leader_election.cc:343] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.882297 21734 raft_consensus.cc:2749] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.884001 21247 raft_consensus.cc:2468] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:57.885254 21632 consensus_queue.cc:1048] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:57.885748 21072 leader_election.cc:304] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:57.886997 21621 raft_consensus.cc:2804] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:57.887493 21621 raft_consensus.cc:697] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:57.888309 21621 consensus_queue.cc:237] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:57.898108 21301 tablet_bootstrap.cc:654] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.900401 21300 tablet_bootstrap.cc:492] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:57.910635 21300 tablet_bootstrap.cc:654] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.908358 21707 consensus_queue.cc:1048] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:19:57.914409 21302 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:57.915108 21302 ts_tablet_manager.cc:1403] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.222s	user 0.007s	sys 0.008s
I20260709 13:19:57.935196 21302 raft_consensus.cc:359] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.935758 21302 raft_consensus.cc:385] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.935993 21302 raft_consensus.cc:740] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.940420 21299 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:57.941155 21299 ts_tablet_manager.cc:1403] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.242s	user 0.012s	sys 0.002s
I20260709 13:19:57.943061 21302 consensus_queue.cc:260] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.946159 21302 ts_tablet_manager.cc:1434] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:19:57.947289 21302 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:57.951614 21707 raft_consensus.cc:493] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.952173 21707 raft_consensus.cc:515] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:57.960059 20929 catalog_manager.cc:5697] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:57.969319 21302 tablet_bootstrap.cc:654] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:57.973176 21301 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:57.973737 21301 ts_tablet_manager.cc:1403] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.264s	user 0.015s	sys 0.008s
I20260709 13:19:57.975119 21299 raft_consensus.cc:359] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.975666 21299 raft_consensus.cc:385] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.975916 21299 raft_consensus.cc:740] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.972471 20929 catalog_manager.cc:5697] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.985332 21707 leader_election.cc:290] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:57.987871 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:57.983593 21299 consensus_queue.cc:260] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:57.996847 21301 raft_consensus.cc:359] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:57.997637 21301 raft_consensus.cc:385] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:57.997920 21301 raft_consensus.cc:740] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.006081 21299 ts_tablet_manager.cc:1434] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:19:58.007323 21299 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:58.010447 21300 tablet_bootstrap.cc:492] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:58.011051 21300 ts_tablet_manager.cc:1403] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.119s	user 0.015s	sys 0.016s
I20260709 13:19:58.003384 21301 consensus_queue.cc:260] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.014434 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:58.018688 21102 raft_consensus.cc:2393] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
I20260709 13:19:58.020175 21219 leader_election.cc:304] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:58.021503 21632 raft_consensus.cc:3060] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.021534 20926 catalog_manager.cc:5697] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.038173 21632 raft_consensus.cc:2749] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:58.025398 21300 raft_consensus.cc:359] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:58.040313 21300 raft_consensus.cc:385] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.041006 21300 raft_consensus.cc:740] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.038553 21301 ts_tablet_manager.cc:1434] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.000s
I20260709 13:19:58.041906 21632 raft_consensus.cc:493] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.042641 21301 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:58.043630 21299 tablet_bootstrap.cc:654] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.044862 21300 consensus_queue.cc:260] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:58.046751 21300 ts_tablet_manager.cc:1434] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.002s
I20260709 13:19:58.047771 21300 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Bootstrap starting.
I20260709 13:19:58.042719 21632 raft_consensus.cc:515] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.078269 21707 raft_consensus.cc:493] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.079043 21707 raft_consensus.cc:515] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.082595 21707 leader_election.cc:290] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:58.083932 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317b739931ab4905ba1a212e8abe5207" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:58.083266 20925 catalog_manager.cc:5697] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.083982 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7eae6372364e919b8c6f1a4d358a77" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:58.087304 21302 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:58.093492 21302 ts_tablet_manager.cc:1403] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.011s
W20260709 13:19:58.093847 21217 leader_election.cc:343] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:58.094694 21217 leader_election.cc:343] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.096042 21299 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:58.096565 21299 ts_tablet_manager.cc:1403] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 13:19:58.088100 21632 leader_election.cc:290] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:58.099387 21299 raft_consensus.cc:359] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.099598 21704 consensus_queue.cc:1048] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:58.100138 21299 raft_consensus.cc:385] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.100449 21299 raft_consensus.cc:740] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.101300 21299 consensus_queue.cc:260] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.104064 21299 ts_tablet_manager.cc:1434] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:58.108389 21733 consensus_queue.cc:1048] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.110222 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317b739931ab4905ba1a212e8abe5207" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:58.113171 21299 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648: Bootstrap starting.
I20260709 13:19:58.114169 21704 consensus_queue.cc:1048] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:58.121951 21219 leader_election.cc:343] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.122447 21219 leader_election.cc:304] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:58.123158 21707 raft_consensus.cc:2749] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:58.126251 21301 tablet_bootstrap.cc:654] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.108243 20929 catalog_manager.cc:5697] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.124913 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7eae6372364e919b8c6f1a4d358a77" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:58.133076 21302 raft_consensus.cc:359] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.133845 21302 raft_consensus.cc:385] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.134974 21302 raft_consensus.cc:740] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.135775 21302 consensus_queue.cc:260] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.130014 21704 consensus_queue.cc:1048] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:19:58.141111 21029 raft_consensus.cc:2468] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:58.142910 21299 tablet_bootstrap.cc:654] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.144970 21219 leader_election.cc:304] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:58.147018 21401 raft_consensus.cc:2804] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.147542 21401 raft_consensus.cc:493] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.147958 21401 raft_consensus.cc:3060] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.159934 21300 tablet_bootstrap.cc:654] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.175009 21547 raft_consensus.cc:493] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.175833 21547 raft_consensus.cc:515] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.177865 21302 ts_tablet_manager.cc:1434] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.001s
I20260709 13:19:58.179464 21302 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:58.180830 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:19:58.182555 21069 leader_election.cc:343] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.197669 21547 leader_election.cc:290] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:58.229589 21030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:58.236755 21494 consensus_queue.cc:1048] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:58.240612 21071 leader_election.cc:343] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.219610 21401 raft_consensus.cc:515] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.241331 21071 leader_election.cc:304] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:58.245682 21693 consensus_queue.cc:1048] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.259485 21547 raft_consensus.cc:2749] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:58.271847 21299 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648: No bootstrap required, opened a new log
I20260709 13:19:58.272439 21299 ts_tablet_manager.cc:1403] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648: Time spent bootstrapping tablet: real 0.160s	user 0.021s	sys 0.001s
I20260709 13:19:58.287020 21703 raft_consensus.cc:493] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.287590 21703 raft_consensus.cc:515] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:58.288532 21401 leader_election.cc:290] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:58.289683 21703 leader_election.cc:290] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:58.268692 21734 consensus_queue.cc:1048] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:19:58.298408 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fc8ae4e5ba4be69acf20c7759745ec" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:58.299160 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7eae6372364e919b8c6f1a4d358a77" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:58.299500 21710 raft_consensus.cc:493] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.299846 21029 raft_consensus.cc:3060] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.300150 21710 raft_consensus.cc:515] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.301932 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fc8ae4e5ba4be69acf20c7759745ec" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:58.302455 21710 leader_election.cc:290] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:58.304623 21302 tablet_bootstrap.cc:654] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.312486 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:58.313279 21175 raft_consensus.cc:2468] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:58.303498 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
W20260709 13:19:58.315858 21219 leader_election.cc:343] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.299201 21100 raft_consensus.cc:2468] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 0.
I20260709 13:19:58.348781 21301 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:58.349936 21301 ts_tablet_manager.cc:1403] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.308s	user 0.030s	sys 0.019s
I20260709 13:19:58.355696 21300 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: No bootstrap required, opened a new log
I20260709 13:19:58.373387 21300 ts_tablet_manager.cc:1403] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent bootstrapping tablet: real 0.326s	user 0.027s	sys 0.060s
I20260709 13:19:58.374395 21299 raft_consensus.cc:359] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:58.384313 21299 raft_consensus.cc:385] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.384651 21299 raft_consensus.cc:740] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.385308 21299 consensus_queue.cc:260] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:58.338801 21217 leader_election.cc:343] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:58.387037 21217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 54635.8us
I20260709 13:19:58.388144 21217 leader_election.cc:304] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:58.303287 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7eae6372364e919b8c6f1a4d358a77" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:58.396075 21179 raft_consensus.cc:3060] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.392794 21703 raft_consensus.cc:2804] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.400624 21703 raft_consensus.cc:493] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.400980 21703 raft_consensus.cc:3060] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.401713 21029 raft_consensus.cc:2468] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:58.403090 21219 leader_election.cc:304] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:19:58.407393 21632 raft_consensus.cc:2804] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.407990 21632 raft_consensus.cc:697] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:58.408998 21632 consensus_queue.cc:237] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.400173 21299 ts_tablet_manager.cc:1434] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.000s
I20260709 13:19:58.439759 21300 raft_consensus.cc:359] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:58.440644 21300 raft_consensus.cc:385] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.440932 21300 raft_consensus.cc:740] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.449654 21703 raft_consensus.cc:515] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.458191 21219 leader_election.cc:304] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:19:58.459414 21710 raft_consensus.cc:2804] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.459815 21710 raft_consensus.cc:493] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.460153 21710 raft_consensus.cc:3060] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.462054 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:58.462721 21178 raft_consensus.cc:3060] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.463362 21301 raft_consensus.cc:359] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.464141 21301 raft_consensus.cc:385] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.468978 21300 consensus_queue.cc:260] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:58.471220 21071 consensus_peers.cc:597] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:58.471446 21300 ts_tablet_manager.cc:1434] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.000s
I20260709 13:19:58.471931 21624 raft_consensus.cc:493] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.472524 21624 raft_consensus.cc:515] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.472887 21703 leader_election.cc:290] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:58.474550 21624 leader_election.cc:290] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:58.464413 21301 raft_consensus.cc:740] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.475934 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91f39c6153492a8fd05d9918062caa" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:58.476389 21301 consensus_queue.cc:260] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.478546 21179 raft_consensus.cc:2468] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:58.481868 21028 raft_consensus.cc:2468] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:58.483481 21301 ts_tablet_manager.cc:1434] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.133s	user 0.006s	sys 0.000s
I20260709 13:19:58.485877 21301 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:58.490476 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91f39c6153492a8fd05d9918062caa" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:58.491219 21179 raft_consensus.cc:2468] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:58.493021 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
W20260709 13:19:58.494611 21219 leader_election.cc:343] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.496076 21071 leader_election.cc:304] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:58.497233 21547 raft_consensus.cc:2804] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.497716 21547 raft_consensus.cc:493] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.498127 21547 raft_consensus.cc:3060] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.498262 21301 tablet_bootstrap.cc:654] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.501595 21690 raft_consensus.cc:493] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.502290 21690 raft_consensus.cc:515] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:58.509232 21690 leader_election.cc:290] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:58.510298 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:58.510376 21710 raft_consensus.cc:515] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:58.512171 21071 leader_election.cc:343] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.527429 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fc8ae4e5ba4be69acf20c7759745ec" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:58.528110 21099 raft_consensus.cc:3060] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.530604 21302 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:58.531173 21302 ts_tablet_manager.cc:1403] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.352s	user 0.017s	sys 0.000s
I20260709 13:19:58.522034 21690 consensus_queue.cc:1048] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:19:58.517112 21704 consensus_queue.cc:1048] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:19:58.559042 21178 raft_consensus.cc:2468] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
W20260709 13:19:58.577013 21219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 60911us
W20260709 13:19:58.579360 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 48089.6us
I20260709 13:19:58.568346 21710 leader_election.cc:290] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:58.610947 21302 raft_consensus.cc:359] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.611691 21302 raft_consensus.cc:385] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:58.613513 20976 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:58.613632 21302 raft_consensus.cc:740] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.623145 21099 raft_consensus.cc:2468] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:19:58.633965 21219 leader_election.cc:304] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:58.618227 21179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2fc8ae4e5ba4be69acf20c7759745ec" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:58.612690 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:58.650238 21251 raft_consensus.cc:2468] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 0.
I20260709 13:19:58.653261 21401 raft_consensus.cc:2804] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.653610 21301 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:58.654199 21301 ts_tablet_manager.cc:1403] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.013s
I20260709 13:19:58.654069 21401 raft_consensus.cc:697] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:58.639035 21217 leader_election.cc:304] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:58.655113 21401 consensus_queue.cc:237] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:58.657101 21217 leader_election.cc:343] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.658313 21775 raft_consensus.cc:2804] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.659008 21775 raft_consensus.cc:697] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:19:58.663288 21301 raft_consensus.cc:359] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:58.664041 21301 raft_consensus.cc:385] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.664301 21301 raft_consensus.cc:740] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.665063 21301 consensus_queue.cc:260] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:58.680619 21072 leader_election.cc:304] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:58.682149 21621 raft_consensus.cc:2804] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:58.659855 21775 consensus_queue.cc:237] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.685204 20928 catalog_manager.cc:5697] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.683406 21621 raft_consensus.cc:493] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:58.689414 21621 raft_consensus.cc:3060] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.682451 21302 consensus_queue.cc:260] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.696729 21302 ts_tablet_manager.cc:1434] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.165s	user 0.007s	sys 0.001s
I20260709 13:19:58.706728 21301 ts_tablet_manager.cc:1434] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:19:58.720230 21301 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:58.668190 21547 raft_consensus.cc:515] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.748941 21023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91f39c6153492a8fd05d9918062caa" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:58.750031 21023 raft_consensus.cc:3060] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.750483 21301 tablet_bootstrap.cc:654] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.745267 21302 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:58.763047 21621 raft_consensus.cc:515] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:58.769629 21621 leader_election.cc:290] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:58.770565 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:58.771291 21253 raft_consensus.cc:3060] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.776551 21302 tablet_bootstrap.cc:654] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.776984 21024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
W20260709 13:19:58.790381 21071 leader_election.cc:343] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:58.788257 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf91f39c6153492a8fd05d9918062caa" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:19:58.777918 21547 leader_election.cc:290] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:58.794454 21178 raft_consensus.cc:3060] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:58.802426 21178 raft_consensus.cc:2468] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:58.793286 21253 raft_consensus.cc:2468] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:58.808259 21072 leader_election.cc:304] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:58.809830 21491 raft_consensus.cc:2804] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.811817 21069 leader_election.cc:304] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:58.813016 21547 raft_consensus.cc:2804] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:58.813648 21547 raft_consensus.cc:697] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:58.814662 21547 consensus_queue.cc:237] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:58.811192 21491 raft_consensus.cc:697] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:19:58.819629 21491 consensus_queue.cc:237] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:58.826884 21775 consensus_queue.cc:1048] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.831310 21023 raft_consensus.cc:2468] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:19:58.843634 21301 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:58.844219 21301 ts_tablet_manager.cc:1403] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.124s	user 0.016s	sys 0.003s
I20260709 13:19:58.854689 21301 raft_consensus.cc:359] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.855378 21301 raft_consensus.cc:385] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.855640 21301 raft_consensus.cc:740] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.856302 21301 consensus_queue.cc:260] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.863198 21302 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:58.863821 21302 ts_tablet_manager.cc:1403] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.119s	user 0.009s	sys 0.020s
I20260709 13:19:58.867538 21776 consensus_queue.cc:1048] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.870680 21301 ts_tablet_manager.cc:1434] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:19:58.872037 21301 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:58.889807 21301 tablet_bootstrap.cc:654] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:58.900979 21302 raft_consensus.cc:359] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.902848 21302 raft_consensus.cc:385] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:58.903127 21302 raft_consensus.cc:740] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:58.903752 21302 consensus_queue.cc:260] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:58.908793 21302 ts_tablet_manager.cc:1434] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:19:58.909797 21302 tablet_bootstrap.cc:492] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8: Bootstrap starting.
I20260709 13:19:58.920686 20929 catalog_manager.cc:5697] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:58.937252 20929 catalog_manager.cc:5697] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:58.954397 21390 raft_consensus.cc:493] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:58.955245 21390 raft_consensus.cc:515] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:59.000568 21390 leader_election.cc:290] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:59.011950 21251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317b739931ab4905ba1a212e8abe5207" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:59.012776 21251 raft_consensus.cc:2468] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:59.002763 21028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317b739931ab4905ba1a212e8abe5207" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:59.016345 21146 leader_election.cc:304] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:59.023959 21768 raft_consensus.cc:2804] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.025429 21768 raft_consensus.cc:493] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.025784 21768 raft_consensus.cc:3060] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.026134 21301 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:59.026702 21301 ts_tablet_manager.cc:1403] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.155s	user 0.026s	sys 0.028s
W20260709 13:19:59.029343 21145 leader_election.cc:343] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.036839 21302 tablet_bootstrap.cc:654] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.040156 20925 catalog_manager.cc:5697] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.037128 21768 raft_consensus.cc:515] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:59.030189 21301 raft_consensus.cc:359] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:59.116297 21400 raft_consensus.cc:493] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.118409 20925 catalog_manager.cc:5697] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 1 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.112671 21768 leader_election.cc:290] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:19:59.123486 21301 raft_consensus.cc:385] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.127966 21029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317b739931ab4905ba1a212e8abe5207" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:59.151026 21301 raft_consensus.cc:740] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.122982 21400 raft_consensus.cc:515] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:19:59.137522 21217 consensus_peers.cc:597] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.141047 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317b739931ab4905ba1a212e8abe5207" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:19:59.142822 21025 raft_consensus.cc:3060] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.151855 21301 consensus_queue.cc:260] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:59.158155 21029 raft_consensus.cc:3060] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.161269 21301 ts_tablet_manager.cc:1434] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.134s	user 0.008s	sys 0.007s
I20260709 13:19:59.162401 21301 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:59.169160 21401 consensus_queue.cc:1048] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.158519 21024 raft_consensus.cc:3060] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.159709 21246 raft_consensus.cc:3060] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.179507 21029 raft_consensus.cc:2468] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:59.185552 21776 consensus_queue.cc:1048] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.189702 21400 leader_election.cc:290] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:59.192655 21626 raft_consensus.cc:493] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.193271 21626 raft_consensus.cc:515] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:59.195529 21626 leader_election.cc:290] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:59.199899 21401 consensus_queue.cc:1048] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.202653 21301 tablet_bootstrap.cc:654] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:59.204766 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:59.205870 21101 raft_consensus.cc:2468] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 0.
I20260709 13:19:59.208421 21145 leader_election.cc:304] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:19:59.209547 21768 raft_consensus.cc:2804] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:59.209977 21768 raft_consensus.cc:493] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:59.210351 21768 raft_consensus.cc:3060] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.219209 21768 raft_consensus.cc:515] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:59.221609 21768 leader_election.cc:290] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:59.229915 21302 tablet_bootstrap.cc:492] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8: No bootstrap required, opened a new log
I20260709 13:19:59.230422 21302 ts_tablet_manager.cc:1403] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent bootstrapping tablet: real 0.321s	user 0.029s	sys 0.007s
I20260709 13:19:59.234673 21246 raft_consensus.cc:2468] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:59.236274 21146 leader_election.cc:304] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:19:59.236923 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:59.238674 21777 raft_consensus.cc:2804] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:59.240806 21777 raft_consensus.cc:697] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:59.241768 21777 consensus_queue.cc:237] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:19:59.251156 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:19:59.258720 21025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:19:59.264187 21302 raft_consensus.cc:359] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:19:59.269387 21071 consensus_peers.cc:597] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.278908 21491 consensus_queue.cc:1048] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.284754 20925 catalog_manager.cc:5697] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.270207 21301 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:59.286986 21301 ts_tablet_manager.cc:1403] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.125s	user 0.004s	sys 0.008s
I20260709 13:19:59.289989 21301 raft_consensus.cc:359] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:59.290730 21301 raft_consensus.cc:385] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.291009 21301 raft_consensus.cc:740] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.265341 21302 raft_consensus.cc:385] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.291764 21302 raft_consensus.cc:740] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.294169 21302 consensus_queue.cc:260] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:19:59.299696 21301 consensus_queue.cc:260] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:59.300385 21302 ts_tablet_manager.cc:1434] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:19:59.309891 21301 ts_tablet_manager.cc:1434] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:19:59.311031 21301 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:19:59.321075 21689 raft_consensus.cc:493] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.321904 21689 raft_consensus.cc:515] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
W20260709 13:19:59.324018 21800 log.cc:927] Time spent T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:19:59.325323 21689 leader_election.cc:290] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:19:59.327308 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ebfe18bcecc49198cbf0d3721f65dc7" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:59.333240 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:19:59.339002 21099 raft_consensus.cc:3060] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.334051 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:19:59.342810 21176 raft_consensus.cc:2393] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d804ce9949645b19a0ccc1faf258ec7 in current term 1: Already voted for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in this term.
W20260709 13:19:59.354908 21145 leader_election.cc:343] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.355082 21301 tablet_bootstrap.cc:654] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:59.355967 21145 leader_election.cc:343] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:59.371459 20997 leader_election.cc:304] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:59.375612 21301 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: No bootstrap required, opened a new log
I20260709 13:19:59.376235 21301 ts_tablet_manager.cc:1403] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.005s
I20260709 13:19:59.381675 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65a4c18f2b744dccb42a3da937d648f6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:59.384325 20996 leader_election.cc:304] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:59.385704 21734 raft_consensus.cc:3060] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.388530 21400 raft_consensus.cc:2749] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:59.403941 21734 raft_consensus.cc:2749] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:59.379808 21301 raft_consensus.cc:359] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:59.412118 21301 raft_consensus.cc:385] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:59.412472 21301 raft_consensus.cc:740] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:19:59.423583 21099 raft_consensus.cc:2468] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:19:59.432404 21624 consensus_queue.cc:1048] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.441042 21145 leader_election.cc:304] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:19:59.413287 21301 consensus_queue.cc:260] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:59.443260 21693 raft_consensus.cc:2804] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:59.445578 21693 raft_consensus.cc:697] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:19:59.446930 21301 ts_tablet_manager.cc:1434] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:19:59.446755 21693 consensus_queue.cc:237] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:19:59.459345 21621 consensus_queue.cc:1048] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:59.491910 20925 catalog_manager.cc:5697] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:59.555127 21176 raft_consensus.cc:3060] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.753985 21693 consensus_queue.cc:1048] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.770912 21777 consensus_queue.cc:1048] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.802203 21689 raft_consensus.cc:493] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:59.802778 21689 raft_consensus.cc:515] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:19:59.804877 21689 leader_election.cc:290] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:19:59.805812 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:19:59.806392 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:19:59.805994 21029 raft_consensus.cc:3060] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:59.807821 20996 leader_election.cc:304] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:19:59.814142 21689 raft_consensus.cc:2749] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:59.866127 21768 consensus_queue.cc:1048] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.868371 21768 consensus_queue.cc:1048] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:00.146636 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
W20260709 13:20:00.149610 21145 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:00.175104 21219 consensus_peers.cc:597] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.178485 21219 consensus_peers.cc:597] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.185149 21145 consensus_peers.cc:597] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.186189 21145 consensus_peers.cc:597] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.190526 21071 consensus_peers.cc:597] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.221081 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:00.222060 14501 tablet_replica.cc:333] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.223373 14501 raft_consensus.cc:2243] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.223964 14501 raft_consensus.cc:2272] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.228102 21145 consensus_peers.cc:597] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.229533 14501 tablet_replica.cc:333] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.230607 14501 raft_consensus.cc:2243] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.231163 14501 raft_consensus.cc:2272] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.234285 21071 consensus_peers.cc:597] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.236029 14501 tablet_replica.cc:333] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.237025 14501 raft_consensus.cc:2243] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.237558 14501 raft_consensus.cc:2272] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.240859 14501 tablet_replica.cc:333] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.241770 14501 raft_consensus.cc:2243] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.242309 14501 raft_consensus.cc:2272] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.244405 14501 tablet_replica.cc:333] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.245071 14501 raft_consensus.cc:2243] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.245478 14501 raft_consensus.cc:2272] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.247745 14501 tablet_replica.cc:333] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.248495 14501 raft_consensus.cc:2243] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.249544 14501 raft_consensus.cc:2272] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.251992 14501 tablet_replica.cc:333] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
W20260709 13:20:00.251930 21219 consensus_peers.cc:597] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.252995 14501 raft_consensus.cc:2243] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.253492 14501 raft_consensus.cc:2272] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.255529 14501 tablet_replica.cc:333] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.256322 14501 raft_consensus.cc:2243] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.256808 14501 raft_consensus.cc:2272] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.259064 14501 tablet_replica.cc:333] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.259711 14501 raft_consensus.cc:2243] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.260285 14501 raft_consensus.cc:2272] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.262441 14501 tablet_replica.cc:333] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.263053 14501 raft_consensus.cc:2243] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.263484 14501 raft_consensus.cc:2272] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.265465 14501 tablet_replica.cc:333] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.266042 14501 raft_consensus.cc:2243] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.266878 14501 raft_consensus.cc:2272] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.268875 14501 tablet_replica.cc:333] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.269547 14501 raft_consensus.cc:2243] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.270103 14501 raft_consensus.cc:2272] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.273020 14501 tablet_replica.cc:333] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.273849 14501 raft_consensus.cc:2243] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.274312 14501 raft_consensus.cc:2272] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.274857 21145 consensus_peers.cc:597] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.277688 14501 tablet_replica.cc:333] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.278618 14501 raft_consensus.cc:2243] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.279136 14501 raft_consensus.cc:2272] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.282310 14501 tablet_replica.cc:333] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.283084 14501 raft_consensus.cc:2243] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.283620 14501 raft_consensus.cc:2272] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.286417 14501 tablet_replica.cc:333] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.287226 14501 raft_consensus.cc:2243] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.287775 14501 raft_consensus.cc:2272] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.290726 14501 tablet_replica.cc:333] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.291509 14501 raft_consensus.cc:2243] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.292093 14501 raft_consensus.cc:2272] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.294998 14501 tablet_replica.cc:333] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.295930 14501 raft_consensus.cc:2243] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.296458 14501 raft_consensus.cc:2272] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.299350 21071 consensus_peers.cc:597] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.302244 14501 tablet_replica.cc:333] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.303215 14501 raft_consensus.cc:2243] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.303862 14501 raft_consensus.cc:2272] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.306715 14501 tablet_replica.cc:333] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.307689 14501 raft_consensus.cc:2243] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.308307 14501 raft_consensus.cc:2272] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.310380 21145 consensus_peers.cc:597] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.311488 14501 tablet_replica.cc:333] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.312465 14501 raft_consensus.cc:2243] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:00.313206 21145 consensus_peers.cc:597] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.313642 14501 raft_consensus.cc:2272] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.316519 14501 tablet_replica.cc:333] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
W20260709 13:20:00.316946 21071 consensus_peers.cc:597] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.317358 14501 raft_consensus.cc:2243] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:00.317843 21071 consensus_peers.cc:597] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.317982 14501 raft_consensus.cc:2272] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.320360 14501 tablet_replica.cc:333] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.321190 14501 raft_consensus.cc:2243] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.322077 14501 raft_consensus.cc:2272] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.322150 21145 consensus_peers.cc:597] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.324186 14501 tablet_replica.cc:333] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.324951 14501 raft_consensus.cc:2243] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.325405 14501 raft_consensus.cc:2272] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.327292 14501 tablet_replica.cc:333] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.327842 14501 raft_consensus.cc:2243] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.328280 14501 raft_consensus.cc:2272] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.331089 14501 tablet_replica.cc:333] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.331976 14501 raft_consensus.cc:2243] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.333074 14501 raft_consensus.cc:2272] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.333518 21145 consensus_peers.cc:597] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.335816 14501 tablet_replica.cc:333] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.336727 14501 raft_consensus.cc:2243] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.337613 14501 raft_consensus.cc:2272] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.339643 21219 consensus_peers.cc:597] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.339980 14501 tablet_replica.cc:333] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.340996 14501 raft_consensus.cc:2243] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.341557 14501 raft_consensus.cc:2272] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.344434 14501 tablet_replica.cc:333] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.345211 14501 raft_consensus.cc:2243] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.345682 14501 raft_consensus.cc:2272] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.348007 14501 tablet_replica.cc:333] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.348695 14501 raft_consensus.cc:2243] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.349126 14501 raft_consensus.cc:2272] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.351470 14501 tablet_replica.cc:333] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.352034 14501 raft_consensus.cc:2243] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.352483 14501 raft_consensus.cc:2272] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.354492 14501 tablet_replica.cc:333] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.355034 14501 raft_consensus.cc:2243] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.355527 14501 raft_consensus.cc:2272] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.357614 14501 tablet_replica.cc:333] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.358220 14501 raft_consensus.cc:2243] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.358729 14501 raft_consensus.cc:2272] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.361191 14501 tablet_replica.cc:333] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.361878 14501 raft_consensus.cc:2243] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.362327 14501 raft_consensus.cc:2272] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.364790 14501 tablet_replica.cc:333] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.365542 14501 raft_consensus.cc:2243] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.365995 14501 raft_consensus.cc:2272] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.368820 14501 tablet_replica.cc:333] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.369541 14501 raft_consensus.cc:2243] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.370607 14501 raft_consensus.cc:2272] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.373152 14501 tablet_replica.cc:333] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
W20260709 13:20:00.373682 21145 consensus_peers.cc:597] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.373961 14501 raft_consensus.cc:2243] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:00.374451 21145 consensus_peers.cc:597] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.374627 14501 raft_consensus.cc:2272] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.377055 21145 consensus_peers.cc:597] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.377475 14501 tablet_replica.cc:333] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.378060 14501 raft_consensus.cc:2243] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.378728 14501 raft_consensus.cc:2272] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.380771 14501 tablet_replica.cc:333] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.381237 14501 raft_consensus.cc:2243] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.381976 14501 raft_consensus.cc:2272] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.383771 14501 tablet_replica.cc:333] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.384243 14501 raft_consensus.cc:2243] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.384662 14501 raft_consensus.cc:2272] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.386365 14501 tablet_replica.cc:333] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.386811 14501 raft_consensus.cc:2243] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.387559 14501 raft_consensus.cc:2272] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.389539 14501 tablet_replica.cc:333] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.390412 14501 raft_consensus.cc:2243] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.391048 14501 raft_consensus.cc:2272] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.393239 14501 tablet_replica.cc:333] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.393765 14501 raft_consensus.cc:2243] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.394182 14501 raft_consensus.cc:2272] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:00.396562 14501 tablet_replica.cc:333] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.397344 14501 raft_consensus.cc:2243] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:00.398396 14501 raft_consensus.cc:2272] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.401044 21219 consensus_peers.cc:597] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.401037 14501 tablet_replica.cc:333] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: stopping tablet replica
I20260709 13:20:00.402055 14501 raft_consensus.cc:2243] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:00.402814 14501 raft_consensus.cc:2272] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:00.413638 21071 consensus_peers.cc:597] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.413803 21145 consensus_peers.cc:597] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.476816 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
W20260709 13:20:00.492985 21071 consensus_peers.cc:597] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.528432 21219 consensus_peers.cc:597] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.538095 21145 consensus_peers.cc:597] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.550746 21145 consensus_peers.cc:597] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.570969 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:00.573038 21145 consensus_peers.cc:597] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.576337 21145 consensus_peers.cc:597] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:00.579402 21827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:00.580325 21828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:00.589167 14501 server_base.cc:1061] running on GCE node
W20260709 13:20:00.589522 21830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:00.594333 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:00.594592 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:00.594843 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603200594805 us; error 0 us; skew 500 ppm
I20260709 13:20:00.595436 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:00.598706 14501 webserver.cc:533] Webserver started at http://127.14.41.65:37213/ using document root <none> and password file <none>
I20260709 13:20:00.599357 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:00.599640 14501 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:20:00.604048 21071 consensus_peers.cc:597] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.606127 14501 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.003s	sys 0.001s
W20260709 13:20:00.616247 21145 consensus_peers.cc:597] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.618911 21835 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:00.620133 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:20:00.620546 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "1d804ce9949645b19a0ccc1faf258ec7"
format_stamp: "Formatted at 2026-07-09 13:19:47 on dist-test-slave-56lb"
I20260709 13:20:00.621047 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:20:00.646566 21071 consensus_peers.cc:597] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.646914 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:00.648639 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:00.650081 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:20:00.670806 21219 consensus_peers.cc:597] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.675947 21843 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:20:00.704705 21219 consensus_peers.cc:597] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:00.995963 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:20:00.996384 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.326s	user 0.006s	sys 0.007s
I20260709 13:20:00.996768 14501 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:20:01.005497 21843 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.028831 21843 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.029783 21843 tablet_bootstrap.cc:492] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.030411 21843 ts_tablet_manager.cc:1403] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:20:01.032939 21843 raft_consensus.cc:359] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.033599 21843 raft_consensus.cc:740] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.034288 21843 consensus_queue.cc:260] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.036586 21843 ts_tablet_manager.cc:1434] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:01.037405 21843 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.051466 21843 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.052275 21843 tablet_bootstrap.cc:492] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.053004 21843 ts_tablet_manager.cc:1403] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:20:01.054900 21843 raft_consensus.cc:359] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.055449 21843 raft_consensus.cc:740] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.056109 21843 consensus_queue.cc:260] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.057675 21843 ts_tablet_manager.cc:1434] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:01.058357 21843 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.071888 21843 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.072726 21843 tablet_bootstrap.cc:492] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.073266 21843 ts_tablet_manager.cc:1403] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:20:01.075217 21843 raft_consensus.cc:359] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.075873 21843 raft_consensus.cc:740] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.076565 21843 consensus_queue.cc:260] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.078258 21843 ts_tablet_manager.cc:1434] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:20:01.079385 21843 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.101676 21843 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.102645 21843 tablet_bootstrap.cc:492] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.103300 21843 ts_tablet_manager.cc:1403] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:20:01.105769 21843 raft_consensus.cc:359] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.106451 21843 raft_consensus.cc:740] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.107445 21843 consensus_queue.cc:260] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.109418 21843 ts_tablet_manager.cc:1434] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:01.110109 21843 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.130188 21843 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.131086 21843 tablet_bootstrap.cc:492] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.131745 21843 ts_tablet_manager.cc:1403] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:20:01.134411 21843 raft_consensus.cc:359] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.135087 21843 raft_consensus.cc:740] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.135887 21843 consensus_queue.cc:260] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.138082 21843 ts_tablet_manager.cc:1434] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:01.138878 21843 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.153898 21843 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.154906 21843 tablet_bootstrap.cc:492] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.155586 21843 ts_tablet_manager.cc:1403] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:20:01.158176 21843 raft_consensus.cc:359] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.159885 21843 raft_consensus.cc:740] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.160567 21843 consensus_queue.cc:260] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.162278 21843 ts_tablet_manager.cc:1434] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:20:01.163079 21843 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.182945 21843 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.183941 21843 tablet_bootstrap.cc:492] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.184523 21843 ts_tablet_manager.cc:1403] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:20:01.186379 21843 raft_consensus.cc:359] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.187040 21843 raft_consensus.cc:740] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.187644 21843 consensus_queue.cc:260] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.189353 21843 ts_tablet_manager.cc:1434] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:01.190090 21843 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.207296 21843 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.208248 21843 tablet_bootstrap.cc:492] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.208947 21843 ts_tablet_manager.cc:1403] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:20:01.211339 21843 raft_consensus.cc:359] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.211836 21843 raft_consensus.cc:740] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.212435 21843 consensus_queue.cc:260] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.214296 21843 ts_tablet_manager.cc:1434] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:01.215098 21843 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.229269 21843 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.230186 21843 tablet_bootstrap.cc:492] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.230775 21843 ts_tablet_manager.cc:1403] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:20:01.233104 21843 raft_consensus.cc:359] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.233666 21843 raft_consensus.cc:740] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.234278 21843 consensus_queue.cc:260] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.236181 21843 ts_tablet_manager.cc:1434] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:01.236994 21843 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.252072 21843 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.253069 21843 tablet_bootstrap.cc:492] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.253702 21843 ts_tablet_manager.cc:1403] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:20:01.256181 21843 raft_consensus.cc:359] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:01.256875 21843 raft_consensus.cc:740] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.257648 21843 consensus_queue.cc:260] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:01.259907 21843 ts_tablet_manager.cc:1434] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:01.260723 21843 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.266578 14501 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:20:01.266991 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.270s	user 0.253s	sys 0.003s
I20260709 13:20:01.283411 21843 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.284449 21843 tablet_bootstrap.cc:492] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.285426 21843 ts_tablet_manager.cc:1403] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:20:01.288792 21843 raft_consensus.cc:359] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:01.289844 21843 raft_consensus.cc:740] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.290745 21843 consensus_queue.cc:260] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:01.293355 21843 ts_tablet_manager.cc:1434] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:01.294456 21843 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.306198 21820 raft_consensus.cc:493] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.307128 21820 raft_consensus.cc:515] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.309563 21820 leader_election.cc:290] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.311015 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:01.318948 21843 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.320011 21843 tablet_bootstrap.cc:492] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.320695 21843 ts_tablet_manager.cc:1403] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.027s	user 0.024s	sys 0.000s
I20260709 13:20:01.323570 21843 raft_consensus.cc:359] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.324285 21843 raft_consensus.cc:740] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.325769 21843 consensus_queue.cc:260] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:20:01.326850 21219 leader_election.cc:336] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
I20260709 13:20:01.327399 21219 leader_election.cc:304] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:01.328104 21843 ts_tablet_manager.cc:1434] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:01.328979 21843 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.330937 21776 raft_consensus.cc:2749] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.335368 21693 raft_consensus.cc:493] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.336211 21693 raft_consensus.cc:515] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.339020 21693 leader_election.cc:290] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.348964 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:01.349875 21843 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.350888 21843 tablet_bootstrap.cc:492] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.351576 21843 ts_tablet_manager.cc:1403] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 13:20:01.351694 21775 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.352589 21775 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.355536 21775 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.354143 21843 raft_consensus.cc:359] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:01.359759 21843 raft_consensus.cc:740] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.360667 21843 consensus_queue.cc:260] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
W20260709 13:20:01.348868 21145 leader_election.cc:336] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
I20260709 13:20:01.362922 21843 ts_tablet_manager.cc:1434] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:20:01.363837 21843 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.366222 21145 leader_election.cc:304] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:01.367475 21816 raft_consensus.cc:2749] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.380060 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
W20260709 13:20:01.385206 21219 leader_election.cc:336] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
I20260709 13:20:01.385668 21219 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:01.386409 21776 raft_consensus.cc:2749] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.387182 21843 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.388286 21843 tablet_bootstrap.cc:492] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.388948 21843 ts_tablet_manager.cc:1403] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:20:01.391513 21843 raft_consensus.cc:359] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.392181 21843 raft_consensus.cc:740] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.398253 21843 consensus_queue.cc:260] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.402146 21843 ts_tablet_manager.cc:1434] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:20:01.403033 21843 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.440637 21843 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.441715 21843 tablet_bootstrap.cc:492] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.442411 21843 ts_tablet_manager.cc:1403] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.016s
I20260709 13:20:01.445168 21843 raft_consensus.cc:359] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:01.445964 21843 raft_consensus.cc:740] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.446768 21843 consensus_queue.cc:260] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:01.448719 21843 ts_tablet_manager.cc:1434] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:01.449626 21843 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.450830 21776 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.451622 21776 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:01.454798 21776 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.457185 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
W20260709 13:20:01.469143 21219 leader_election.cc:336] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
I20260709 13:20:01.469342 21843 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.469594 21219 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:20:01.470398 21843 tablet_bootstrap.cc:492] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.471072 21843 ts_tablet_manager.cc:1403] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:20:01.471280 21775 raft_consensus.cc:2749] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.473795 21843 raft_consensus.cc:359] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.474596 21843 raft_consensus.cc:740] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.475355 21843 consensus_queue.cc:260] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.477334 21843 ts_tablet_manager.cc:1434] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:01.478231 21843 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.488173 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:43285
I20260709 13:20:01.488281 21920 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:43285 every 8 connection(s)
I20260709 13:20:01.490242 21843 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.491266 21843 tablet_bootstrap.cc:492] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.492033 21843 ts_tablet_manager.cc:1403] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:20:01.495292 21843 raft_consensus.cc:359] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.496114 21843 raft_consensus.cc:740] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.496939 21843 consensus_queue.cc:260] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.498715 21843 ts_tablet_manager.cc:1434] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:01.499802 21843 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.542877 21624 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.543608 21624 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.545747 21624 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.547912 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.548094 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:20:01.548782 21893 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.548884 21246 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.548168 21624 raft_consensus.cc:493] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.554494 21624 raft_consensus.cc:515] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.554873 21072 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.555840 21547 raft_consensus.cc:2804] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.556253 21547 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.556646 21547 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.557152 21624 leader_election.cc:290] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.560876 21921 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36967
I20260709 13:20:01.561296 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.561375 21921 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:01.563476 21921 heartbeater.cc:507] Master 127.14.41.126:36967 requested a full tablet report, sending...
I20260709 13:20:01.566206 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:20:01.568423 21893 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.572222 21547 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.575351 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:01.576035 21246 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.578052 21892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:01.579010 21892 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.581674 21071 leader_election.cc:304] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:01.583459 21547 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.583459 21624 raft_consensus.cc:2804] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.584628 21624 raft_consensus.cc:493] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.585021 21624 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.588341 21246 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:01.589805 21072 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.590785 21547 raft_consensus.cc:2804] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.591356 21547 raft_consensus.cc:697] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:01.592352 21547 consensus_queue.cc:237] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.594869 21621 raft_consensus.cc:493] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.595695 21621 raft_consensus.cc:515] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.595986 21816 raft_consensus.cc:493] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.596704 21693 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.596889 21816 raft_consensus.cc:515] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.597564 21693 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.603096 21776 raft_consensus.cc:493] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.609998 21776 raft_consensus.cc:515] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.611289 21816 leader_election.cc:290] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.619601 21930 raft_consensus.cc:493] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.622632 21624 raft_consensus.cc:515] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.626802 21624 leader_election.cc:290] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.628059 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:01.637743 21890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.625626 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:01.639597 21843 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.640017 21693 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.640682 21843 tablet_bootstrap.cc:492] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.641547 21843 ts_tablet_manager.cc:1403] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.142s	user 0.056s	sys 0.065s
W20260709 13:20:01.645741 21145 leader_election.cc:343] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.638355 21891 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.658128 21820 raft_consensus.cc:493] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.667716 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:01.668469 21246 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.669085 21104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:01.671103 21820 raft_consensus.cc:515] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.678754 21145 leader_election.cc:304] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:01.628360 21776 leader_election.cc:290] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.673992 21890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.674216 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:01.712513 21843 raft_consensus.cc:359] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.715816 21843 raft_consensus.cc:740] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.715890 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:20:01.673781 21892 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:01.717121 21843 consensus_queue.cc:260] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.709797 21931 raft_consensus.cc:2749] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.640795 21930 raft_consensus.cc:515] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.707768 21934 raft_consensus.cc:493] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.725773 21843 ts_tablet_manager.cc:1434] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:20:01.709575 21890 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:20:01.709919 21820 leader_election.cc:290] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.727698 21843 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:01.728322 21104 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:20:01.730335 21930 leader_election.cc:290] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.731006 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:20:01.732753 21934 raft_consensus.cc:515] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.738905 21253 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.742436 21219 leader_election.cc:304] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:20:01.720207 21888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.726197 21621 leader_election.cc:290] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.745388 21072 leader_election.cc:304] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.739751 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:01.747083 21547 raft_consensus.cc:2804] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.750798 21547 raft_consensus.cc:493] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.751161 21547 raft_consensus.cc:3060] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.758767 21933 raft_consensus.cc:493] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.759403 21933 raft_consensus.cc:515] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.740921 21892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.750114 21775 raft_consensus.cc:2804] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.744824 21935 raft_consensus.cc:493] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.764844 21934 leader_election.cc:290] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.764310 20925 catalog_manager.cc:5697] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.747069 21890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.774120 21931 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.795223 21776 raft_consensus.cc:493] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.796221 21776 raft_consensus.cc:515] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.799149 21776 leader_election.cc:290] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.800145 21933 leader_election.cc:290] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:01.800259 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
W20260709 13:20:01.783566 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 97509.2us
I20260709 13:20:01.795230 21932 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.804550 21245 raft_consensus.cc:2468] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.804651 21932 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.810217 21072 leader_election.cc:304] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.812287 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
W20260709 13:20:01.807906 21219 leader_election.cc:343] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.813037 21253 raft_consensus.cc:2468] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.813261 21219 leader_election.cc:304] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:01.814188 21072 leader_election.cc:304] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.767094 21888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.819582 21934 raft_consensus.cc:2804] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.820081 21934 raft_consensus.cc:493] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.820288 21820 raft_consensus.cc:2749] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.820513 21934 raft_consensus.cc:3060] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:01.813038 21145 leader_election.cc:343] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.778033 21621 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.823499 21891 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
W20260709 13:20:01.825601 21071 leader_election.cc:343] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.826113 21071 leader_election.cc:304] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:01.826114 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.826758 21932 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
W20260709 13:20:01.827294 21071 leader_election.cc:343] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.827386 21932 raft_consensus.cc:2749] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.828270 21071 leader_election.cc:304] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.805167 21931 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:20:01.830166 21071 leader_election.cc:343] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.831524 21930 raft_consensus.cc:2804] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.831601 21931 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.832171 21930 raft_consensus.cc:697] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:01.832620 21932 raft_consensus.cc:493] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.824400 21621 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.833151 21932 raft_consensus.cc:515] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.833878 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:20:01.834573 21176 raft_consensus.cc:2468] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.834818 21621 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.835466 21621 raft_consensus.cc:2804] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.793890 21775 raft_consensus.cc:493] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.835839 21069 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.835969 21775 raft_consensus.cc:3060] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.836241 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.836510 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:20:01.836937 21933 raft_consensus.cc:2804] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.837298 21176 raft_consensus.cc:2468] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.837386 21933 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.837890 21933 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.838819 21069 leader_election.cc:304] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.840464 21624 raft_consensus.cc:2804] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.840629 21145 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:01.840901 21624 raft_consensus.cc:493] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.841264 21624 raft_consensus.cc:3060] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:01.843036 21071 leader_election.cc:343] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.849534 21247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:20:01.850271 21247 raft_consensus.cc:2468] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 1.
I20260709 13:20:01.844813 21932 leader_election.cc:290] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:01.853422 21146 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:01.810478 21935 raft_consensus.cc:515] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.854389 21693 raft_consensus.cc:2749] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.855505 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" is_pre_election: true
I20260709 13:20:01.862823 21245 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.857802 21888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.833173 21930 consensus_queue.cc:237] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.835846 21621 raft_consensus.cc:493] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.858644 21892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.874881 21621 raft_consensus.cc:3060] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.875067 21935 leader_election.cc:290] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:01.866873 21072 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.869103 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.873073 21888 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
W20260709 13:20:01.877666 21071 leader_election.cc:343] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:01.855422 21940 raft_consensus.cc:2804] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:01.882526 21219 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 74607.6us
I20260709 13:20:01.884724 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" is_pre_election: true
I20260709 13:20:01.885391 21176 raft_consensus.cc:2468] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.888168 21624 raft_consensus.cc:515] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.886408 21069 leader_election.cc:304] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.894032 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:01.897630 21099 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 1.
I20260709 13:20:01.893347 21246 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:01.889676 21547 raft_consensus.cc:515] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.880391 21935 raft_consensus.cc:2804] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.824352 21887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.902199 21219 leader_election.cc:304] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:01.906327 21547 leader_election.cc:290] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:01.909047 21820 raft_consensus.cc:2804] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.901335 21935 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.909529 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:01.909898 21935 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.888952 21940 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.913551 21940 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.914776 21843 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.915226 21624 leader_election.cc:290] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:01.899058 21937 raft_consensus.cc:493] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.921048 21937 raft_consensus.cc:515] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.922991 21888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.917357 21887 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:01.929014 21621 raft_consensus.cc:515] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.932148 21621 leader_election.cc:290] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:01.932706 21775 raft_consensus.cc:515] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:01.909543 21820 raft_consensus.cc:493] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.938302 21843 tablet_bootstrap.cc:492] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:01.938983 21843 ts_tablet_manager.cc:1403] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.212s	user 0.021s	sys 0.009s
I20260709 13:20:01.940785 21944 raft_consensus.cc:2804] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.935925 21820 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.949887 21944 raft_consensus.cc:493] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:01.955312 21944 raft_consensus.cc:3060] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.946820 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:01.956138 21245 raft_consensus.cc:3060] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.964802 21892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:01.975849 21843 raft_consensus.cc:359] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.965924 21246 raft_consensus.cc:2393] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e8ce20857fa342c1b4cfc322565e1648 in current term 2: Already voted for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in this term.
I20260709 13:20:01.977113 21843 raft_consensus.cc:740] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.979501 21937 leader_election.cc:290] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:01.964082 21933 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.985407 21843 consensus_queue.cc:260] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:01.992959 21887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:01.993750 21887 raft_consensus.cc:3060] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.997707 21176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "428efef8d3454b9f894a316ef6c5576a" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:01.998414 21176 raft_consensus.cc:3060] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.998935 21933 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:01.978804 21892 raft_consensus.cc:2468] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 1.
I20260709 13:20:02.010294 21843 ts_tablet_manager.cc:1434] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 13:20:02.011360 21843 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
W20260709 13:20:02.014724 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:43093, user_credentials={real_user=slave}} blocked reactor thread for 136847us
I20260709 13:20:02.015132 21890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7" is_pre_election: true
I20260709 13:20:02.018457 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:02.001056 21935 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.025089 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.026670 21178 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.008889 20929 ts_manager.cc:194] Re-registered known tserver with Master: 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:02.027143 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.028290 21888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8db1e0ee06248228c09ec09a8ec2374" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.029484 21245 raft_consensus.cc:2468] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.030916 21890 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:02.032989 21775 leader_election.cc:290] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:02.040505 21072 leader_election.cc:304] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:02.041524 21176 raft_consensus.cc:2468] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.037968 21891 raft_consensus.cc:3060] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.044982 21069 leader_election.cc:304] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:02.048341 21101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648" is_pre_election: true
I20260709 13:20:02.049655 21945 raft_consensus.cc:2804] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.050315 21945 raft_consensus.cc:697] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.050477 21098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:02.038112 21934 raft_consensus.cc:515] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.051672 21098 raft_consensus.cc:2393] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in current term 2: Already voted for candidate e8ce20857fa342c1b4cfc322565e1648 in this term.
I20260709 13:20:02.053161 21934 leader_election.cc:290] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:02.051275 21945 consensus_queue.cc:237] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:20:02.046519 21219 leader_election.cc:343] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:02.049357 21930 raft_consensus.cc:2804] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:20:02.038914 21145 leader_election.cc:343] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:02.064836 21893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90ab82e70de84e30bf72e4383c4309b0" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.067241 21820 raft_consensus.cc:515] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.068840 21930 raft_consensus.cc:697] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.069890 21930 consensus_queue.cc:237] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:02.070824 21887 raft_consensus.cc:2468] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.074724 21219 leader_election.cc:304] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:20:02.083987 21935 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
W20260709 13:20:02.086211 21071 leader_election.cc:343] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:02.093928 21071 leader_election.cc:343] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:02.086812 21775 raft_consensus.cc:2804] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:02.095391 21775 raft_consensus.cc:493] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:02.095789 21775 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.091874 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:02.088456 21820 leader_election.cc:290] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:02.098750 21246 raft_consensus.cc:3060] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.072239 21940 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:02.096552 21944 raft_consensus.cc:515] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:02.106711 21247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
W20260709 13:20:02.114768 21145 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.65:43285, user_credentials={real_user=slave}} blocked reactor thread for 75890.5us
I20260709 13:20:02.111097 21888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a01bd1c7e8e34a2cb7235e985339f475" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.125835 21219 leader_election.cc:304] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:02.116358 21890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.116257 21247 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.126965 21776 raft_consensus.cc:2749] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.125715 21891 raft_consensus.cc:2468] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
W20260709 13:20:02.142520 21071 leader_election.cc:343] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:02.137554 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:02.144830 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.151055 21940 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:02.153115 21893 raft_consensus.cc:1275] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.137758 21890 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.151084 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:02.162112 21102 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.170114 21245 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.171264 21071 leader_election.cc:304] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:02.175933 21547 raft_consensus.cc:2804] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.176342 21547 raft_consensus.cc:697] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.177299 21547 consensus_queue.cc:237] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.180330 21102 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:02.182389 21219 leader_election.cc:304] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:02.185387 21938 raft_consensus.cc:2804] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.182561 21178 raft_consensus.cc:2468] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.185657 21245 raft_consensus.cc:2468] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 2.
W20260709 13:20:02.190582 21219 leader_election.cc:343] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:02.190789 21246 raft_consensus.cc:2468] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.185966 21938 raft_consensus.cc:697] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:02.193014 21938 consensus_queue.cc:237] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.200728 21069 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:02.201052 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.205024 21247 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.207824 21072 leader_election.cc:304] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:02.210523 21146 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:02.213227 21934 raft_consensus.cc:2804] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.215955 21934 raft_consensus.cc:697] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.215996 21952 raft_consensus.cc:2804] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.216699 21952 raft_consensus.cc:697] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:02.217713 21952 consensus_queue.cc:237] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
W20260709 13:20:02.214620 21145 leader_election.cc:343] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:02.228314 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:02.240537 21178 raft_consensus.cc:3060] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.247056 21072 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:02.249343 21624 raft_consensus.cc:2804] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.253894 21894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e82b5b2abd94e6587289f0201891e8b" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.220372 21935 raft_consensus.cc:2804] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.227425 21621 consensus_queue.cc:1048] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:20:02.226624 21944 leader_election.cc:290] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:02.259164 21246 raft_consensus.cc:1275] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.272324 21178 raft_consensus.cc:2468] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.274374 21069 leader_election.cc:304] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:02.278878 21945 raft_consensus.cc:2804] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.279462 21945 raft_consensus.cc:697] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.259972 21894 raft_consensus.cc:3060] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.289295 21945 consensus_queue.cc:237] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:02.227869 21934 consensus_queue.cc:237] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:02.339159 21624 raft_consensus.cc:697] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.310251 21935 raft_consensus.cc:697] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.343052 21775 raft_consensus.cc:515] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:20:02.365161 21146 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.68:37887, user_credentials={real_user=slave}} blocked reactor thread for 56070.3us
I20260709 13:20:02.369966 21775 leader_election.cc:290] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 election: Requested vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:02.385504 21624 consensus_queue.cc:237] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.397107 21099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:02.397838 21890 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.399207 21930 consensus_queue.cc:1048] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:02.402796 21843 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:02.403733 21892 raft_consensus.cc:1275] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.404003 21843 tablet_bootstrap.cc:492] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:02.408998 21843 ts_tablet_manager.cc:1403] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.398s	user 0.028s	sys 0.005s
W20260709 13:20:02.416314 21965 log.cc:927] Time spent T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:20:02.445353 21250 raft_consensus.cc:1240] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Rejecting Update request from peer e8ce20857fa342c1b4cfc322565e1648 for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:02.439070 21891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289ff54958748809113e69d968d9332" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
I20260709 13:20:02.450474 21891 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.416865 21935 consensus_queue.cc:237] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.460397 21843 raft_consensus.cc:359] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:02.481632 21843 raft_consensus.cc:740] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:02.497783 20927 catalog_manager.cc:5697] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.482668 21843 consensus_queue.cc:260] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:02.518509 21843 ts_tablet_manager.cc:1434] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.000s
I20260709 13:20:02.519462 21843 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:02.538131 21964 consensus_queue.cc:1059] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:20:02.544445 21071 consensus_peers.cc:597] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.547758 21932 raft_consensus.cc:3055] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:02.548187 21932 raft_consensus.cc:740] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:02.549130 21932 consensus_queue.cc:260] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.556082 21932 raft_consensus.cc:3060] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:02.562748 21246 raft_consensus.cc:1275] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.508811 21894 raft_consensus.cc:2468] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:02.574419 21934 consensus_queue.cc:1048] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.602392 21250 raft_consensus.cc:1275] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.605219 21178 raft_consensus.cc:1275] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.605144 21624 consensus_queue.cc:1048] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:20:02.615078 20925 catalog_manager.cc:5697] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 2 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:02.616914 21930 consensus_queue.cc:1048] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:20:02.626888 21892 raft_consensus.cc:1275] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.637826 20929 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33404
I20260709 13:20:02.643743 21892 raft_consensus.cc:1275] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.646510 21921 heartbeater.cc:499] Master 127.14.41.126:36967 was elected leader, sending a full tablet report...
I20260709 13:20:02.646875 21962 consensus_queue.cc:1048] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:02.634529 21964 consensus_queue.cc:1048] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:20:02.695483 21145 consensus_peers.cc:597] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.712393 21071 consensus_peers.cc:597] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.721526 21891 raft_consensus.cc:2468] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 3.
W20260709 13:20:02.727723 21145 consensus_peers.cc:597] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.748544 21253 raft_consensus.cc:1275] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 9bc329a3e3d74a618ce2b4749aaafec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.784186 20927 catalog_manager.cc:5697] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } }
I20260709 13:20:02.791009 21219 leader_election.cc:304] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:02.792357 21776 raft_consensus.cc:2804] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:02.796819 21776 raft_consensus.cc:697] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:02.797778 21776 consensus_queue.cc:237] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:02.800163 20925 catalog_manager.cc:5697] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } }
I20260709 13:20:02.801941 20925 catalog_manager.cc:5697] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } }
W20260709 13:20:02.808374 21145 consensus_peers.cc:597] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.872474 21102 raft_consensus.cc:1275] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:02.879295 21219 consensus_peers.cc:597] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.880404 21219 consensus_peers.cc:597] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.880795 21145 consensus_peers.cc:597] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.891440 21951 consensus_queue.cc:1048] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:20:02.897472 21890 raft_consensus.cc:1275] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:02.902926 21145 consensus_peers.cc:597] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.903810 21145 consensus_peers.cc:597] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.903183 20929 catalog_manager.cc:5697] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:02.905392 21071 consensus_peers.cc:597] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.905714 20929 catalog_manager.cc:5697] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:02.906546 21071 consensus_peers.cc:597] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.912868 21937 consensus_queue.cc:1048] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:02.913333 21954 consensus_queue.cc:1048] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:02.927393 21145 consensus_peers.cc:597] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.930332 21145 consensus_peers.cc:597] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.908324 20929 catalog_manager.cc:5697] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.934486 21892 raft_consensus.cc:1275] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.938963 21245 raft_consensus.cc:1275] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.939904 21954 consensus_queue.cc:1048] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.941454 21932 consensus_queue.cc:1048] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.944505 21175 raft_consensus.cc:1275] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:02.949120 21145 consensus_peers.cc:597] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.956681 21071 consensus_peers.cc:597] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.932729 20929 catalog_manager.cc:5697] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 1 to 2, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.976673 21843 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:02.978506 21932 consensus_queue.cc:1048] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:02.989153 21175 raft_consensus.cc:1275] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.996428 21843 tablet_bootstrap.cc:492] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:02.998667 21843 ts_tablet_manager.cc:1403] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.479s	user 0.018s	sys 0.016s
I20260709 13:20:03.001274 21963 consensus_queue.cc:1048] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:03.001451 21843 raft_consensus.cc:359] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.002257 21843 raft_consensus.cc:740] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.003068 21843 consensus_queue.cc:260] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
W20260709 13:20:03.014284 21145 consensus_peers.cc:597] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:03.016542 21843 ts_tablet_manager.cc:1434] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:20:03.017551 21843 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.026275 20927 catalog_manager.cc:5697] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 3, leader changed from 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65) to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 3 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:03.039870 21219 consensus_peers.cc:597] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:03.045445 21071 consensus_peers.cc:597] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.053169 21843 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.054685 21843 tablet_bootstrap.cc:492] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.055683 21843 ts_tablet_manager.cc:1403] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.003s
W20260709 13:20:03.060055 21145 consensus_peers.cc:597] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:03.065511 21843 raft_consensus.cc:359] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.067946 21843 raft_consensus.cc:740] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
W20260709 13:20:03.068310 21219 consensus_peers.cc:597] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:03.068872 21843 consensus_queue.cc:260] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.072284 21843 ts_tablet_manager.cc:1434] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 13:20:03.073247 21843 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.077297 21245 raft_consensus.cc:1275] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:03.079784 21954 consensus_queue.cc:1048] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:03.104485 21219 consensus_peers.cc:597] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:03.107383 21145 consensus_peers.cc:597] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:03.123175 21071 consensus_peers.cc:597] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:03.127595 21843 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.128674 21843 tablet_bootstrap.cc:492] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.129346 21843 ts_tablet_manager.cc:1403] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.004s
I20260709 13:20:03.138171 21843 raft_consensus.cc:359] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.138911 21843 raft_consensus.cc:740] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.139613 21843 consensus_queue.cc:260] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.146544 21843 ts_tablet_manager.cc:1434] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:20:03.148747 21843 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.183897 21843 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.184976 21843 tablet_bootstrap.cc:492] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.185685 21843 ts_tablet_manager.cc:1403] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.009s
I20260709 13:20:03.186216 21886 raft_consensus.cc:1275] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:03.190096 21948 consensus_queue.cc:1048] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:03.193939 21843 raft_consensus.cc:359] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.195024 21843 raft_consensus.cc:740] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.196185 21843 consensus_queue.cc:260] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.198778 21843 ts_tablet_manager.cc:1434] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:20:03.199841 21843 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.205768 21100 raft_consensus.cc:1275] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:20:03.206277 21100 pending_rounds.cc:85] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: Aborting all ops after (but not including) 1
I20260709 13:20:03.206539 21100 pending_rounds.cc:107] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:20:03.206840 21100 raft_consensus.cc:2889] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:03.211804 21776 consensus_queue.cc:1048] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:03.217815 21886 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.244969 21843 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.246948 21843 tablet_bootstrap.cc:492] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.247720 21843 ts_tablet_manager.cc:1403] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.016s
I20260709 13:20:03.250265 21843 raft_consensus.cc:359] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.250946 21843 raft_consensus.cc:740] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.251618 21843 consensus_queue.cc:260] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.254113 21843 ts_tablet_manager.cc:1434] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:03.254966 21843 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.270582 21886 raft_consensus.cc:3060] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.278227 21843 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.279317 21843 tablet_bootstrap.cc:492] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.280005 21843 ts_tablet_manager.cc:1403] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:20:03.282775 21843 raft_consensus.cc:359] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.283772 21843 raft_consensus.cc:740] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.284521 21843 consensus_queue.cc:260] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.286703 21843 ts_tablet_manager.cc:1434] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:20:03.287545 21843 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
W20260709 13:20:03.292990 21071 consensus_peers.cc:597] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:03.308362 21843 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.309875 21843 tablet_bootstrap.cc:492] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.310513 21843 ts_tablet_manager.cc:1403] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:20:03.313095 21843 raft_consensus.cc:359] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.313799 21843 raft_consensus.cc:740] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.314633 21843 consensus_queue.cc:260] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.316713 21843 ts_tablet_manager.cc:1434] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:03.317538 21843 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.332078 21843 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.332911 21843 tablet_bootstrap.cc:492] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.333534 21843 ts_tablet_manager.cc:1403] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:20:03.335613 21843 raft_consensus.cc:359] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.336262 21843 raft_consensus.cc:740] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.336844 21843 consensus_queue.cc:260] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.338553 21843 ts_tablet_manager.cc:1434] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:03.339622 21843 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.355500 21843 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.356487 21843 tablet_bootstrap.cc:492] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.357226 21843 ts_tablet_manager.cc:1403] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:20:03.359754 21843 raft_consensus.cc:359] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.360378 21843 raft_consensus.cc:740] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.361068 21843 consensus_queue.cc:260] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.362951 21843 ts_tablet_manager.cc:1434] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:03.363826 21843 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.378535 21843 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.379523 21843 tablet_bootstrap.cc:492] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.380225 21843 ts_tablet_manager.cc:1403] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:20:03.382654 21843 raft_consensus.cc:359] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.383344 21843 raft_consensus.cc:740] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.384039 21843 consensus_queue.cc:260] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.386113 21843 ts_tablet_manager.cc:1434] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:20:03.386950 21843 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.405218 21843 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.406176 21843 tablet_bootstrap.cc:492] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.406893 21843 ts_tablet_manager.cc:1403] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:20:03.408885 21843 raft_consensus.cc:359] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.409426 21843 raft_consensus.cc:740] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.410048 21843 consensus_queue.cc:260] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.411789 21843 ts_tablet_manager.cc:1434] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:03.412447 21843 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.429787 21843 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.430557 21843 tablet_bootstrap.cc:492] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.431133 21843 ts_tablet_manager.cc:1403] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 13:20:03.433032 21843 raft_consensus.cc:359] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.433696 21843 raft_consensus.cc:740] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.434376 21843 consensus_queue.cc:260] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.436378 21843 ts_tablet_manager.cc:1434] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:03.437693 21843 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.453401 21843 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.454396 21843 tablet_bootstrap.cc:492] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.455075 21843 ts_tablet_manager.cc:1403] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:20:03.457275 21843 raft_consensus.cc:359] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.457763 21843 raft_consensus.cc:740] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.458241 21843 consensus_queue.cc:260] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.460114 21843 ts_tablet_manager.cc:1434] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:03.461212 21843 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.477180 21843 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.478188 21843 tablet_bootstrap.cc:492] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.478875 21843 ts_tablet_manager.cc:1403] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:20:03.481906 21843 raft_consensus.cc:359] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.482599 21843 raft_consensus.cc:740] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.483251 21843 consensus_queue.cc:260] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.485386 21843 ts_tablet_manager.cc:1434] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:03.486194 21843 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.501087 21843 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.501924 21843 tablet_bootstrap.cc:492] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.502506 21843 ts_tablet_manager.cc:1403] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:20:03.505501 21843 raft_consensus.cc:359] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.506290 21843 raft_consensus.cc:740] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.507085 21843 consensus_queue.cc:260] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.507647 21890 raft_consensus.cc:3060] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:03.509173 21843 ts_tablet_manager.cc:1434] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:03.510874 21843 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.540300 21843 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.541291 21843 tablet_bootstrap.cc:492] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.548910 21843 ts_tablet_manager.cc:1403] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.008s
I20260709 13:20:03.551688 21843 raft_consensus.cc:359] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.552412 21843 raft_consensus.cc:740] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.553200 21843 consensus_queue.cc:260] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:03.555382 21843 ts_tablet_manager.cc:1434] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:03.556207 21843 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.585827 21843 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.586671 21843 tablet_bootstrap.cc:492] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.587270 21843 ts_tablet_manager.cc:1403] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.007s
I20260709 13:20:03.589176 21843 raft_consensus.cc:359] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.589805 21843 raft_consensus.cc:740] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.590276 21843 consensus_queue.cc:260] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.592024 21843 ts_tablet_manager.cc:1434] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:03.593182 21843 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.606223 21843 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.607131 21843 tablet_bootstrap.cc:492] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.607779 21843 ts_tablet_manager.cc:1403] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:20:03.610001 21843 raft_consensus.cc:359] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.610631 21843 raft_consensus.cc:740] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.611380 21843 consensus_queue.cc:260] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.613485 21843 ts_tablet_manager.cc:1434] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:20:03.614610 21843 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.627923 21843 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.628962 21843 tablet_bootstrap.cc:492] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.629541 21843 ts_tablet_manager.cc:1403] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:20:03.631398 21843 raft_consensus.cc:359] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.632050 21843 raft_consensus.cc:740] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.632709 21843 consensus_queue.cc:260] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.634644 21843 ts_tablet_manager.cc:1434] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:03.637681 21843 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.655542 21843 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.656325 21843 tablet_bootstrap.cc:492] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.656999 21843 ts_tablet_manager.cc:1403] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:20:03.659039 21843 raft_consensus.cc:359] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.659988 21843 raft_consensus.cc:740] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.660775 21843 consensus_queue.cc:260] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.663296 21843 ts_tablet_manager.cc:1434] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:03.664335 21843 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.684162 21843 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.685238 21843 tablet_bootstrap.cc:492] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.685946 21843 ts_tablet_manager.cc:1403] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:20:03.687844 21843 raft_consensus.cc:359] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.688513 21843 raft_consensus.cc:740] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.689522 21843 consensus_queue.cc:260] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.691287 21843 ts_tablet_manager.cc:1434] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:03.692171 21843 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.710665 21843 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.711536 21843 tablet_bootstrap.cc:492] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.712224 21843 ts_tablet_manager.cc:1403] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 13:20:03.714826 21843 raft_consensus.cc:359] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.715497 21843 raft_consensus.cc:740] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.716262 21843 consensus_queue.cc:260] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.718556 21843 ts_tablet_manager.cc:1434] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:03.719395 21843 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.733253 21843 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.734037 21843 tablet_bootstrap.cc:492] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.734699 21843 ts_tablet_manager.cc:1403] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:20:03.736423 21843 raft_consensus.cc:359] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.737003 21843 raft_consensus.cc:740] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.737663 21843 consensus_queue.cc:260] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.739311 21843 ts_tablet_manager.cc:1434] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:03.740278 21843 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.763058 21843 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.764103 21843 tablet_bootstrap.cc:492] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.765049 21843 ts_tablet_manager.cc:1403] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.002s
I20260709 13:20:03.767746 21843 raft_consensus.cc:359] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.768700 21843 raft_consensus.cc:740] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.769443 21843 consensus_queue.cc:260] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:03.771966 21843 ts_tablet_manager.cc:1434] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:20:03.772907 21843 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap starting.
I20260709 13:20:03.805910 21843 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.806888 21843 tablet_bootstrap.cc:492] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Bootstrap complete.
I20260709 13:20:03.807578 21843 ts_tablet_manager.cc:1403] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.009s
I20260709 13:20:03.809885 21843 raft_consensus.cc:359] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.810544 21843 raft_consensus.cc:740] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.811159 21843 consensus_queue.cc:260] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:03.813334 21843 ts_tablet_manager.cc:1434] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:20:03.862494 21886 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.339376 21894 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.494045 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:11.555100 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
mode: GRACEFUL
new_leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:46632
I20260709 13:20:11.555714 21177 raft_consensus.cc:606] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Received request to transfer leadership to TS 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:11.558018 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "230befbac66a43a5aad30976385b0944"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:46632
I20260709 13:20:11.558442 21177 raft_consensus.cc:606] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:11.560559 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:46632
I20260709 13:20:11.561213 21177 raft_consensus.cc:606] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:11.564025 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:46632
I20260709 13:20:11.564571 21177 raft_consensus.cc:606] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:11.580225 21100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:11.580941 21100 raft_consensus.cc:606] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:11.585515 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:46632
I20260709 13:20:11.586099 21177 raft_consensus.cc:606] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:11.587396 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:11.588943 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:11.723560 22036 raft_consensus.cc:993] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8: : Instructing follower 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:11.724279 22052 raft_consensus.cc:1081] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Signalling peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:11.726148 21250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:48918
I20260709 13:20:11.726766 21250 raft_consensus.cc:493] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.727146 21250 raft_consensus.cc:3060] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.733817 21250 raft_consensus.cc:515] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:11.736599 21250 leader_election.cc:290] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:11.737036 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:11.737320 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ac20c373724f3baf9ca9b75bc62765" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:11.737926 21100 raft_consensus.cc:3060] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.738059 21177 raft_consensus.cc:3055] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.739245 21177 raft_consensus.cc:740] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:11.740034 21177 consensus_queue.cc:260] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:11.741288 21177 raft_consensus.cc:3060] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.749953 21177 raft_consensus.cc:2468] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:11.751428 21217 leader_election.cc:304] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:11.752818 22053 raft_consensus.cc:2804] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.754065 22053 raft_consensus.cc:697] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:11.754830 21100 raft_consensus.cc:2468] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:11.755169 22053 consensus_queue.cc:237] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:11.767558 20928 catalog_manager.cc:5697] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67) to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 2 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.800684 22040 raft_consensus.cc:993] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.801573 22045 raft_consensus.cc:1081] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.803262 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51622
I20260709 13:20:11.803807 21894 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.804171 21894 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:11.809567 22036 raft_consensus.cc:993] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.810266 22054 raft_consensus.cc:1081] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.811638 21894 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:11.811977 21890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51608
I20260709 13:20:11.812577 21890 raft_consensus.cc:493] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.812933 21890 raft_consensus.cc:3060] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.813820 21894 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:11.825779 21890 raft_consensus.cc:515] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:11.829162 21890 leader_election.cc:290] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:11.837059 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:11.838215 21250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:11.838215 21246 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:11.838824 21250 raft_consensus.cc:3060] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.839506 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8805cdcd3cb148acb1654e722cf4a577" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:11.840073 21100 raft_consensus.cc:3055] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:11.840369 21100 raft_consensus.cc:740] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:11.841388 21100 consensus_queue.cc:260] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:11.842727 21100 raft_consensus.cc:3060] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:11.846616 21246 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:11.849412 21839 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:20:11.849783 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ebc67ba1384341b5cbd68f36a5d420" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:11.850097 21100 raft_consensus.cc:2468] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:11.850994 21177 raft_consensus.cc:3055] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.851445 21177 raft_consensus.cc:740] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:11.852423 22066 raft_consensus.cc:2804] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:11.853055 21250 raft_consensus.cc:2468] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:11.852368 21177 consensus_queue.cc:260] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:11.856832 21177 raft_consensus.cc:3060] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.857972 21839 leader_election.cc:304] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:20:11.860926 22066 raft_consensus.cc:697] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:11.861217 22068 raft_consensus.cc:2804] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.861769 22068 raft_consensus.cc:697] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:11.862145 22066 consensus_queue.cc:237] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:11.862814 22068 consensus_queue.cc:237] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:11.872517 21177 raft_consensus.cc:2468] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:11.874455 20928 catalog_manager.cc:5697] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 2 to 3, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:11.890738 20928 catalog_manager.cc:5697] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.925266 22054 raft_consensus.cc:993] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.925769 22036 raft_consensus.cc:1081] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.927518 21886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51608
I20260709 13:20:11.928066 21886 raft_consensus.cc:493] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.928393 21886 raft_consensus.cc:3060] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.934911 22054 raft_consensus.cc:993] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.935472 22036 raft_consensus.cc:1081] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:11.936774 21886 raft_consensus.cc:515] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:11.937222 21890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51608
I20260709 13:20:11.937783 21890 raft_consensus.cc:493] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:11.938155 21890 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:11.939375 21886 leader_election.cc:290] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:11.939679 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:11.940018 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3848031ef4394b0bbc4d53d2fc9546d2" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:11.940948 21100 raft_consensus.cc:3060] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.941143 21175 raft_consensus.cc:3055] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:11.941619 21175 raft_consensus.cc:740] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:11.942647 21175 consensus_queue.cc:260] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:11.943899 21175 raft_consensus.cc:3060] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:11.946776 21890 raft_consensus.cc:515] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:11.952025 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:11.952216 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72d9426efb8467e9ff58df645ea8f6c" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:11.952682 21177 raft_consensus.cc:3055] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:11.952904 21246 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:11.953069 21177 raft_consensus.cc:740] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:11.953970 21177 consensus_queue.cc:260] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:11.954807 21177 raft_consensus.cc:3060] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:11.952054 21890 leader_election.cc:290] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:11.960206 21177 raft_consensus.cc:2468] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:11.960965 21175 raft_consensus.cc:2468] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:11.961105 21100 raft_consensus.cc:2468] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:11.960965 21246 raft_consensus.cc:2468] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:11.961728 21836 leader_election.cc:304] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:11.962523 21838 leader_election.cc:304] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:11.963441 22066 raft_consensus.cc:2804] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:11.963713 22068 raft_consensus.cc:2804] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:11.963876 22066 raft_consensus.cc:697] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:11.964293 22068 raft_consensus.cc:697] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:11.964920 22066 consensus_queue.cc:237] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:11.965135 22068 consensus_queue.cc:237] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:11.975819 20928 catalog_manager.cc:5697] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 2 to 3, leader changed from 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:11.991065 20928 catalog_manager.cc:5697] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.038125 22054 raft_consensus.cc:993] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.038688 22036 raft_consensus.cc:1081] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.040174 21890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "230befbac66a43a5aad30976385b0944"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51608
I20260709 13:20:12.040725 21890 raft_consensus.cc:493] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.041131 21890 raft_consensus.cc:3060] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.046209 21890 raft_consensus.cc:515] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:12.048483 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:12.048647 21890 leader_election.cc:290] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:12.049119 21175 raft_consensus.cc:3055] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:12.048990 21246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230befbac66a43a5aad30976385b0944" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:12.049726 21175 raft_consensus.cc:740] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:12.049953 21246 raft_consensus.cc:3060] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.050534 21175 consensus_queue.cc:260] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:12.051496 21175 raft_consensus.cc:3060] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.058485 21175 raft_consensus.cc:2468] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:12.061461 21836 leader_election.cc:304] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:12.062314 22068 raft_consensus.cc:2804] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:12.062892 22068 raft_consensus.cc:697] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:12.063846 22068 consensus_queue.cc:237] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:12.069031 21246 raft_consensus.cc:2468] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:12.079873 20928 catalog_manager.cc:5697] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.261189 21175 raft_consensus.cc:1275] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.262461 22046 consensus_queue.cc:1048] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:12.277277 21100 raft_consensus.cc:1275] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.281555 21250 raft_consensus.cc:1275] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.284441 22068 consensus_queue.cc:1048] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:12.278892 22046 consensus_queue.cc:1048] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:20:12.310503 21245 raft_consensus.cc:1275] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.313655 22068 consensus_queue.cc:1048] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:12.328896 21102 raft_consensus.cc:1275] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.333930 22066 consensus_queue.cc:1048] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:12.362548 21175 raft_consensus.cc:1275] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.364620 22067 consensus_queue.cc:1048] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:12.396308 21245 raft_consensus.cc:1275] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.398411 22066 consensus_queue.cc:1048] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:12.422174 21175 raft_consensus.cc:1275] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:12.423475 22068 consensus_queue.cc:1048] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:12.449247 21100 raft_consensus.cc:1275] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.450767 22068 consensus_queue.cc:1048] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:12.465466 21175 raft_consensus.cc:1275] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.466729 22068 consensus_queue.cc:1048] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:12.528004 21175 raft_consensus.cc:1275] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.529306 22068 consensus_queue.cc:1048] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:12.539373 21245 raft_consensus.cc:1275] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:12.540932 22067 consensus_queue.cc:1048] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:12.590006 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:12.628520 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:12.661828 21100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:12.662503 21100 raft_consensus.cc:606] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:12.665094 21100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13fea0e467074bd185a6c07450057598"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:12.665562 21100 raft_consensus.cc:606] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:12.673032 22051 raft_consensus.cc:993] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.673585 22040 raft_consensus.cc:1081] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.675261 21886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13fea0e467074bd185a6c07450057598"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51622
I20260709 13:20:12.675863 21886 raft_consensus.cc:493] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.676255 21886 raft_consensus.cc:3060] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.679148 21250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:56324
I20260709 13:20:12.679806 21250 raft_consensus.cc:606] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:12.682662 21177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:46632
I20260709 13:20:12.683225 21177 raft_consensus.cc:606] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:12.686715 21100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:12.687276 21100 raft_consensus.cc:606] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Received request to transfer leadership to TS 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:12.688292 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:12.689131 21886 raft_consensus.cc:515] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:12.690114 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:12.691942 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:12.692584 21100 raft_consensus.cc:3055] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:12.692909 21100 raft_consensus.cc:740] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:12.694262 21886 leader_election.cc:290] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:12.695214 21100 consensus_queue.cc:260] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:12.696125 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13fea0e467074bd185a6c07450057598" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:12.697506 21175 raft_consensus.cc:3060] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.696645 21100 raft_consensus.cc:3060] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.703970 21175 raft_consensus.cc:2468] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:12.705168 21836 leader_election.cc:304] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:12.705941 22067 raft_consensus.cc:2804] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:12.706401 22067 raft_consensus.cc:697] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:12.707283 22067 consensus_queue.cc:237] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:12.707988 21100 raft_consensus.cc:2468] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:12.719802 20925 catalog_manager.cc:5697] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.773283 22045 raft_consensus.cc:993] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.773792 22045 raft_consensus.cc:1081] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.776237 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51622
I20260709 13:20:12.776851 21894 raft_consensus.cc:493] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.777256 21894 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.786850 21894 raft_consensus.cc:515] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:12.789551 21894 leader_election.cc:290] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:12.789520 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:12.789911 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "115f88285bc14a5b8057a3aa7e8f3d49" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:12.790282 21100 raft_consensus.cc:3055] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:12.790426 21175 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.792011 21100 raft_consensus.cc:740] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:12.792815 21100 consensus_queue.cc:260] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:12.793879 21100 raft_consensus.cc:3060] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.797771 21175 raft_consensus.cc:2468] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:12.798956 21836 leader_election.cc:304] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:12.799924 22067 raft_consensus.cc:2804] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:12.800429 22067 raft_consensus.cc:697] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:12.800531 21100 raft_consensus.cc:2468] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:12.801427 22067 consensus_queue.cc:237] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:12.802951 22080 raft_consensus.cc:993] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.803474 22080 raft_consensus.cc:1081] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:12.805208 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51638
I20260709 13:20:12.805773 21894 raft_consensus.cc:493] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.806176 21894 raft_consensus.cc:3060] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.812449 20925 catalog_manager.cc:5697] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 2 to 3, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.813220 21894 raft_consensus.cc:515] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:12.815223 21894 leader_election.cc:290] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:12.816110 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:12.816394 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc5ba4c765c48d49d6e392427a3303d" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:12.816808 21245 raft_consensus.cc:3055] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:12.817093 21175 raft_consensus.cc:3060] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.817165 21245 raft_consensus.cc:740] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:12.818089 21245 consensus_queue.cc:260] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:12.819465 21245 raft_consensus.cc:3060] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.826663 21245 raft_consensus.cc:2468] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:12.828145 21839 leader_election.cc:304] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:20:12.829093 22067 raft_consensus.cc:2804] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:12.829805 22067 raft_consensus.cc:697] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:12.830156 21175 raft_consensus.cc:2468] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:12.830758 22067 consensus_queue.cc:237] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:12.850876 20925 catalog_manager.cc:5697] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.942152 22098 raft_consensus.cc:993] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:12.942612 22045 raft_consensus.cc:1081] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Signalling peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:12.943974 21245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:48920
I20260709 13:20:12.944435 21245 raft_consensus.cc:493] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.944833 21245 raft_consensus.cc:3060] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.951506 21245 raft_consensus.cc:515] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:12.954403 21245 leader_election.cc:290] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:12.955600 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:12.956010 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e227c9264c424ae89443b124431f4bc4" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:12.956271 21177 raft_consensus.cc:3060] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.956633 21100 raft_consensus.cc:3055] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:12.957005 21100 raft_consensus.cc:740] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:12.957616 21100 consensus_queue.cc:260] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:12.958366 21100 raft_consensus.cc:3060] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.961767 21177 raft_consensus.cc:2468] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:12.964237 21217 leader_election.cc:304] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:12.964870 21100 raft_consensus.cc:2468] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:12.965252 22080 raft_consensus.cc:2804] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:12.966539 22080 raft_consensus.cc:697] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:12.967538 22080 consensus_queue.cc:237] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:12.976791 20925 catalog_manager.cc:5697] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 2 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.156649 22036 raft_consensus.cc:993] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:13.157163 22054 raft_consensus.cc:1081] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:13.159447 21100 raft_consensus.cc:1275] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.159518 21886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51608
I20260709 13:20:13.160216 21886 raft_consensus.cc:493] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.160585 21886 raft_consensus.cc:3060] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.160975 22068 consensus_queue.cc:1048] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.168632 21886 raft_consensus.cc:515] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:13.171361 21886 leader_election.cc:290] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:13.174343 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:13.180938 21100 raft_consensus.cc:3060] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.182144 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a6eec3bdec4955bc56e41974349edd" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:13.182818 21177 raft_consensus.cc:3055] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.183125 21177 raft_consensus.cc:740] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:13.183966 21175 raft_consensus.cc:1275] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.184065 21177 consensus_queue.cc:260] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:13.185446 21177 raft_consensus.cc:3060] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.187418 22067 consensus_queue.cc:1048] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.191924 21100 raft_consensus.cc:2468] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:13.193143 21838 leader_election.cc:304] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:13.194458 22067 raft_consensus.cc:2804] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.195932 22067 raft_consensus.cc:697] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:13.197381 22067 consensus_queue.cc:237] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } }
I20260709 13:20:13.207559 21177 raft_consensus.cc:2468] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:13.224511 20928 catalog_manager.cc:5697] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.357218 21177 raft_consensus.cc:1275] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.358527 22067 consensus_queue.cc:1048] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.374583 21177 raft_consensus.cc:1275] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.376340 22067 consensus_queue.cc:1048] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.386030 21253 raft_consensus.cc:1275] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.387632 22105 consensus_queue.cc:1048] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.401525 21102 raft_consensus.cc:1275] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.436178 22066 consensus_queue.cc:1048] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:13.497788 21100 raft_consensus.cc:1275] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.499080 22080 consensus_queue.cc:1048] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.509420 21177 raft_consensus.cc:1275] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.510840 22080 consensus_queue.cc:1048] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.623176 21177 raft_consensus.cc:1275] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.624667 22066 consensus_queue.cc:1048] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:13.635887 21102 raft_consensus.cc:1275] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.637284 22067 consensus_queue.cc:1048] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.691140 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.736534 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.788942 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:13.789500 21102 raft_consensus.cc:606] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:13.792167 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:13.792717 21102 raft_consensus.cc:606] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:13.795152 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8802f602125f45849d52951cb35a2e51"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:13.795630 21102 raft_consensus.cc:606] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Received request to transfer leadership to TS 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:13.798103 21245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:56324
I20260709 13:20:13.798589 21245 raft_consensus.cc:606] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:13.801272 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:13.801767 21102 raft_consensus.cc:606] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Received request to transfer leadership to TS 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:20:13.802865 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:13.804054 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:13.906548 22113 raft_consensus.cc:993] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:13.907192 22040 raft_consensus.cc:1081] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:13.908792 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51622
I20260709 13:20:13.909219 21894 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.909466 21894 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.914086 21894 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:13.915575 21894 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:13.916556 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:13.916692 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8297f1726bad4a5dba767dc9d850ccb8" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:13.917305 21245 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.917367 21102 raft_consensus.cc:3055] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:13.917800 21102 raft_consensus.cc:740] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:13.918485 21102 consensus_queue.cc:260] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:13.919384 21102 raft_consensus.cc:3060] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.923111 21245 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:13.924522 21839 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:20:13.925400 22067 raft_consensus.cc:2804] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:13.925505 21102 raft_consensus.cc:2468] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:13.925979 22067 raft_consensus.cc:697] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:13.927088 22067 consensus_queue.cc:237] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:13.937968 20929 catalog_manager.cc:5697] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 2 to 3, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.006647 22117 raft_consensus.cc:993] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:14.007143 22046 raft_consensus.cc:1081] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:14.008751 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51638
I20260709 13:20:14.009238 21894 raft_consensus.cc:493] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.009531 21894 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.014499 21894 raft_consensus.cc:515] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:14.016242 21894 leader_election.cc:290] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:14.016970 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:14.017431 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77f26debe334a758ab2ca9c17429fb6" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:14.017710 21245 raft_consensus.cc:3055] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:14.018100 21102 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.018139 21245 raft_consensus.cc:740] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:14.019402 21245 consensus_queue.cc:260] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:14.020514 21245 raft_consensus.cc:3060] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.024580 21102 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:14.025764 21838 leader_election.cc:304] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:14.026510 22067 raft_consensus.cc:2804] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:14.027035 22067 raft_consensus.cc:697] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:14.027081 21245 raft_consensus.cc:2468] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 3.
I20260709 13:20:14.028074 22067 consensus_queue.cc:237] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:14.037896 20929 catalog_manager.cc:5697] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 2 to 3, leader changed from 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 3 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.076797 22113 raft_consensus.cc:993] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:14.077339 22040 raft_consensus.cc:1081] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:14.078907 21894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51622
I20260709 13:20:14.079598 21894 raft_consensus.cc:493] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.079968 21894 raft_consensus.cc:3060] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.086720 21894 raft_consensus.cc:515] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:14.089962 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:14.090194 21894 leader_election.cc:290] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:14.090623 21253 raft_consensus.cc:3060] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.092115 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08de2d3846974898b85e48b736d45cd0" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:14.092756 21102 raft_consensus.cc:3055] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.093030 21102 raft_consensus.cc:740] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:14.093715 21102 consensus_queue.cc:260] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:14.094587 21102 raft_consensus.cc:3060] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.097992 21253 raft_consensus.cc:2468] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:14.099565 21839 leader_election.cc:304] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 
I20260709 13:20:14.100404 22066 raft_consensus.cc:2804] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.102069 21102 raft_consensus.cc:2468] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:14.102758 22066 raft_consensus.cc:697] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:14.104295 22066 consensus_queue.cc:237] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:14.122440 22040 raft_consensus.cc:993] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 9bc329a3e3d74a618ce2b4749aaafec8 to start an election
I20260709 13:20:14.122897 22113 raft_consensus.cc:1081] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Signalling peer 9bc329a3e3d74a618ce2b4749aaafec8 to start an election
I20260709 13:20:14.125978 21178 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
 from {username='slave'} at 127.0.0.1:41066
I20260709 13:20:14.126542 21178 raft_consensus.cc:493] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.126948 21178 raft_consensus.cc:3060] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.126338 20929 catalog_manager.cc:5697] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.136291 21178 raft_consensus.cc:515] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:14.140527 21178 leader_election.cc:290] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:14.142247 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:14.142850 21100 raft_consensus.cc:3055] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.143184 21100 raft_consensus.cc:740] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:14.143987 21100 consensus_queue.cc:260] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:14.142871 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0670515d5ba47de932640b46e77d7f3" candidate_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:14.146189 21253 raft_consensus.cc:3060] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.145543 21100 raft_consensus.cc:3060] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.153343 21253 raft_consensus.cc:2468] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 2.
I20260709 13:20:14.154489 21146 leader_election.cc:304] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:14.155263 22036 raft_consensus.cc:2804] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.155740 22036 raft_consensus.cc:697] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 LEADER]: Becoming Leader. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:14.156682 21100 raft_consensus.cc:2468] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bc329a3e3d74a618ce2b4749aaafec8 in term 2.
I20260709 13:20:14.156556 22036 consensus_queue.cc:237] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:14.171720 20929 catalog_manager.cc:5697] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 reported cstate change: term changed from 1 to 2, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.267637 22113 raft_consensus.cc:993] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:14.268127 22040 raft_consensus.cc:1081] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Signalling peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:14.269778 21253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8802f602125f45849d52951cb35a2e51"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:48920
I20260709 13:20:14.270340 21253 raft_consensus.cc:493] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.270687 21253 raft_consensus.cc:3060] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.277503 21253 raft_consensus.cc:515] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:14.279254 21253 leader_election.cc:290] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:14.280251 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:14.280248 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8802f602125f45849d52951cb35a2e51" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:14.281129 21100 raft_consensus.cc:3055] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.281221 21178 raft_consensus.cc:3060] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.281478 21100 raft_consensus.cc:740] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:14.282254 21100 consensus_queue.cc:260] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:14.283332 21100 raft_consensus.cc:3060] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.287245 21178 raft_consensus.cc:2468] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:14.288357 21217 leader_election.cc:304] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:14.289176 22126 raft_consensus.cc:2804] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.289583 21100 raft_consensus.cc:2468] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:14.289685 22126 raft_consensus.cc:697] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:14.290725 22126 consensus_queue.cc:237] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:14.301642 20929 catalog_manager.cc:5697] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 2 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:14.450039 21253 raft_consensus.cc:1275] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:14.451191 22127 consensus_queue.cc:1048] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:14.465798 21102 raft_consensus.cc:1275] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:14.467227 22066 consensus_queue.cc:1048] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:14.473312 21253 raft_consensus.cc:1275] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:14.476436 22066 consensus_queue.cc:1048] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:14.490176 21102 raft_consensus.cc:1275] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:14.493424 22105 consensus_queue.cc:1048] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:14.557636 21100 raft_consensus.cc:1275] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.559039 22105 consensus_queue.cc:1048] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.568662 21253 raft_consensus.cc:1275] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.570031 22127 consensus_queue.cc:1048] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.658968 21253 raft_consensus.cc:1275] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 9bc329a3e3d74a618ce2b4749aaafec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.660517 22109 consensus_queue.cc:1048] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.681293 21100 raft_consensus.cc:1275] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 9bc329a3e3d74a618ce2b4749aaafec8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.682976 22109 consensus_queue.cc:1048] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.747087 21100 raft_consensus.cc:1275] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.748445 22117 consensus_queue.cc:1048] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.759941 21178 raft_consensus.cc:1275] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.761453 22126 consensus_queue.cc:1048] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.805219 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:14.862677 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:14.905324 21178 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c"
dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
mode: GRACEFUL
new_leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:46632
I20260709 13:20:14.905845 21178 raft_consensus.cc:606] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Received request to transfer leadership to TS 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:14.908560 21253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
mode: GRACEFUL
new_leader_uuid: "e8ce20857fa342c1b4cfc322565e1648"
 from {username='slave'} at 127.0.0.1:56324
I20260709 13:20:14.909148 21253 raft_consensus.cc:606] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Received request to transfer leadership to TS e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:14.910487 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:14.912177 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:15.014509 22109 raft_consensus.cc:993] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8: : Instructing follower 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:15.015100 22109 raft_consensus.cc:1081] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Signalling peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:15.016779 21245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:48918
I20260709 13:20:15.017365 21245 raft_consensus.cc:493] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.017689 21245 raft_consensus.cc:3060] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.025115 21245 raft_consensus.cc:515] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:15.026891 21245 leader_election.cc:290] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:15.027447 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:15.027848 21178 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e0d65d4b8e468085b0a5a2d280c36c" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:15.028164 21100 raft_consensus.cc:3060] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.028469 21178 raft_consensus.cc:3055] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:15.028793 21178 raft_consensus.cc:740] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9bc329a3e3d74a618ce2b4749aaafec8, State: Running, Role: LEADER
I20260709 13:20:15.029575 21178 consensus_queue.cc:260] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:15.030792 21178 raft_consensus.cc:3060] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.035241 21100 raft_consensus.cc:2468] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:15.037174 21219 leader_election.cc:304] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:15.038005 22126 raft_consensus.cc:2804] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:15.038719 22126 raft_consensus.cc:697] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:15.037925 21178 raft_consensus.cc:2468] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:15.039669 22126 consensus_queue.cc:237] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:15.055334 20929 catalog_manager.cc:5697] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67) to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 2 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:15.101663 22141 raft_consensus.cc:993] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: : Instructing follower e8ce20857fa342c1b4cfc322565e1648 to start an election
I20260709 13:20:15.102139 22117 raft_consensus.cc:1081] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Signalling peer e8ce20857fa342c1b4cfc322565e1648 to start an election
I20260709 13:20:15.103565 21100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
 from {username='slave'} at 127.0.0.1:37700
I20260709 13:20:15.103988 21100 raft_consensus.cc:493] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.104218 21100 raft_consensus.cc:3060] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.108747 21100 raft_consensus.cc:515] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:15.110806 21100 leader_election.cc:290] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:15.111560 21177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:15.111811 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35366fd4bf3b40269b10dbf95981ec98" candidate_uuid: "e8ce20857fa342c1b4cfc322565e1648" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:15.112161 21177 raft_consensus.cc:3060] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.112471 21245 raft_consensus.cc:3055] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:15.112860 21245 raft_consensus.cc:740] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:15.113570 21245 consensus_queue.cc:260] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:15.114562 21245 raft_consensus.cc:3060] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.118377 21177 raft_consensus.cc:2468] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:15.119910 21069 leader_election.cc:304] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bc329a3e3d74a618ce2b4749aaafec8, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:15.120790 22113 raft_consensus.cc:2804] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:15.121312 21245 raft_consensus.cc:2468] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8ce20857fa342c1b4cfc322565e1648 in term 2.
I20260709 13:20:15.121469 22113 raft_consensus.cc:697] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Becoming Leader. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:15.122488 22113 consensus_queue.cc:237] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:15.134227 20929 catalog_manager.cc:5697] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 reported cstate change: term changed from 1 to 2, leader changed from 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68) to e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66). New cstate: current_term: 2 leader_uuid: "e8ce20857fa342c1b4cfc322565e1648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:15.544512 21178 raft_consensus.cc:1275] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.546115 22113 consensus_queue.cc:1048] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:15.565662 21253 raft_consensus.cc:1275] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer e8ce20857fa342c1b4cfc322565e1648: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.566881 22113 consensus_queue.cc:1048] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.625876 21178 raft_consensus.cc:1275] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.627113 22117 consensus_queue.cc:1048] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.636071 21100 raft_consensus.cc:1275] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.637676 22126 consensus_queue.cc:1048] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.913064 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:15.961370 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.003872 21102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38983c417740476390f693a1ab05eb8a"
dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
mode: GRACEFUL
new_leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:33024
I20260709 13:20:16.004451 21102 raft_consensus.cc:606] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Received request to transfer leadership to TS 4bb61bea9b7d4c7dabace3a6c04d1cf2
I20260709 13:20:16.007010 21253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f389bd24ad6943419686b3110e876624"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:56324
I20260709 13:20:16.007503 21253 raft_consensus.cc:606] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:16.008631 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:16.009954 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:16.326071 22117 raft_consensus.cc:993] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:16.326527 22161 raft_consensus.cc:1081] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:16.328050 21890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f389bd24ad6943419686b3110e876624"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51638
I20260709 13:20:16.328557 21890 raft_consensus.cc:493] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.328929 21890 raft_consensus.cc:3060] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.333657 21890 raft_consensus.cc:515] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:16.335170 21890 leader_election.cc:290] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887)
I20260709 13:20:16.336004 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:16.336218 21253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f389bd24ad6943419686b3110e876624" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:16.336692 21175 raft_consensus.cc:3060] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.336800 21253 raft_consensus.cc:3055] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.337180 21253 raft_consensus.cc:740] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:16.337823 21253 consensus_queue.cc:260] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:16.338924 21253 raft_consensus.cc:3060] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.342486 21175 raft_consensus.cc:2468] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:16.343595 21836 leader_election.cc:304] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:16.344317 22127 raft_consensus.cc:2804] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.344551 21253 raft_consensus.cc:2468] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:16.345793 22127 raft_consensus.cc:697] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:16.346712 22127 consensus_queue.cc:237] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:16.357208 20929 catalog_manager.cc:5697] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.401926 22113 raft_consensus.cc:993] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: : Instructing follower 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:16.402437 22113 raft_consensus.cc:1081] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Signalling peer 4bb61bea9b7d4c7dabace3a6c04d1cf2 to start an election
I20260709 13:20:16.404564 21253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38983c417740476390f693a1ab05eb8a"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
 from {username='slave'} at 127.0.0.1:48920
I20260709 13:20:16.405144 21253 raft_consensus.cc:493] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.405508 21253 raft_consensus.cc:3060] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.412408 21253 raft_consensus.cc:515] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:16.414264 21253 leader_election.cc:290] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Requested vote from peers e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093), 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045)
I20260709 13:20:16.415288 21175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9bc329a3e3d74a618ce2b4749aaafec8"
I20260709 13:20:16.415498 21102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38983c417740476390f693a1ab05eb8a" candidate_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:16.415918 21175 raft_consensus.cc:3060] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.416252 21102 raft_consensus.cc:3055] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.416574 21102 raft_consensus.cc:740] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8ce20857fa342c1b4cfc322565e1648, State: Running, Role: LEADER
I20260709 13:20:16.417490 21102 consensus_queue.cc:260] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:16.418529 21102 raft_consensus.cc:3060] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.421761 21175 raft_consensus.cc:2468] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:16.423134 21217 leader_election.cc:304] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2, 9bc329a3e3d74a618ce2b4749aaafec8; no voters: 
I20260709 13:20:16.423935 22161 raft_consensus.cc:2804] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.424435 22161 raft_consensus.cc:697] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:16.425285 22161 consensus_queue.cc:237] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } }
I20260709 13:20:16.426523 21102 raft_consensus.cc:2468] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb61bea9b7d4c7dabace3a6c04d1cf2 in term 2.
I20260709 13:20:16.435634 20929 catalog_manager.cc:5697] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 reported cstate change: term changed from 1 to 2, leader changed from e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66) to 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68). New cstate: current_term: 2 leader_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:16.816859 21217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:34045, user_credentials={real_user=slave}} blocked reactor thread for 97016.3us
I20260709 13:20:16.872997 21245 raft_consensus.cc:1275] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.875087 22162 consensus_queue.cc:1048] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:16.905037 21175 raft_consensus.cc:1275] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.907866 22173 consensus_queue.cc:1048] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:16.943814 21100 raft_consensus.cc:1275] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.945767 22117 consensus_queue.cc:1048] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:16.958894 21175 raft_consensus.cc:1275] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Refusing update from remote peer 4bb61bea9b7d4c7dabace3a6c04d1cf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.961766 22171 consensus_queue.cc:1048] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:17.010913 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.076180 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.125469 21245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c02b59a16cf441888ce492581a48536"
dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
mode: GRACEFUL
new_leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:56324
I20260709 13:20:17.126231 21245 raft_consensus.cc:606] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Received request to transfer leadership to TS 1d804ce9949645b19a0ccc1faf258ec7
I20260709 13:20:17.127909 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:17.129491 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:17.288348 22117 raft_consensus.cc:993] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: : Instructing follower 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:17.288923 22171 raft_consensus.cc:1081] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Signalling peer 1d804ce9949645b19a0ccc1faf258ec7 to start an election
I20260709 13:20:17.290606 21890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c02b59a16cf441888ce492581a48536"
dest_uuid: "1d804ce9949645b19a0ccc1faf258ec7"
 from {username='slave'} at 127.0.0.1:51638
I20260709 13:20:17.291138 21890 raft_consensus.cc:493] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.291442 21890 raft_consensus.cc:3060] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.298008 21890 raft_consensus.cc:515] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:17.300498 21890 leader_election.cc:290] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68:37887), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:17.300895 21245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2"
I20260709 13:20:17.301316 21100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c02b59a16cf441888ce492581a48536" candidate_uuid: "1d804ce9949645b19a0ccc1faf258ec7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8ce20857fa342c1b4cfc322565e1648"
I20260709 13:20:17.301848 21245 raft_consensus.cc:3055] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.301971 21100 raft_consensus.cc:3060] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.302145 21245 raft_consensus.cc:740] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bb61bea9b7d4c7dabace3a6c04d1cf2, State: Running, Role: LEADER
I20260709 13:20:17.303113 21245 consensus_queue.cc:260] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:17.304252 21245 raft_consensus.cc:3060] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.312148 21100 raft_consensus.cc:2468] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:17.315776 21245 raft_consensus.cc:2468] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d804ce9949645b19a0ccc1faf258ec7 in term 2.
I20260709 13:20:17.316310 21838 leader_election.cc:304] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648; no voters: 
I20260709 13:20:17.317330 22173 raft_consensus.cc:2804] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.317821 22173 raft_consensus.cc:697] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Becoming Leader. State: Replica: 1d804ce9949645b19a0ccc1faf258ec7, State: Running, Role: LEADER
I20260709 13:20:17.318792 22173 consensus_queue.cc:237] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:17.332906 20925 catalog_manager.cc:5697] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 reported cstate change: term changed from 1 to 2, leader changed from 4bb61bea9b7d4c7dabace3a6c04d1cf2 (127.14.41.68) to 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "1d804ce9949645b19a0ccc1faf258ec7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:17.712368 21245 raft_consensus.cc:1275] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.713802 22127 consensus_queue.cc:1048] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:17.729905 21100 raft_consensus.cc:1275] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Refusing update from remote peer 1d804ce9949645b19a0ccc1faf258ec7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.732650 22173 consensus_queue.cc:1048] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:18.130443 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:18.174733 14501 tablet_server.cc:179] TabletServer@127.14.41.65:43285 shutting down...
W20260709 13:20:18.208213 21071 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 93 similar messages]
W20260709 13:20:18.213770 21071 consensus_peers.cc:597] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.218981 21071 consensus_peers.cc:597] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.230985 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:18.232295 14501 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:18.232115 21071 consensus_peers.cc:597] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.233992 14501 raft_consensus.cc:2243] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.236195 14501 raft_consensus.cc:2272] T f389bd24ad6943419686b3110e876624 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.239086 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.239728 14501 raft_consensus.cc:2243] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.240545 14501 raft_consensus.cc:2272] T 115f88285bc14a5b8057a3aa7e8f3d49 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.242690 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.243321 14501 raft_consensus.cc:2243] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.244138 14501 raft_consensus.cc:2272] T 3848031ef4394b0bbc4d53d2fc9546d2 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.246665 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.247329 14501 raft_consensus.cc:2243] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.247766 14501 raft_consensus.cc:2272] T 62cd665cde99440fbd2d8bbd52fbadec P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.250789 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.251592 14501 raft_consensus.cc:2243] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.251945 14501 raft_consensus.cc:2272] T 65a4c18f2b744dccb42a3da937d648f6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.254280 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.254845 14501 raft_consensus.cc:2243] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.255349 14501 raft_consensus.cc:2272] T 20e2322c978e431ab9ce24d58bf8177a P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.258013 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.259032 14501 raft_consensus.cc:2243] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:18.259275 21071 consensus_peers.cc:597] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.259644 14501 raft_consensus.cc:2272] T 07889753a7dd4a42b31d46ef6a693f98 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.262686 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.263427 14501 raft_consensus.cc:2243] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.263883 14501 raft_consensus.cc:2272] T c088f6c59e3d40e28bfb3005f3fe8930 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.266559 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.267397 14501 raft_consensus.cc:2243] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.267824 14501 raft_consensus.cc:2272] T 18db2aafa5c048e98de27e15a5df6e61 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.270022 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.270612 14501 raft_consensus.cc:2243] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.271023 14501 raft_consensus.cc:2272] T 3f74fadf9cfd46a09de882208a769f0f P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.273327 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.274029 14501 raft_consensus.cc:2243] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.274507 14501 raft_consensus.cc:2272] T ae9de470b5d74977809dc2668fa67ae3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.278020 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.278903 14501 raft_consensus.cc:2243] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.279469 14501 raft_consensus.cc:2272] T 157364afaee148b998ca48df7e81225e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.280335 21071 consensus_peers.cc:597] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.281949 21071 consensus_peers.cc:597] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.282737 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.283692 14501 raft_consensus.cc:2243] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.284287 14501 raft_consensus.cc:2272] T a01bd1c7e8e34a2cb7235e985339f475 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.287601 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.288535 14501 raft_consensus.cc:2243] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.289242 14501 raft_consensus.cc:2272] T d033c5d43dee4eaca81ac47cdb061f0b P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.289286 21071 consensus_peers.cc:597] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.291702 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.292449 14501 raft_consensus.cc:2243] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.293226 14501 raft_consensus.cc:2272] T b77f26debe334a758ab2ca9c17429fb6 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.295531 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.296105 14501 raft_consensus.cc:2243] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.296947 14501 raft_consensus.cc:2272] T 08de2d3846974898b85e48b736d45cd0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.299269 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.299908 14501 raft_consensus.cc:2243] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.300746 14501 raft_consensus.cc:2272] T 28ebc67ba1384341b5cbd68f36a5d420 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.302839 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.303433 14501 raft_consensus.cc:2243] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.303910 14501 raft_consensus.cc:2272] T d8db1e0ee06248228c09ec09a8ec2374 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.306821 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.307610 14501 raft_consensus.cc:2243] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.308151 14501 raft_consensus.cc:2272] T 69c0be6c701f4fae9083797282669fe3 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.311452 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.312374 14501 raft_consensus.cc:2243] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.313035 14501 raft_consensus.cc:2272] T 4e82b5b2abd94e6587289f0201891e8b P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.315161 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.315670 14501 raft_consensus.cc:2243] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.316030 14501 raft_consensus.cc:2272] T 7d7eae6372364e919b8c6f1a4d358a77 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.318177 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.318722 14501 raft_consensus.cc:2243] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.319551 14501 raft_consensus.cc:2272] T 230befbac66a43a5aad30976385b0944 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.321805 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.322386 14501 raft_consensus.cc:2243] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.322827 14501 raft_consensus.cc:2272] T 9289ff54958748809113e69d968d9332 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.324988 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.325595 14501 raft_consensus.cc:2243] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.326128 14501 raft_consensus.cc:2272] T 428efef8d3454b9f894a316ef6c5576a P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.328539 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.329216 14501 raft_consensus.cc:2243] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.329655 14501 raft_consensus.cc:2272] T 3547414adb8447f6989687a1f99ce241 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.331862 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.332551 14501 raft_consensus.cc:2243] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.333043 14501 raft_consensus.cc:2272] T 95a91f1d3cda4e78b61f1817a855f249 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.336035 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.336730 14501 raft_consensus.cc:2243] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.337262 14501 raft_consensus.cc:2272] T fd01db0747d94dc08454b218e6dca7be P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.337965 21145 consensus_peers.cc:597] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.340335 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.341315 14501 raft_consensus.cc:2243] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.341856 14501 raft_consensus.cc:2272] T 317b739931ab4905ba1a212e8abe5207 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.344853 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.345670 14501 raft_consensus.cc:2243] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.346279 14501 raft_consensus.cc:2272] T bf91f39c6153492a8fd05d9918062caa P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.349479 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.350332 14501 raft_consensus.cc:2243] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.350929 14501 raft_consensus.cc:2272] T c1cf371fb66e4871bfbcf50de978af7d P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.353979 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.354717 14501 raft_consensus.cc:2243] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.355273 14501 raft_consensus.cc:2272] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.358027 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.358726 14501 raft_consensus.cc:2243] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.359724 14501 raft_consensus.cc:2272] T 8805cdcd3cb148acb1654e722cf4a577 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.362914 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.363848 14501 raft_consensus.cc:2243] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.365124 14501 raft_consensus.cc:2272] T 9dc5ba4c765c48d49d6e392427a3303d P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.367496 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.368089 14501 raft_consensus.cc:2243] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.368660 14501 raft_consensus.cc:2272] T 9f647f71210440f2b1c7811406423646 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.371971 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.372881 14501 raft_consensus.cc:2243] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.373557 14501 raft_consensus.cc:2272] T 90ab82e70de84e30bf72e4383c4309b0 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.377079 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.377965 14501 raft_consensus.cc:2243] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:18.378580 21145 consensus_peers.cc:597] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.378633 14501 raft_consensus.cc:2272] T 18c983bfb97d4996978143ed268649ca P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.382287 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.382948 14501 raft_consensus.cc:2243] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.383976 14501 raft_consensus.cc:2272] T 13fea0e467074bd185a6c07450057598 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.384171 21145 consensus_peers.cc:597] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.386372 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.387284 14501 raft_consensus.cc:2243] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.388396 14501 raft_consensus.cc:2272] T c7a6eec3bdec4955bc56e41974349edd P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.391142 21219 consensus_peers.cc:597] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.391716 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.392381 14501 raft_consensus.cc:2243] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.392810 14501 raft_consensus.cc:2272] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.394958 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.395522 14501 raft_consensus.cc:2243] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.396010 14501 raft_consensus.cc:2272] T f0e039db49ff4c319e42dc1783ed2045 P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.398416 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.399091 14501 raft_consensus.cc:2243] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:20:18.399585 21145 consensus_peers.cc:597] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.400223 14501 raft_consensus.cc:2272] T f72d9426efb8467e9ff58df645ea8f6c P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.402655 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.403225 14501 raft_consensus.cc:2243] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.403983 14501 raft_consensus.cc:2272] T 1c02b59a16cf441888ce492581a48536 P 1d804ce9949645b19a0ccc1faf258ec7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.406380 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.406981 14501 raft_consensus.cc:2243] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.407589 14501 raft_consensus.cc:2272] T b5ea23e9d27e4929a6b8615fc593610e P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.410607 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.411276 14501 raft_consensus.cc:2243] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:20:18.411823 21219 consensus_peers.cc:597] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.412365 14501 raft_consensus.cc:2272] T 8297f1726bad4a5dba767dc9d850ccb8 P 1d804ce9949645b19a0ccc1faf258ec7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.413771 21219 consensus_peers.cc:597] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.415779 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.416379 14501 raft_consensus.cc:2243] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.416899 14501 raft_consensus.cc:2272] T cbecd21568da4cba91bf43b4ce59a28c P 1d804ce9949645b19a0ccc1faf258ec7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.426991 21071 consensus_peers.cc:597] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.433044 21145 consensus_peers.cc:597] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.438329 21145 consensus_peers.cc:597] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.446007 21145 consensus_peers.cc:597] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.448730 21145 consensus_peers.cc:597] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.463295 21145 consensus_peers.cc:597] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.477264 21219 consensus_peers.cc:597] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.501991 14501 tablet_server.cc:196] TabletServer@127.14.41.65:43285 shutdown complete.
W20260709 13:20:18.535311 21219 consensus_peers.cc:597] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.546656 21145 consensus_peers.cc:597] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.559628 21145 consensus_peers.cc:597] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.573609 21071 consensus_peers.cc:597] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.587474 21219 consensus_peers.cc:597] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.603277 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
W20260709 13:20:18.604259 21145 consensus_peers.cc:597] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.643731 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:20:18.644109 21145 consensus_peers.cc:597] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.644781 14501 tablet_replica.cc:333] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.646034 14501 raft_consensus.cc:2243] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.646585 14501 raft_consensus.cc:2272] T 08de2d3846974898b85e48b736d45cd0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.648784 14501 tablet_replica.cc:333] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.649394 14501 raft_consensus.cc:2243] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.650219 14501 raft_consensus.cc:2272] T bf91f39c6153492a8fd05d9918062caa P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.653080 14501 tablet_replica.cc:333] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.654003 14501 raft_consensus.cc:2243] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.654531 14501 raft_consensus.cc:2272] T 65a4c18f2b744dccb42a3da937d648f6 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.655323 21071 consensus_peers.cc:597] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.656859 14501 tablet_replica.cc:333] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.657768 14501 raft_consensus.cc:2243] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.658640 14501 raft_consensus.cc:2272] T 2ebfe18bcecc49198cbf0d3721f65dc7 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.661342 14501 tablet_replica.cc:333] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.662103 14501 raft_consensus.cc:2243] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.662631 14501 raft_consensus.cc:2272] T 10ac20c373724f3baf9ca9b75bc62765 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.665668 14501 tablet_replica.cc:333] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.666524 14501 raft_consensus.cc:2243] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.667076 14501 raft_consensus.cc:2272] T 1c02b59a16cf441888ce492581a48536 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.670318 21145 consensus_peers.cc:597] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Couldn't send request to peer 1d804ce9949645b19a0ccc1faf258ec7. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.670544 14501 tablet_replica.cc:333] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.671535 14501 raft_consensus.cc:2243] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.672070 14501 raft_consensus.cc:2272] T 8802f602125f45849d52951cb35a2e51 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.673636 21219 consensus_peers.cc:597] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.674367 14501 tablet_replica.cc:333] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.675138 14501 raft_consensus.cc:2243] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.675575 14501 raft_consensus.cc:2272] T c9ec9a5e146a4779afbe72eb46e5c0c8 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.677649 14501 tablet_replica.cc:333] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.678249 14501 raft_consensus.cc:2243] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.678663 14501 raft_consensus.cc:2272] T a2fc8ae4e5ba4be69acf20c7759745ec P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.681348 14501 tablet_replica.cc:333] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.682314 14501 raft_consensus.cc:2243] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.683270 14501 raft_consensus.cc:2272] T 4e82b5b2abd94e6587289f0201891e8b P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.685557 14501 tablet_replica.cc:333] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.686190 14501 raft_consensus.cc:2243] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.687122 14501 raft_consensus.cc:2272] T d06f1aafd4c14193b9c2e305a7b38209 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.689987 14501 tablet_replica.cc:333] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
W20260709 13:20:18.690773 21145 consensus_peers.cc:597] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.690794 14501 raft_consensus.cc:2243] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.691535 14501 raft_consensus.cc:2272] T 62cd665cde99440fbd2d8bbd52fbadec P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.694464 14501 tablet_replica.cc:333] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.695205 14501 raft_consensus.cc:2243] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.695788 14501 raft_consensus.cc:2272] T c0670515d5ba47de932640b46e77d7f3 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.698638 14501 tablet_replica.cc:333] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.699558 14501 raft_consensus.cc:2243] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.700245 14501 raft_consensus.cc:2272] T 06e0d65d4b8e468085b0a5a2d280c36c P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.704099 14501 tablet_replica.cc:333] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.705036 14501 raft_consensus.cc:2243] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:18.705075 21219 consensus_peers.cc:597] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.706225 14501 raft_consensus.cc:2272] T b5ea23e9d27e4929a6b8615fc593610e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.709156 14501 tablet_replica.cc:333] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.710029 14501 raft_consensus.cc:2243] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.710654 14501 raft_consensus.cc:2272] T 8297f1726bad4a5dba767dc9d850ccb8 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.713649 14501 tablet_replica.cc:333] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.714443 14501 raft_consensus.cc:2243] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.715337 14501 raft_consensus.cc:2272] T 9f647f71210440f2b1c7811406423646 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.717509 14501 tablet_replica.cc:333] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.718075 14501 raft_consensus.cc:2243] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.718935 14501 raft_consensus.cc:2272] T 3f74fadf9cfd46a09de882208a769f0f P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.720901 14501 tablet_replica.cc:333] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.721457 14501 raft_consensus.cc:2243] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.721897 14501 raft_consensus.cc:2272] T ed16ebc062ff4ee69c7071f6af842713 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.724026 14501 tablet_replica.cc:333] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.724558 14501 raft_consensus.cc:2243] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.725533 14501 raft_consensus.cc:2272] T 90ab82e70de84e30bf72e4383c4309b0 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.728564 14501 tablet_replica.cc:333] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.729391 14501 raft_consensus.cc:2243] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.729873 14501 raft_consensus.cc:2272] T b1d5cd05e2f349d8b1916f974171fb46 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.732697 14501 tablet_replica.cc:333] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.733628 14501 raft_consensus.cc:2243] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.734665 14501 raft_consensus.cc:2272] T 157364afaee148b998ca48df7e81225e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.737605 14501 tablet_replica.cc:333] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
W20260709 13:20:18.738289 21219 consensus_peers.cc:597] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.738363 14501 raft_consensus.cc:2243] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.739130 14501 raft_consensus.cc:2272] T ae9de470b5d74977809dc2668fa67ae3 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.741463 14501 tablet_replica.cc:333] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.742225 14501 raft_consensus.cc:2243] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.743278 14501 raft_consensus.cc:2272] T a01bd1c7e8e34a2cb7235e985339f475 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.745921 14501 tablet_replica.cc:333] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.746667 14501 raft_consensus.cc:2243] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.747193 14501 raft_consensus.cc:2272] T 3848031ef4394b0bbc4d53d2fc9546d2 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.749884 14501 tablet_replica.cc:333] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.750557 14501 raft_consensus.cc:2243] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.751133 14501 raft_consensus.cc:2272] T 115f88285bc14a5b8057a3aa7e8f3d49 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.753751 14501 tablet_replica.cc:333] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.754528 14501 raft_consensus.cc:2243] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.755097 14501 raft_consensus.cc:2272] T c297a12f6a8d4cebb87de531c02e7944 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.758278 14501 tablet_replica.cc:333] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.759135 14501 raft_consensus.cc:2243] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.759737 14501 raft_consensus.cc:2272] T 8805cdcd3cb148acb1654e722cf4a577 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.762425 14501 tablet_replica.cc:333] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.763001 14501 raft_consensus.cc:2243] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.763419 14501 raft_consensus.cc:2272] T 38983c417740476390f693a1ab05eb8a P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.765450 14501 tablet_replica.cc:333] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.765965 14501 raft_consensus.cc:2243] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.766358 14501 raft_consensus.cc:2272] T c7a6eec3bdec4955bc56e41974349edd P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.768465 14501 tablet_replica.cc:333] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.769204 14501 raft_consensus.cc:2243] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.769719 14501 raft_consensus.cc:2272] T 0f17fd17b854429c8d54b89098c0498e P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.771587 21219 consensus_peers.cc:597] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.772686 14501 tablet_replica.cc:333] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.773294 14501 raft_consensus.cc:2243] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.773716 14501 raft_consensus.cc:2272] T e227c9264c424ae89443b124431f4bc4 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.775653 14501 tablet_replica.cc:333] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.776140 14501 raft_consensus.cc:2243] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.776526 14501 raft_consensus.cc:2272] T 13fea0e467074bd185a6c07450057598 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.778569 14501 tablet_replica.cc:333] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.779145 14501 raft_consensus.cc:2243] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.779604 14501 raft_consensus.cc:2272] T b77f26debe334a758ab2ca9c17429fb6 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.781575 14501 tablet_replica.cc:333] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.782155 14501 raft_consensus.cc:2243] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.782548 14501 raft_consensus.cc:2272] T c088f6c59e3d40e28bfb3005f3fe8930 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.784708 14501 tablet_replica.cc:333] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.785218 14501 raft_consensus.cc:2243] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.785619 14501 raft_consensus.cc:2272] T 3547414adb8447f6989687a1f99ce241 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.787567 14501 tablet_replica.cc:333] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.788053 14501 raft_consensus.cc:2243] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.788839 14501 raft_consensus.cc:2272] T b1f8bda438ea43dfa50e131788b83ebd P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.790832 14501 tablet_replica.cc:333] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.791452 14501 raft_consensus.cc:2243] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.792189 14501 raft_consensus.cc:2272] T 35366fd4bf3b40269b10dbf95981ec98 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.794201 14501 tablet_replica.cc:333] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.794701 14501 raft_consensus.cc:2243] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.795161 14501 raft_consensus.cc:2272] T 18db2aafa5c048e98de27e15a5df6e61 P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.798020 14501 tablet_replica.cc:333] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.798576 14501 raft_consensus.cc:2243] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.799127 14501 raft_consensus.cc:2272] T cbecd21568da4cba91bf43b4ce59a28c P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.799952 21219 consensus_peers.cc:597] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.801618 14501 tablet_replica.cc:333] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.802170 14501 raft_consensus.cc:2243] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.802899 14501 raft_consensus.cc:2272] T d8db1e0ee06248228c09ec09a8ec2374 P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.804955 14501 tablet_replica.cc:333] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.805413 14501 raft_consensus.cc:2243] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.806147 14501 raft_consensus.cc:2272] T c1cf371fb66e4871bfbcf50de978af7d P e8ce20857fa342c1b4cfc322565e1648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.808137 14501 tablet_replica.cc:333] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.808553 14501 raft_consensus.cc:2243] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.809322 14501 raft_consensus.cc:2272] T 428efef8d3454b9f894a316ef6c5576a P e8ce20857fa342c1b4cfc322565e1648 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.811262 14501 tablet_replica.cc:333] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648: stopping tablet replica
I20260709 13:20:18.811698 14501 raft_consensus.cc:2243] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.812093 14501 raft_consensus.cc:2272] T 9289ff54958748809113e69d968d9332 P e8ce20857fa342c1b4cfc322565e1648 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.827577 21145 consensus_peers.cc:597] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.833698 21145 consensus_peers.cc:597] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.837827 21219 consensus_peers.cc:597] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.839582 21219 consensus_peers.cc:597] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.851907 21145 consensus_peers.cc:597] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.890479 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
W20260709 13:20:18.890559 21219 consensus_peers.cc:597] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.922849 21145 consensus_peers.cc:597] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.932263 21145 consensus_peers.cc:597] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.975033 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
I20260709 13:20:19.036373 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:19.037402 14501 tablet_replica.cc:333] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
W20260709 13:20:19.034905 21219 consensus_peers.cc:597] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.038388 14501 raft_consensus.cc:2243] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.040067 14501 raft_consensus.cc:2272] T 65a4c18f2b744dccb42a3da937d648f6 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.042810 14501 tablet_replica.cc:333] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.043697 14501 raft_consensus.cc:2243] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:19.043885 21217 consensus_peers.cc:597] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.044250 14501 raft_consensus.cc:2272] T 9dc5ba4c765c48d49d6e392427a3303d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.046836 14501 tablet_replica.cc:333] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.047453 14501 raft_consensus.cc:2243] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.047931 14501 raft_consensus.cc:2272] T 428efef8d3454b9f894a316ef6c5576a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.049908 14501 tablet_replica.cc:333] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.050498 14501 raft_consensus.cc:2243] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.050921 14501 raft_consensus.cc:2272] T 8802f602125f45849d52951cb35a2e51 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.053334 14501 tablet_replica.cc:333] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.053908 14501 raft_consensus.cc:2243] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.054950 14501 raft_consensus.cc:2272] T c9ec9a5e146a4779afbe72eb46e5c0c8 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.057986 14501 tablet_replica.cc:333] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.058815 14501 raft_consensus.cc:2243] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.059705 14501 raft_consensus.cc:2272] T c0670515d5ba47de932640b46e77d7f3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.059708 21219 consensus_peers.cc:597] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.062072 21145 consensus_peers.cc:597] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.063028 14501 tablet_replica.cc:333] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.063745 14501 raft_consensus.cc:2243] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.064257 14501 raft_consensus.cc:2272] T d06f1aafd4c14193b9c2e305a7b38209 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.066843 14501 tablet_replica.cc:333] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.067613 14501 raft_consensus.cc:2243] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.068130 14501 raft_consensus.cc:2272] T a2fc8ae4e5ba4be69acf20c7759745ec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.070904 14501 tablet_replica.cc:333] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.071643 14501 raft_consensus.cc:2243] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.072099 14501 raft_consensus.cc:2272] T 7d7eae6372364e919b8c6f1a4d358a77 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.074030 14501 tablet_replica.cc:333] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.074597 14501 raft_consensus.cc:2243] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.075423 14501 raft_consensus.cc:2272] T 69c0be6c701f4fae9083797282669fe3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.077504 14501 tablet_replica.cc:333] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.078074 14501 raft_consensus.cc:2243] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.078528 14501 raft_consensus.cc:2272] T 4e82b5b2abd94e6587289f0201891e8b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.080477 14501 tablet_replica.cc:333] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.081091 14501 raft_consensus.cc:2243] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.081548 14501 raft_consensus.cc:2272] T 230befbac66a43a5aad30976385b0944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.083601 14501 tablet_replica.cc:333] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.084190 14501 raft_consensus.cc:2243] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.084636 14501 raft_consensus.cc:2272] T f389bd24ad6943419686b3110e876624 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.086517 14501 tablet_replica.cc:333] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.087083 14501 raft_consensus.cc:2243] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.087845 14501 raft_consensus.cc:2272] T 62cd665cde99440fbd2d8bbd52fbadec P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.090144 14501 tablet_replica.cc:333] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.090719 14501 raft_consensus.cc:2243] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.091179 14501 raft_consensus.cc:2272] T 06e0d65d4b8e468085b0a5a2d280c36c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.093452 14501 tablet_replica.cc:333] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.094030 14501 raft_consensus.cc:2243] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.094584 14501 raft_consensus.cc:2272] T 3f74fadf9cfd46a09de882208a769f0f P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.097167 14501 tablet_replica.cc:333] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.097836 14501 raft_consensus.cc:2243] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.098747 14501 raft_consensus.cc:2272] T 07889753a7dd4a42b31d46ef6a693f98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.099076 21219 consensus_peers.cc:597] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.101365 14501 tablet_replica.cc:333] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
W20260709 13:20:19.101853 21217 consensus_peers.cc:597] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.102260 14501 raft_consensus.cc:2243] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.103088 14501 raft_consensus.cc:2272] T ed16ebc062ff4ee69c7071f6af842713 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.105145 14501 tablet_replica.cc:333] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.105654 14501 raft_consensus.cc:2243] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.106108 14501 raft_consensus.cc:2272] T b1d5cd05e2f349d8b1916f974171fb46 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.108083 14501 tablet_replica.cc:333] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.108737 14501 raft_consensus.cc:2243] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.109220 14501 raft_consensus.cc:2272] T c297a12f6a8d4cebb87de531c02e7944 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.111382 14501 tablet_replica.cc:333] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.111928 14501 raft_consensus.cc:2243] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.112439 14501 raft_consensus.cc:2272] T e227c9264c424ae89443b124431f4bc4 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.115182 14501 tablet_replica.cc:333] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.115947 14501 raft_consensus.cc:2243] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.116534 14501 raft_consensus.cc:2272] T 0f17fd17b854429c8d54b89098c0498e P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.118366 21219 consensus_peers.cc:597] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Couldn't send request to peer e8ce20857fa342c1b4cfc322565e1648. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.119575 14501 tablet_replica.cc:333] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.120404 14501 raft_consensus.cc:2243] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.121026 14501 raft_consensus.cc:2272] T c7a6eec3bdec4955bc56e41974349edd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.123382 21217 consensus_peers.cc:597] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.123816 14501 tablet_replica.cc:333] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.124481 14501 raft_consensus.cc:2243] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.124963 14501 raft_consensus.cc:2272] T 13fea0e467074bd185a6c07450057598 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.128001 14501 tablet_replica.cc:333] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.128970 14501 raft_consensus.cc:2243] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.130615 14501 raft_consensus.cc:2272] T 18c983bfb97d4996978143ed268649ca P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.133670 14501 tablet_replica.cc:333] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.134522 14501 raft_consensus.cc:2243] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.135200 14501 raft_consensus.cc:2272] T 28ebc67ba1384341b5cbd68f36a5d420 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.134881 21217 consensus_peers.cc:597] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.137727 14501 tablet_replica.cc:333] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.138376 14501 raft_consensus.cc:2243] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.138834 14501 raft_consensus.cc:2272] T 38983c417740476390f693a1ab05eb8a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.140923 14501 tablet_replica.cc:333] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.141506 14501 raft_consensus.cc:2243] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.141999 14501 raft_consensus.cc:2272] T 3848031ef4394b0bbc4d53d2fc9546d2 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.144631 14501 tablet_replica.cc:333] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.145447 14501 raft_consensus.cc:2243] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.146101 14501 raft_consensus.cc:2272] T 115f88285bc14a5b8057a3aa7e8f3d49 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.148424 14501 tablet_replica.cc:333] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.149060 14501 raft_consensus.cc:2243] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.149855 14501 raft_consensus.cc:2272] T 317b739931ab4905ba1a212e8abe5207 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.151867 14501 tablet_replica.cc:333] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.152458 14501 raft_consensus.cc:2243] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.153033 14501 raft_consensus.cc:2272] T bf91f39c6153492a8fd05d9918062caa P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.155102 14501 tablet_replica.cc:333] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.155642 14501 raft_consensus.cc:2243] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.156425 14501 raft_consensus.cc:2272] T 95a91f1d3cda4e78b61f1817a855f249 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.158452 14501 tablet_replica.cc:333] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.159049 14501 raft_consensus.cc:2243] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.159876 14501 raft_consensus.cc:2272] T fd01db0747d94dc08454b218e6dca7be P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.162521 14501 tablet_replica.cc:333] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.163303 14501 raft_consensus.cc:2243] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.164387 14501 raft_consensus.cc:2272] T 3547414adb8447f6989687a1f99ce241 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.167348 14501 tablet_replica.cc:333] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.168210 14501 raft_consensus.cc:2243] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.168891 14501 raft_consensus.cc:2272] T 10ac20c373724f3baf9ca9b75bc62765 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.171950 14501 tablet_replica.cc:333] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.172731 14501 raft_consensus.cc:2243] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.173730 14501 raft_consensus.cc:2272] T 20e2322c978e431ab9ce24d58bf8177a P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.175983 14501 tablet_replica.cc:333] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.176555 14501 raft_consensus.cc:2243] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.177048 14501 raft_consensus.cc:2272] T c1cf371fb66e4871bfbcf50de978af7d P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.179174 14501 tablet_replica.cc:333] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.179876 14501 raft_consensus.cc:2243] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.180421 14501 raft_consensus.cc:2272] T f72d9426efb8467e9ff58df645ea8f6c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.183034 14501 tablet_replica.cc:333] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.183552 14501 raft_consensus.cc:2243] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.184300 14501 raft_consensus.cc:2272] T cbecd21568da4cba91bf43b4ce59a28c P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.186507 14501 tablet_replica.cc:333] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.187026 14501 raft_consensus.cc:2243] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.187482 14501 raft_consensus.cc:2272] T 35366fd4bf3b40269b10dbf95981ec98 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.189455 14501 tablet_replica.cc:333] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.189977 14501 raft_consensus.cc:2243] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.190770 14501 raft_consensus.cc:2272] T ae9de470b5d74977809dc2668fa67ae3 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.192787 14501 tablet_replica.cc:333] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.193250 14501 raft_consensus.cc:2243] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.193962 14501 raft_consensus.cc:2272] T d033c5d43dee4eaca81ac47cdb061f0b P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.195921 14501 tablet_replica.cc:333] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.196552 14501 raft_consensus.cc:2243] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.197142 14501 raft_consensus.cc:2272] T f0e039db49ff4c319e42dc1783ed2045 P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.199519 14501 tablet_replica.cc:333] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8: stopping tablet replica
I20260709 13:20:19.200131 14501 raft_consensus.cc:2243] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.200680 14501 raft_consensus.cc:2272] T b1f8bda438ea43dfa50e131788b83ebd P 9bc329a3e3d74a618ce2b4749aaafec8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.200996 21217 consensus_peers.cc:597] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.234901 21217 consensus_peers.cc:597] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.256422 21217 consensus_peers.cc:597] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.257738 21217 consensus_peers.cc:597] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.275874 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:20:19.341487 14501 tablet_server.cc:179] TabletServer@127.14.41.68:0 shutting down...
W20260709 13:20:19.361510 21217 consensus_peers.cc:597] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:34045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.379050 22171 raft_consensus.cc:493] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:19.379739 22171 raft_consensus.cc:515] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:19.381310 22198 raft_consensus.cc:493] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:19.381944 22198 raft_consensus.cc:515] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:19.382507 22171 leader_election.cc:290] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:19.384255 22198 leader_election.cc:290] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:19.389829 22198 raft_consensus.cc:493] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:19.390542 22198 raft_consensus.cc:515] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bc329a3e3d74a618ce2b4749aaafec8" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 34045 } } peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } }
I20260709 13:20:19.393989 22198 leader_election.cc:290] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045), 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285)
I20260709 13:20:19.396405 22203 raft_consensus.cc:493] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:19.396935 22203 raft_consensus.cc:515] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:19.399250 22203 leader_election.cc:290] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:19.399401 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:19.400669 14501 tablet_replica.cc:333] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.401806 14501 raft_consensus.cc:2243] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.402374 14501 raft_consensus.cc:2272] T 08de2d3846974898b85e48b736d45cd0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.404786 14501 tablet_replica.cc:333] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.405563 14501 raft_consensus.cc:2243] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.406196 14501 raft_consensus.cc:2272] T 2ebfe18bcecc49198cbf0d3721f65dc7 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.407440 21219 leader_election.cc:336] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
I20260709 13:20:19.408434 14501 tablet_replica.cc:333] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
W20260709 13:20:19.408844 21217 leader_election.cc:336] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Network error: Client connection negotiation failed: client connection to 127.14.41.67:34045: connect: Connection refused (error 111)
W20260709 13:20:19.409125 21219 leader_election.cc:336] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
I20260709 13:20:19.409412 14501 raft_consensus.cc:2243] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.409637 21217 leader_election.cc:304] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
W20260709 13:20:19.410590 21217 leader_election.cc:336] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Network error: Client connection negotiation failed: client connection to 127.14.41.67:34045: connect: Connection refused (error 111)
I20260709 13:20:19.410902 21217 leader_election.cc:304] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:20:19.411460 22202 raft_consensus.cc:2749] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:19.412186 22202 raft_consensus.cc:2749] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:19.412974 14501 raft_consensus.cc:2272] T 8802f602125f45849d52951cb35a2e51 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.414090 21219 leader_election.cc:336] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
W20260709 13:20:19.414633 21219 leader_election.cc:336] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
W20260709 13:20:19.415215 21219 leader_election.cc:336] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111)
I20260709 13:20:19.415570 21219 leader_election.cc:304] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:19.415851 14501 tablet_replica.cc:333] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.416738 14501 raft_consensus.cc:2243] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.416810 22202 raft_consensus.cc:2749] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:19.417294 14501 raft_consensus.cc:2272] T d06f1aafd4c14193b9c2e305a7b38209 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.419008 21217 leader_election.cc:336] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Network error: Client connection negotiation failed: client connection to 127.14.41.67:34045: connect: Connection refused (error 111)
I20260709 13:20:19.419512 21217 leader_election.cc:304] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, 9bc329a3e3d74a618ce2b4749aaafec8
I20260709 13:20:19.420018 22202 raft_consensus.cc:493] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1d804ce9949645b19a0ccc1faf258ec7)
I20260709 13:20:19.420303 14501 tablet_replica.cc:333] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.420439 22161 raft_consensus.cc:2749] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:19.420753 21217 consensus_peers.cc:597] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:34045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.421204 21217 consensus_peers.cc:597] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:34045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.421414 14501 raft_consensus.cc:2243] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.421479 22202 raft_consensus.cc:515] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb61bea9b7d4c7dabace3a6c04d1cf2" member_type: VOTER last_known_addr { host: "127.14.41.68" port: 37887 } } peers { permanent_uuid: "1d804ce9949645b19a0ccc1faf258ec7" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 43285 } } peers { permanent_uuid: "e8ce20857fa342c1b4cfc322565e1648" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 43093 } }
I20260709 13:20:19.422062 14501 raft_consensus.cc:2272] T b5ea23e9d27e4929a6b8615fc593610e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.423532 21217 consensus_peers.cc:597] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 -> Peer 9bc329a3e3d74a618ce2b4749aaafec8 (127.14.41.67:34045): Couldn't send request to peer 9bc329a3e3d74a618ce2b4749aaafec8. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.67:34045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.423703 22202 leader_election.cc:290] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285), e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093)
I20260709 13:20:19.424731 14501 tablet_replica.cc:333] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.425634 14501 raft_consensus.cc:2243] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.426180 14501 raft_consensus.cc:2272] T 8297f1726bad4a5dba767dc9d850ccb8 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.428660 21219 leader_election.cc:336] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1d804ce9949645b19a0ccc1faf258ec7 (127.14.41.65:43285): Network error: Client connection negotiation failed: client connection to 127.14.41.65:43285: connect: Connection refused (error 111)
I20260709 13:20:19.428988 14501 tablet_replica.cc:333] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
W20260709 13:20:19.429430 21219 leader_election.cc:336] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8ce20857fa342c1b4cfc322565e1648 (127.14.41.66:43093): Network error: Client connection negotiation failed: client connection to 127.14.41.66:43093: connect: Connection refused (error 111)
I20260709 13:20:19.429791 21219 leader_election.cc:304] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb61bea9b7d4c7dabace3a6c04d1cf2; no voters: 1d804ce9949645b19a0ccc1faf258ec7, e8ce20857fa342c1b4cfc322565e1648
I20260709 13:20:19.429927 14501 raft_consensus.cc:2243] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.430472 22202 raft_consensus.cc:2749] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:19.430500 14501 raft_consensus.cc:2272] T f389bd24ad6943419686b3110e876624 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.432827 14501 tablet_replica.cc:333] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.433440 14501 raft_consensus.cc:2243] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.434231 14501 raft_consensus.cc:2272] T a2fc8ae4e5ba4be69acf20c7759745ec P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.436115 14501 tablet_replica.cc:333] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.436771 14501 raft_consensus.cc:2243] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.437551 14501 raft_consensus.cc:2272] T 7d7eae6372364e919b8c6f1a4d358a77 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.439532 14501 tablet_replica.cc:333] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.440114 14501 raft_consensus.cc:2243] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.440553 14501 raft_consensus.cc:2272] T 69c0be6c701f4fae9083797282669fe3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.442684 14501 tablet_replica.cc:333] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.443223 14501 raft_consensus.cc:2243] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.443630 14501 raft_consensus.cc:2272] T 230befbac66a43a5aad30976385b0944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.445710 14501 tablet_replica.cc:333] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.446245 14501 raft_consensus.cc:2243] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.446677 14501 raft_consensus.cc:2272] T c0670515d5ba47de932640b46e77d7f3 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.448510 14501 tablet_replica.cc:333] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.449167 14501 raft_consensus.cc:2243] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.449618 14501 raft_consensus.cc:2272] T 07889753a7dd4a42b31d46ef6a693f98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.452080 14501 tablet_replica.cc:333] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.452726 14501 raft_consensus.cc:2243] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.453527 14501 raft_consensus.cc:2272] T 06e0d65d4b8e468085b0a5a2d280c36c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.455387 14501 tablet_replica.cc:333] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.455910 14501 raft_consensus.cc:2243] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.456305 14501 raft_consensus.cc:2272] T 9dc5ba4c765c48d49d6e392427a3303d P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.458225 14501 tablet_replica.cc:333] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.458750 14501 raft_consensus.cc:2243] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.459136 14501 raft_consensus.cc:2272] T 9f647f71210440f2b1c7811406423646 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.461066 14501 tablet_replica.cc:333] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.461592 14501 raft_consensus.cc:2243] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.461978 14501 raft_consensus.cc:2272] T ed16ebc062ff4ee69c7071f6af842713 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.463799 14501 tablet_replica.cc:333] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.464280 14501 raft_consensus.cc:2243] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.465022 14501 raft_consensus.cc:2272] T 18db2aafa5c048e98de27e15a5df6e61 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.466827 14501 tablet_replica.cc:333] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.467319 14501 raft_consensus.cc:2243] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.467706 14501 raft_consensus.cc:2272] T 90ab82e70de84e30bf72e4383c4309b0 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.469558 14501 tablet_replica.cc:333] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.470042 14501 raft_consensus.cc:2243] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.470738 14501 raft_consensus.cc:2272] T b1d5cd05e2f349d8b1916f974171fb46 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.472851 14501 tablet_replica.cc:333] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.473541 14501 raft_consensus.cc:2243] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.474498 14501 raft_consensus.cc:2272] T 10ac20c373724f3baf9ca9b75bc62765 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.476711 14501 tablet_replica.cc:333] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.477284 14501 raft_consensus.cc:2243] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.477726 14501 raft_consensus.cc:2272] T 20e2322c978e431ab9ce24d58bf8177a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.479542 14501 tablet_replica.cc:333] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.480150 14501 raft_consensus.cc:2243] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.480671 14501 raft_consensus.cc:2272] T 8805cdcd3cb148acb1654e722cf4a577 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.482960 14501 tablet_replica.cc:333] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.483489 14501 raft_consensus.cc:2243] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.484230 14501 raft_consensus.cc:2272] T 38983c417740476390f693a1ab05eb8a P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.486300 14501 tablet_replica.cc:333] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.487071 14501 raft_consensus.cc:2243] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.487804 14501 raft_consensus.cc:2272] T c297a12f6a8d4cebb87de531c02e7944 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.489806 14501 tablet_replica.cc:333] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.490437 14501 raft_consensus.cc:2243] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.491046 14501 raft_consensus.cc:2272] T 157364afaee148b998ca48df7e81225e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.493827 14501 tablet_replica.cc:333] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.494570 14501 raft_consensus.cc:2243] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.494961 14501 raft_consensus.cc:2272] T d033c5d43dee4eaca81ac47cdb061f0b P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.497152 14501 tablet_replica.cc:333] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.497635 14501 raft_consensus.cc:2243] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.497983 14501 raft_consensus.cc:2272] T a01bd1c7e8e34a2cb7235e985339f475 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.500135 14501 tablet_replica.cc:333] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.500665 14501 raft_consensus.cc:2243] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.501345 14501 raft_consensus.cc:2272] T c088f6c59e3d40e28bfb3005f3fe8930 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.503278 14501 tablet_replica.cc:333] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.504107 14501 raft_consensus.cc:2243] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.505292 14501 raft_consensus.cc:2272] T 18c983bfb97d4996978143ed268649ca P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.507871 14501 tablet_replica.cc:333] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.508672 14501 raft_consensus.cc:2243] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.509683 14501 raft_consensus.cc:2272] T e227c9264c424ae89443b124431f4bc4 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.511726 14501 tablet_replica.cc:333] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.512212 14501 raft_consensus.cc:2243] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.513006 14501 raft_consensus.cc:2272] T 0f17fd17b854429c8d54b89098c0498e P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.514966 14501 tablet_replica.cc:333] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.515496 14501 raft_consensus.cc:2243] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.515872 14501 raft_consensus.cc:2272] T 1c02b59a16cf441888ce492581a48536 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.517750 14501 tablet_replica.cc:333] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.518272 14501 raft_consensus.cc:2243] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.518690 14501 raft_consensus.cc:2272] T f72d9426efb8467e9ff58df645ea8f6c P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.520566 14501 tablet_replica.cc:333] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.521130 14501 raft_consensus.cc:2243] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.521500 14501 raft_consensus.cc:2272] T 317b739931ab4905ba1a212e8abe5207 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.523314 14501 tablet_replica.cc:333] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.523818 14501 raft_consensus.cc:2243] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.524171 14501 raft_consensus.cc:2272] T 95a91f1d3cda4e78b61f1817a855f249 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.526049 14501 tablet_replica.cc:333] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.526528 14501 raft_consensus.cc:2243] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.526903 14501 raft_consensus.cc:2272] T fd01db0747d94dc08454b218e6dca7be P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.528834 14501 tablet_replica.cc:333] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.529336 14501 raft_consensus.cc:2243] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.529719 14501 raft_consensus.cc:2272] T b1f8bda438ea43dfa50e131788b83ebd P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.531478 14501 tablet_replica.cc:333] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.531934 14501 raft_consensus.cc:2243] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.532383 14501 raft_consensus.cc:2272] T 35366fd4bf3b40269b10dbf95981ec98 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.534255 14501 tablet_replica.cc:333] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.534752 14501 raft_consensus.cc:2243] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.535178 14501 raft_consensus.cc:2272] T b77f26debe334a758ab2ca9c17429fb6 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.537120 14501 tablet_replica.cc:333] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.537741 14501 raft_consensus.cc:2243] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.538187 14501 raft_consensus.cc:2272] T d8db1e0ee06248228c09ec09a8ec2374 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.540091 14501 tablet_replica.cc:333] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.540680 14501 raft_consensus.cc:2243] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.541121 14501 raft_consensus.cc:2272] T 28ebc67ba1384341b5cbd68f36a5d420 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.543005 14501 tablet_replica.cc:333] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.543480 14501 raft_consensus.cc:2243] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.544265 14501 raft_consensus.cc:2272] T 9289ff54958748809113e69d968d9332 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.546397 14501 tablet_replica.cc:333] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2: stopping tablet replica
I20260709 13:20:19.546885 14501 raft_consensus.cc:2243] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.547639 14501 raft_consensus.cc:2272] T f0e039db49ff4c319e42dc1783ed2045 P 4bb61bea9b7d4c7dabace3a6c04d1cf2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.613005 14501 tablet_server.cc:196] TabletServer@127.14.41.68:0 shutdown complete.
I20260709 13:20:19.674907 14501 master.cc:562] Master@127.14.41.126:36967 shutting down...
I20260709 13:20:19.702010 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.702693 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.703248 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P 019711ec89b74c388bd03d0a1214e1f9: stopping tablet replica
I20260709 13:20:19.726004 14501 master.cc:584] Master@127.14.41.126:36967 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32847 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:20:19.815939 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:39315
I20260709 13:20:19.817376 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:19.823395 22204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:19.823522 22205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:19.824393 22207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:19.824857 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:19.825968 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:19.826143 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:19.826261 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603219826250 us; error 0 us; skew 500 ppm
I20260709 13:20:19.826759 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:19.829212 14501 webserver.cc:533] Webserver started at http://127.14.41.126:35445/ using document root <none> and password file <none>
I20260709 13:20:19.829663 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:19.829821 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:19.830047 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:19.831117 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "3434f15e5f3a4d32a50c2d4e3ba53031"
format_stamp: "Formatted at 2026-07-09 13:20:19 on dist-test-slave-56lb"
I20260709 13:20:19.835711 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:19.839171 22212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:19.840050 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:19.840371 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "3434f15e5f3a4d32a50c2d4e3ba53031"
format_stamp: "Formatted at 2026-07-09 13:20:19 on dist-test-slave-56lb"
I20260709 13:20:19.840931 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:19.857625 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:19.858906 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:19.898674 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:39315
I20260709 13:20:19.898777 22263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:39315 every 8 connection(s)
I20260709 13:20:19.902640 22264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:19.913443 22264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031: Bootstrap starting.
I20260709 13:20:19.918159 22264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:19.922557 22264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031: No bootstrap required, opened a new log
I20260709 13:20:19.924823 22264 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" member_type: VOTER }
I20260709 13:20:19.925235 22264 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:19.925413 22264 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3434f15e5f3a4d32a50c2d4e3ba53031, State: Initialized, Role: FOLLOWER
I20260709 13:20:19.926050 22264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" member_type: VOTER }
I20260709 13:20:19.926483 22264 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:19.926671 22264 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:19.926883 22264 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:19.931710 22264 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" member_type: VOTER }
I20260709 13:20:19.932228 22264 leader_election.cc:304] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3434f15e5f3a4d32a50c2d4e3ba53031; no voters: 
I20260709 13:20:19.933462 22264 leader_election.cc:290] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:19.933909 22267 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:19.935379 22267 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 1 LEADER]: Becoming Leader. State: Replica: 3434f15e5f3a4d32a50c2d4e3ba53031, State: Running, Role: LEADER
I20260709 13:20:19.936115 22267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" member_type: VOTER }
I20260709 13:20:19.936801 22264 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:19.941089 22269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3434f15e5f3a4d32a50c2d4e3ba53031. Latest consensus state: current_term: 1 leader_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" member_type: VOTER } }
I20260709 13:20:19.941156 22268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3434f15e5f3a4d32a50c2d4e3ba53031" member_type: VOTER } }
I20260709 13:20:19.942061 22269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:19.942481 22268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:19.950289 22273 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:19.958251 22273 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:19.959388 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:19.967422 22273 catalog_manager.cc:1383] Generated new cluster ID: 7b48e477887543359eca180c18a4e8e2
I20260709 13:20:19.967788 22273 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:19.991472 22273 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:19.992911 22273 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:20.007105 22273 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031: Generated new TSK 0
I20260709 13:20:20.007854 22273 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:20.026544 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.033124 22285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.034010 22286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.036692 14501 server_base.cc:1061] running on GCE node
W20260709 13:20:20.037137 22288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.038101 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.038466 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.038648 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603220038631 us; error 0 us; skew 500 ppm
I20260709 13:20:20.039340 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.041911 14501 webserver.cc:533] Webserver started at http://127.14.41.65:38729/ using document root <none> and password file <none>
I20260709 13:20:20.042495 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.042696 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.042989 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.044121 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "da8eff0e85fb434cad91af8490a6a46b"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-56lb"
I20260709 13:20:20.048987 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:20:20.053243 22293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.054327 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:20:20.054723 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "da8eff0e85fb434cad91af8490a6a46b"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-56lb"
I20260709 13:20:20.055027 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.072178 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.074293 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.076401 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.080413 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.080711 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:20.081171 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.081450 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.144164 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:36681
I20260709 13:20:20.144212 22355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:36681 every 8 connection(s)
I20260709 13:20:20.150964 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.159758 22360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.163985 22361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.166430 22363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.166702 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:20.168419 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.168735 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.168715 22356 heartbeater.cc:344] Connected to a master server at 127.14.41.126:39315
I20260709 13:20:20.169212 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603220169169 us; error 0 us; skew 500 ppm
I20260709 13:20:20.169416 22356 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.169872 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.170295 22356 heartbeater.cc:507] Master 127.14.41.126:39315 requested a full tablet report, sending...
I20260709 13:20:20.172688 14501 webserver.cc:533] Webserver started at http://127.14.41.66:46491/ using document root <none> and password file <none>
I20260709 13:20:20.173035 22229 ts_manager.cc:194] Registered new tserver with Master: da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681)
I20260709 13:20:20.173430 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.173732 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.174067 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.175596 22229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42036
I20260709 13:20:20.175647 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-56lb"
I20260709 13:20:20.181038 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:20.184412 22368 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.185456 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:20:20.185772 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-56lb"
I20260709 13:20:20.186070 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.198890 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.200153 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.201766 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.204042 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.204276 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.204540 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.204778 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:20.247014 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:37451
I20260709 13:20:20.247139 22430 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:37451 every 8 connection(s)
I20260709 13:20:20.251981 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.259299 22434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.261070 22435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.263687 22431 heartbeater.cc:344] Connected to a master server at 127.14.41.126:39315
I20260709 13:20:20.264189 22431 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.265034 22431 heartbeater.cc:507] Master 127.14.41.126:39315 requested a full tablet report, sending...
W20260709 13:20:20.265122 22437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.265480 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:20.266610 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.266889 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.267091 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603220267050 us; error 0 us; skew 500 ppm
I20260709 13:20:20.267491 22229 ts_manager.cc:194] Registered new tserver with Master: fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:20.267664 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.269508 22229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42040
I20260709 13:20:20.270581 14501 webserver.cc:533] Webserver started at http://127.14.41.67:38475/ using document root <none> and password file <none>
I20260709 13:20:20.271235 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.271436 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.271732 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.272964 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "c47f2732d2dd4be0970fd3638b63bf14"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-56lb"
I20260709 13:20:20.277451 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:20.280951 22442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.281859 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:20:20.282220 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "c47f2732d2dd4be0970fd3638b63bf14"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-56lb"
I20260709 13:20:20.282533 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.302970 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.304265 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.305830 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.308141 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.308380 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.308691 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.308873 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.352412 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:45859
I20260709 13:20:20.352536 22504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:45859 every 8 connection(s)
I20260709 13:20:20.367159 22505 heartbeater.cc:344] Connected to a master server at 127.14.41.126:39315
I20260709 13:20:20.367659 22505 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.368463 22505 heartbeater.cc:507] Master 127.14.41.126:39315 requested a full tablet report, sending...
I20260709 13:20:20.370643 22229 ts_manager.cc:194] Registered new tserver with Master: c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:20.370996 14501 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015174232s
I20260709 13:20:20.372169 22229 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42042
I20260709 13:20:20.398737 22229 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42052:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:20.401981 22229 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:20.474151 22396 tablet_service.cc:1511] Processing CreateTablet for tablet 5e451b65bbc54f34aaa29b0b9307f6a2 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:20.475718 22396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e451b65bbc54f34aaa29b0b9307f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.477726 22395 tablet_service.cc:1511] Processing CreateTablet for tablet 553c7e5dff85428d8dcd6f1288878654 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:20.479384 22395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 553c7e5dff85428d8dcd6f1288878654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.482333 22394 tablet_service.cc:1511] Processing CreateTablet for tablet 37729c984b4445d3b95335c0764a72f3 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:20.483896 22394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37729c984b4445d3b95335c0764a72f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.485788 22393 tablet_service.cc:1511] Processing CreateTablet for tablet e8eef0f92a8149e1ab8cdc32a0c10731 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:20.487321 22393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8eef0f92a8149e1ab8cdc32a0c10731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.489147 22470 tablet_service.cc:1511] Processing CreateTablet for tablet 5e451b65bbc54f34aaa29b0b9307f6a2 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:20.490679 22470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e451b65bbc54f34aaa29b0b9307f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.494292 22468 tablet_service.cc:1511] Processing CreateTablet for tablet 37729c984b4445d3b95335c0764a72f3 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:20.497071 22467 tablet_service.cc:1511] Processing CreateTablet for tablet e8eef0f92a8149e1ab8cdc32a0c10731 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:20.498175 22468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37729c984b4445d3b95335c0764a72f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.499584 22391 tablet_service.cc:1511] Processing CreateTablet for tablet 6e47f052715c41f8856366ad11e41415 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:20.499920 22321 tablet_service.cc:1511] Processing CreateTablet for tablet 5e451b65bbc54f34aaa29b0b9307f6a2 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:20.501303 22391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e47f052715c41f8856366ad11e41415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.501485 22321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e451b65bbc54f34aaa29b0b9307f6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.501870 22466 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2ce4495f0644f6b665b42155ec267b (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:20.503079 22467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8eef0f92a8149e1ab8cdc32a0c10731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.507296 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2ce4495f0644f6b665b42155ec267b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.504070 22392 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2ce4495f0644f6b665b42155ec267b (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:20.508859 22392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2ce4495f0644f6b665b42155ec267b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.510777 22320 tablet_service.cc:1511] Processing CreateTablet for tablet 553c7e5dff85428d8dcd6f1288878654 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:20.505641 22469 tablet_service.cc:1511] Processing CreateTablet for tablet 553c7e5dff85428d8dcd6f1288878654 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:20.513835 22469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 553c7e5dff85428d8dcd6f1288878654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.512452 22320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 553c7e5dff85428d8dcd6f1288878654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.515202 22319 tablet_service.cc:1511] Processing CreateTablet for tablet 37729c984b4445d3b95335c0764a72f3 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:20.517063 22319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37729c984b4445d3b95335c0764a72f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.539558 22318 tablet_service.cc:1511] Processing CreateTablet for tablet e8eef0f92a8149e1ab8cdc32a0c10731 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:20.541241 22318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8eef0f92a8149e1ab8cdc32a0c10731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.545959 22317 tablet_service.cc:1511] Processing CreateTablet for tablet 6a2ce4495f0644f6b665b42155ec267b (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:20.547511 22317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a2ce4495f0644f6b665b42155ec267b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.549863 22316 tablet_service.cc:1511] Processing CreateTablet for tablet 6e47f052715c41f8856366ad11e41415 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:20.551344 22316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e47f052715c41f8856366ad11e41415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.578291 22465 tablet_service.cc:1511] Processing CreateTablet for tablet 6e47f052715c41f8856366ad11e41415 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:20.580502 22465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e47f052715c41f8856366ad11e41415. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.598065 22315 tablet_service.cc:1511] Processing CreateTablet for tablet dd6da956d72042c683b48eddfc178e54 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:20.600308 22315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6da956d72042c683b48eddfc178e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.600490 22394 tablet_service.cc:1511] Processing CreateTablet for tablet dd6da956d72042c683b48eddfc178e54 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:20.602582 22394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6da956d72042c683b48eddfc178e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.615252 22464 tablet_service.cc:1511] Processing CreateTablet for tablet dd6da956d72042c683b48eddfc178e54 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:20.619252 22314 tablet_service.cc:1511] Processing CreateTablet for tablet d1eacdc3dc484f6eb8a3331e815a234f (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:20.620854 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd6da956d72042c683b48eddfc178e54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.622663 22313 tablet_service.cc:1511] Processing CreateTablet for tablet be1f9319550a4d60bd962dbf56a63495 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:20.620888 22314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1eacdc3dc484f6eb8a3331e815a234f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.626727 22390 tablet_service.cc:1511] Processing CreateTablet for tablet d1eacdc3dc484f6eb8a3331e815a234f (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:20.628141 22390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1eacdc3dc484f6eb8a3331e815a234f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.629431 22520 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:20.629973 22463 tablet_service.cc:1511] Processing CreateTablet for tablet d1eacdc3dc484f6eb8a3331e815a234f (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:20.631376 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1eacdc3dc484f6eb8a3331e815a234f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.634438 22313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1f9319550a4d60bd962dbf56a63495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.637403 22521 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:20.664563 22521 tablet_bootstrap.cc:654] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.680914 22520 tablet_bootstrap.cc:654] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.688822 22522 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:20.695240 22463 tablet_service.cc:1511] Processing CreateTablet for tablet be1f9319550a4d60bd962dbf56a63495 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:20.695588 22393 tablet_service.cc:1511] Processing CreateTablet for tablet be1f9319550a4d60bd962dbf56a63495 (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:20.696955 22463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1f9319550a4d60bd962dbf56a63495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.704857 22395 tablet_service.cc:1511] Processing CreateTablet for tablet 681d9e12166944c08655e82914ad008e (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:20.711072 22466 tablet_service.cc:1511] Processing CreateTablet for tablet 681d9e12166944c08655e82914ad008e (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:20.712972 22466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681d9e12166944c08655e82914ad008e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.714934 22320 tablet_service.cc:1511] Processing CreateTablet for tablet 681d9e12166944c08655e82914ad008e (DEFAULT_TABLE table=test-workload [id=0c5010309a92432a8fc35e0f9dac0b7d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:20.716174 22320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681d9e12166944c08655e82914ad008e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.723977 22393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1f9319550a4d60bd962dbf56a63495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.734455 22522 tablet_bootstrap.cc:654] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.736475 22395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 681d9e12166944c08655e82914ad008e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.741747 22521 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:20.742465 22521 ts_tablet_manager.cc:1403] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.105s	user 0.016s	sys 0.048s
I20260709 13:20:20.745517 22521 raft_consensus.cc:359] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.746250 22521 raft_consensus.cc:385] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.746549 22521 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.747406 22521 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.751989 22520 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:20.754518 22520 ts_tablet_manager.cc:1403] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.000s
I20260709 13:20:20.759546 22520 raft_consensus.cc:359] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.760629 22520 raft_consensus.cc:385] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.761029 22520 raft_consensus.cc:740] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.762488 22520 consensus_queue.cc:260] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.766834 22521 ts_tablet_manager.cc:1434] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 13:20:20.768088 22356 heartbeater.cc:499] Master 127.14.41.126:39315 was elected leader, sending a full tablet report...
I20260709 13:20:20.768522 22521 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:20.769309 22522 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:20.770066 22522 ts_tablet_manager.cc:1403] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.000s
I20260709 13:20:20.774470 22522 raft_consensus.cc:359] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.775588 22522 raft_consensus.cc:385] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.776006 22522 raft_consensus.cc:740] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.776170 22521 tablet_bootstrap.cc:654] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.777967 22522 consensus_queue.cc:260] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.778632 22520 ts_tablet_manager.cc:1434] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.013s
I20260709 13:20:20.779541 22431 heartbeater.cc:499] Master 127.14.41.126:39315 was elected leader, sending a full tablet report...
I20260709 13:20:20.783129 22522 ts_tablet_manager.cc:1434] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:20:20.784030 22505 heartbeater.cc:499] Master 127.14.41.126:39315 was elected leader, sending a full tablet report...
I20260709 13:20:20.789613 22522 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:20.793056 22520 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:20.798280 22522 tablet_bootstrap.cc:654] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.800016 22521 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:20.800798 22521 ts_tablet_manager.cc:1403] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 13:20:20.800869 22520 tablet_bootstrap.cc:654] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.804356 22521 raft_consensus.cc:359] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.805377 22521 raft_consensus.cc:385] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.805742 22521 raft_consensus.cc:740] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.806578 22521 consensus_queue.cc:260] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.808911 22521 ts_tablet_manager.cc:1434] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:20.810058 22521 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:20.810357 22522 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:20.810958 22522 ts_tablet_manager.cc:1403] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:20:20.811889 22520 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:20.812448 22520 ts_tablet_manager.cc:1403] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.011s
I20260709 13:20:20.814054 22522 raft_consensus.cc:359] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.814854 22522 raft_consensus.cc:385] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.815155 22522 raft_consensus.cc:740] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.815483 22520 raft_consensus.cc:359] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.816398 22520 raft_consensus.cc:385] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.816108 22522 consensus_queue.cc:260] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.816747 22520 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.817543 22521 tablet_bootstrap.cc:654] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.818773 22522 ts_tablet_manager.cc:1434] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:20.819826 22522 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:20.826469 22522 tablet_bootstrap.cc:654] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.817698 22520 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.829560 22520 ts_tablet_manager.cc:1434] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:20:20.832952 22520 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:20.834578 22521 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:20.835273 22521 ts_tablet_manager.cc:1403] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.013s
I20260709 13:20:20.838418 22521 raft_consensus.cc:359] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.839227 22521 raft_consensus.cc:385] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.839597 22521 raft_consensus.cc:740] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.840518 22521 consensus_queue.cc:260] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.843382 22521 ts_tablet_manager.cc:1434] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:20.844614 22521 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:20.848098 22525 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.848706 22525 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.852805 22525 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:20.853018 22520 tablet_bootstrap.cc:654] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:20.857272 22506 tablet.cc:2406] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:20.857223 22521 tablet_bootstrap.cc:654] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.861052 22522 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:20.861781 22522 ts_tablet_manager.cc:1403] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.009s
I20260709 13:20:20.867918 22522 raft_consensus.cc:359] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:20.868749 22522 raft_consensus.cc:385] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.869179 22522 raft_consensus.cc:740] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.870414 22522 consensus_queue.cc:260] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:20.873677 22521 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:20.874368 22521 ts_tablet_manager.cc:1403] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.002s
I20260709 13:20:20.877363 22521 raft_consensus.cc:359] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.878100 22522 ts_tablet_manager.cc:1434] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:20:20.878141 22521 raft_consensus.cc:385] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.878954 22521 raft_consensus.cc:740] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.879942 22522 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:20.879767 22521 consensus_queue.cc:260] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.885111 22521 ts_tablet_manager.cc:1434] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:20:20.886299 22521 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:20.886723 22520 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:20.887328 22520 ts_tablet_manager.cc:1403] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.055s	user 0.022s	sys 0.001s
I20260709 13:20:20.891063 22520 raft_consensus.cc:359] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.891896 22520 raft_consensus.cc:385] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.892278 22520 raft_consensus.cc:740] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.893600 22521 tablet_bootstrap.cc:654] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.893263 22520 consensus_queue.cc:260] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.900022 22522 tablet_bootstrap.cc:654] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.901993 22520 ts_tablet_manager.cc:1434] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:20:20.903185 22520 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:20.904935 22527 raft_consensus.cc:493] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.905635 22527 raft_consensus.cc:515] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.910799 22527 leader_election.cc:290] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:20.911330 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:20.912372 22406 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:20.933988 22294 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:20.935039 22525 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:20.935477 22525 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.935837 22525 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.936450 22520 tablet_bootstrap.cc:654] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.944190 22522 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:20.944886 22522 ts_tablet_manager.cc:1403] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.036s
I20260709 13:20:20.944908 22525 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.948176 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:20.948879 22406 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.948412 22522 raft_consensus.cc:359] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.949462 22522 raft_consensus.cc:385] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:20:20.951879 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:20.949803 22522 raft_consensus.cc:740] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.954193 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:20.953249 22522 consensus_queue.cc:260] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.956528 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
W20260709 13:20:20.957077 22294 leader_election.cc:343] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:20.959296 22294 leader_election.cc:343] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:20.961432 22406 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:20.962491 22522 ts_tablet_manager.cc:1434] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:20:20.962268 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553c7e5dff85428d8dcd6f1288878654" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:20.962697 22294 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:20.963274 22331 raft_consensus.cc:2468] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 0.
I20260709 13:20:20.966943 22521 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:20.967541 22521 ts_tablet_manager.cc:1403] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.032s
I20260709 13:20:20.968582 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553c7e5dff85428d8dcd6f1288878654" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:20.969625 22371 leader_election.cc:304] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:20.963689 22522 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:20.969694 22479 raft_consensus.cc:2468] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 0.
I20260709 13:20:20.971119 22527 raft_consensus.cc:2804] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:20.971194 22544 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:20.971547 22527 raft_consensus.cc:493] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:20.971977 22527 raft_consensus.cc:3060] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.972565 22521 raft_consensus.cc:359] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.958463 22525 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Requested vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:20.974934 22521 raft_consensus.cc:385] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.975644 22521 raft_consensus.cc:740] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.976464 22521 consensus_queue.cc:260] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.980971 22527 raft_consensus.cc:515] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.983623 22522 tablet_bootstrap.cc:654] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.984279 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553c7e5dff85428d8dcd6f1288878654" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:20.982523 22544 raft_consensus.cc:697] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Becoming Leader. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Running, Role: LEADER
I20260709 13:20:20.984978 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "553c7e5dff85428d8dcd6f1288878654" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:20.985868 22479 raft_consensus.cc:3060] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.986141 22544 consensus_queue.cc:237] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.984987 22331 raft_consensus.cc:3060] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.988291 22521 ts_tablet_manager.cc:1434] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 13:20:20.989517 22521 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:20.993371 22527 leader_election.cc:290] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:20.996009 22520 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:20.995850 22479 raft_consensus.cc:2468] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
I20260709 13:20:20.996356 22521 tablet_bootstrap.cc:654] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.996780 22520 ts_tablet_manager.cc:1403] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.015s
I20260709 13:20:20.997848 22546 raft_consensus.cc:493] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:20.997782 22369 leader_election.cc:304] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:20.998636 22546 raft_consensus.cc:515] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:20.999025 22527 raft_consensus.cc:2804] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.001107 22546 leader_election.cc:290] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.002637 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.001143 22331 raft_consensus.cc:2468] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
W20260709 13:20:21.005183 22294 leader_election.cc:343] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.006343 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
W20260709 13:20:21.008441 22294 leader_election.cc:343] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.007992 22520 raft_consensus.cc:359] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.009619 22520 raft_consensus.cc:385] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.009544 22294 leader_election.cc:304] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b; no voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.010260 22520 raft_consensus.cc:740] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.011641 22546 raft_consensus.cc:2749] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.011369 22520 consensus_queue.cc:260] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.018059 22522 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:21.018963 22522 ts_tablet_manager.cc:1403] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.005s
I20260709 13:20:21.023355 22522 raft_consensus.cc:359] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.024684 22522 raft_consensus.cc:385] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.025522 22522 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.027176 22522 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.029640 22522 ts_tablet_manager.cc:1434] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.007s
I20260709 13:20:21.030192 22521 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:21.030740 22522 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:21.030953 22521 ts_tablet_manager.cc:1403] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.023s
I20260709 13:20:21.032939 22520 ts_tablet_manager.cc:1434] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.031s	user 0.016s	sys 0.006s
I20260709 13:20:21.034686 22520 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:21.038684 22522 tablet_bootstrap.cc:654] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.025707 22527 raft_consensus.cc:697] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:21.041450 22527 consensus_queue.cc:237] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.043838 22520 tablet_bootstrap.cc:654] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.043722 22521 raft_consensus.cc:359] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.044675 22521 raft_consensus.cc:385] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.044989 22521 raft_consensus.cc:740] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.045923 22521 consensus_queue.cc:260] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.048496 22521 ts_tablet_manager.cc:1434] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:20:21.048863 22223 catalog_manager.cc:5697] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b reported cstate change: term changed from 0 to 1, leader changed from <none> to da8eff0e85fb434cad91af8490a6a46b (127.14.41.65). New cstate: current_term: 1 leader_uuid: "da8eff0e85fb434cad91af8490a6a46b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.049800 22521 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:21.051327 22522 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:21.051947 22522 ts_tablet_manager.cc:1403] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.000s
I20260709 13:20:21.055397 22522 raft_consensus.cc:359] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.056695 22522 raft_consensus.cc:385] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.057130 22522 raft_consensus.cc:740] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.058149 22522 consensus_queue.cc:260] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.061697 22521 tablet_bootstrap.cc:654] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.065353 22522 ts_tablet_manager.cc:1434] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:20:21.066687 22522 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:21.068267 22520 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:21.068857 22520 ts_tablet_manager.cc:1403] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.000s
I20260709 13:20:21.072039 22520 raft_consensus.cc:359] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.072830 22520 raft_consensus.cc:385] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.073137 22520 raft_consensus.cc:740] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.073546 22522 tablet_bootstrap.cc:654] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.075496 22528 raft_consensus.cc:493] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.076131 22528 raft_consensus.cc:515] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.077729 22520 consensus_queue.cc:260] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.081820 22544 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.082417 22544 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.084187 22521 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:21.084568 22544 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.084897 22521 ts_tablet_manager.cc:1403] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.011s
I20260709 13:20:21.087888 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.088753 22406 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.088973 22520 ts_tablet_manager.cc:1434] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:20:21.090180 22520 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:21.090319 22294 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:21.091838 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:21.092648 22479 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.093191 22228 catalog_manager.cc:5697] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 0 to 1, leader changed from <none> to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 1 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.093894 22521 raft_consensus.cc:359] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:21.096280 22521 raft_consensus.cc:385] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.096632 22521 raft_consensus.cc:740] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.099610 22521 consensus_queue.cc:260] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:21.100773 22528 leader_election.cc:290] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:21.097548 22544 raft_consensus.cc:2804] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.102175 22544 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.096735 22520 tablet_bootstrap.cc:654] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.102789 22544 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.114203 22544 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.116173 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.117352 22544 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Requested vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
W20260709 13:20:21.118101 22445 leader_election.cc:343] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.121668 22521 ts_tablet_manager.cc:1434] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 13:20:21.122900 22521 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:21.124476 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.125231 22406 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.129505 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:21.130697 22479 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.129954 22521 tablet_bootstrap.cc:654] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.137712 22544 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.144112 22544 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.147976 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.148743 22405 raft_consensus.cc:2468] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.150274 22294 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:21.151480 22546 raft_consensus.cc:2804] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.151989 22546 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.152308 22546 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.154393 22479 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.157480 22294 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:21.158358 22544 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.158424 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.159121 22544 raft_consensus.cc:2804] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.159626 22544 raft_consensus.cc:697] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Becoming Leader. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Running, Role: LEADER
I20260709 13:20:21.159786 22520 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:21.160384 22520 ts_tablet_manager.cc:1403] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.003s
I20260709 13:20:21.160749 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:21.160535 22544 consensus_queue.cc:237] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
W20260709 13:20:21.162046 22443 leader_election.cc:343] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:21.162194 22294 leader_election.cc:343] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.162676 22443 leader_election.cc:304] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14; no voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.163566 22528 raft_consensus.cc:2749] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.163575 22520 raft_consensus.cc:359] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.164866 22520 raft_consensus.cc:385] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.165186 22520 raft_consensus.cc:740] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.166596 22520 consensus_queue.cc:260] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.167236 22522 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:21.167842 22522 ts_tablet_manager.cc:1403] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.101s	user 0.037s	sys 0.011s
I20260709 13:20:21.169039 22520 ts_tablet_manager.cc:1434] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:20:21.169785 22546 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.171084 22522 raft_consensus.cc:359] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.171891 22522 raft_consensus.cc:385] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.172197 22522 raft_consensus.cc:740] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.173974 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.174881 22405 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.175731 22528 raft_consensus.cc:493] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.176266 22528 raft_consensus.cc:515] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:21.178436 22528 leader_election.cc:290] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681)
I20260709 13:20:21.179644 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.180193 22404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.181114 22331 raft_consensus.cc:2468] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 0.
I20260709 13:20:21.180956 22522 consensus_queue.cc:260] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
W20260709 13:20:21.182413 22443 leader_election.cc:343] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.183252 22445 leader_election.cc:304] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.184536 22528 raft_consensus.cc:2804] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.184957 22528 raft_consensus.cc:493] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.185294 22528 raft_consensus.cc:3060] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.188205 22546 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Requested vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.191020 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:21.192022 22405 raft_consensus.cc:2468] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.170238 22520 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
W20260709 13:20:21.192538 22294 leader_election.cc:343] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.193415 22294 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:21.194572 22546 raft_consensus.cc:2804] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.195302 22546 raft_consensus.cc:697] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Becoming Leader. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Running, Role: LEADER
I20260709 13:20:21.196156 22546 consensus_queue.cc:237] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.167460 22406 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.198791 22528 raft_consensus.cc:515] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:21.200899 22520 tablet_bootstrap.cc:654] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.201510 22522 ts_tablet_manager.cc:1434] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:20:21.203316 22522 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:21.202215 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.206535 22521 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:21.207067 22521 ts_tablet_manager.cc:1403] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.020s
W20260709 13:20:21.207091 22443 leader_election.cc:343] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.208242 22226 catalog_manager.cc:5697] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b reported cstate change: term changed from 0 to 1, leader changed from <none> to da8eff0e85fb434cad91af8490a6a46b (127.14.41.65). New cstate: current_term: 1 leader_uuid: "da8eff0e85fb434cad91af8490a6a46b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.209950 22522 tablet_bootstrap.cc:654] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.210034 22521 raft_consensus.cc:359] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.210853 22521 raft_consensus.cc:385] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.211134 22521 raft_consensus.cc:740] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.211851 22521 consensus_queue.cc:260] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.213946 22521 ts_tablet_manager.cc:1434] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:21.214890 22521 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:21.215634 22528 leader_election.cc:290] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 election: Requested vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681)
I20260709 13:20:21.216332 22528 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.217093 22528 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.214946 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:21.218420 22331 raft_consensus.cc:3060] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.220415 22330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.223860 22528 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:21.226364 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.227427 22406 raft_consensus.cc:2393] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c47f2732d2dd4be0970fd3638b63bf14 in current term 1: Already voted for candidate da8eff0e85fb434cad91af8490a6a46b in this term.
I20260709 13:20:21.228631 22443 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14; no voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.229580 22566 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.231706 22226 catalog_manager.cc:5697] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b reported cstate change: term changed from 0 to 1, leader changed from <none> to da8eff0e85fb434cad91af8490a6a46b (127.14.41.65). New cstate: current_term: 1 leader_uuid: "da8eff0e85fb434cad91af8490a6a46b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.233759 22331 raft_consensus.cc:2468] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 1.
I20260709 13:20:21.235275 22445 leader_election.cc:304] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.236820 22528 raft_consensus.cc:2804] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.237872 22566 raft_consensus.cc:2749] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.240011 22521 tablet_bootstrap.cc:654] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.244441 22528 raft_consensus.cc:697] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:21.245584 22528 consensus_queue.cc:237] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:21.249116 22521 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:21.249684 22521 ts_tablet_manager.cc:1403] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:20:21.251742 22520 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:21.252350 22520 ts_tablet_manager.cc:1403] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.010s
I20260709 13:20:21.252458 22522 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:21.252614 22521 raft_consensus.cc:359] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.253348 22522 ts_tablet_manager.cc:1403] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.007s
I20260709 13:20:21.253589 22521 raft_consensus.cc:385] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.253944 22521 raft_consensus.cc:740] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.254886 22521 consensus_queue.cc:260] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.255446 22520 raft_consensus.cc:359] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:21.256186 22520 raft_consensus.cc:385] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.256484 22520 raft_consensus.cc:740] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.257652 22521 ts_tablet_manager.cc:1434] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:21.257575 22520 consensus_queue.cc:260] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:21.258488 22522 raft_consensus.cc:359] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.258872 22521 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:21.259235 22522 raft_consensus.cc:385] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.259550 22522 raft_consensus.cc:740] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.260210 22522 consensus_queue.cc:260] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.262100 22546 raft_consensus.cc:493] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.262311 22520 ts_tablet_manager.cc:1434] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:21.262672 22546 raft_consensus.cc:515] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.263480 22520 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:21.264855 22546 leader_election.cc:290] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.265271 22521 tablet_bootstrap.cc:654] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.266448 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.267656 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
W20260709 13:20:21.268188 22294 leader_election.cc:343] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.268491 22479 raft_consensus.cc:2468] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.277153 22294 leader_election.cc:304] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.278457 22546 raft_consensus.cc:2804] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.278810 22546 raft_consensus.cc:493] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.279110 22546 raft_consensus.cc:3060] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.282111 22520 tablet_bootstrap.cc:654] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.281395 22228 catalog_manager.cc:5697] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.284898 22527 raft_consensus.cc:493] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.285437 22527 raft_consensus.cc:515] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.286306 22546 raft_consensus.cc:515] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.288357 22527 leader_election.cc:290] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.290040 22546 leader_election.cc:290] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Requested vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.290877 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.291043 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:21.291136 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:21.291621 22479 raft_consensus.cc:3060] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.291851 22480 raft_consensus.cc:2468] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 0.
I20260709 13:20:21.292485 22527 raft_consensus.cc:493] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.291958 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.293063 22527 raft_consensus.cc:515] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
W20260709 13:20:21.294193 22294 leader_election.cc:343] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.291662 22331 raft_consensus.cc:2468] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 0.
I20260709 13:20:21.295543 22522 ts_tablet_manager.cc:1434] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:20:21.296461 22522 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:21.296332 22371 leader_election.cc:304] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:21.297542 22550 raft_consensus.cc:2804] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.298177 22550 raft_consensus.cc:493] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.298506 22550 raft_consensus.cc:3060] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.298923 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.299309 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:21.299762 22331 raft_consensus.cc:2393] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb48468d1edb4c0eb1cfc82296a4e2ff in current term 1: Already voted for candidate c47f2732d2dd4be0970fd3638b63bf14 in this term.
I20260709 13:20:21.301100 22371 leader_election.cc:304] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:21.302037 22548 raft_consensus.cc:3060] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.302999 22522 tablet_bootstrap.cc:654] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.307646 22550 raft_consensus.cc:515] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.311797 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:21.312471 22331 raft_consensus.cc:3060] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.312516 22479 raft_consensus.cc:2468] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.313493 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:21.313742 22294 leader_election.cc:304] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.315862 22546 raft_consensus.cc:2804] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.315443 22480 raft_consensus.cc:3060] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.321576 22521 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: No bootstrap required, opened a new log
I20260709 13:20:21.322321 22521 ts_tablet_manager.cc:1403] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.008s
I20260709 13:20:21.318938 22548 raft_consensus.cc:2749] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.324923 22546 raft_consensus.cc:697] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Becoming Leader. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Running, Role: LEADER
I20260709 13:20:21.326385 22546 consensus_queue.cc:237] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.326663 22521 raft_consensus.cc:359] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.317610 22527 leader_election.cc:290] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859), da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681)
I20260709 13:20:21.327404 22521 raft_consensus.cc:385] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.327780 22521 raft_consensus.cc:740] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.328642 22521 consensus_queue.cc:260] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.317454 22550 leader_election.cc:290] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.331166 22521 ts_tablet_manager.cc:1434] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:21.334077 22520 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:21.334620 22520 ts_tablet_manager.cc:1403] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.008s
I20260709 13:20:21.336934 22520 raft_consensus.cc:359] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.337630 22520 raft_consensus.cc:385] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.337930 22520 raft_consensus.cc:740] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.338922 22522 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:21.338615 22520 consensus_queue.cc:260] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.339543 22522 ts_tablet_manager.cc:1403] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.043s	user 0.027s	sys 0.009s
I20260709 13:20:21.339993 22480 raft_consensus.cc:2468] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
I20260709 13:20:21.339290 22228 catalog_manager.cc:5697] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b reported cstate change: term changed from 0 to 1, leader changed from <none> to da8eff0e85fb434cad91af8490a6a46b (127.14.41.65). New cstate: current_term: 1 leader_uuid: "da8eff0e85fb434cad91af8490a6a46b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.342146 22369 leader_election.cc:304] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:21.342680 22522 raft_consensus.cc:359] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.343286 22520 ts_tablet_manager.cc:1434] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:21.343408 22522 raft_consensus.cc:385] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.343585 22550 raft_consensus.cc:2804] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.343829 22522 raft_consensus.cc:740] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.344169 22550 raft_consensus.cc:697] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:21.344389 22520 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:21.345103 22550 consensus_queue.cc:237] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.347249 22522 consensus_queue.cc:260] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.350013 22522 ts_tablet_manager.cc:1434] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:20:21.340708 22331 raft_consensus.cc:2468] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
I20260709 13:20:21.351799 22522 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14: Bootstrap starting.
I20260709 13:20:21.353302 22520 tablet_bootstrap.cc:654] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.358079 22522 tablet_bootstrap.cc:654] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.364470 22520 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:21.364981 22520 ts_tablet_manager.cc:1403] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:20:21.367676 22520 raft_consensus.cc:359] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.368427 22520 raft_consensus.cc:385] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.368765 22520 raft_consensus.cc:740] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.369575 22520 consensus_queue.cc:260] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.372320 22520 ts_tablet_manager.cc:1434] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:21.373149 22520 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff: Bootstrap starting.
I20260709 13:20:21.377691 22520 tablet_bootstrap.cc:654] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.381803 22520 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff: No bootstrap required, opened a new log
I20260709 13:20:21.382282 22520 ts_tablet_manager.cc:1403] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:21.385138 22520 raft_consensus.cc:359] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.385876 22520 raft_consensus.cc:385] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.386212 22520 raft_consensus.cc:740] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.386868 22520 consensus_queue.cc:260] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.387192 22522 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14: No bootstrap required, opened a new log
I20260709 13:20:21.387810 22522 ts_tablet_manager.cc:1403] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.015s
I20260709 13:20:21.388763 22520 ts_tablet_manager.cc:1434] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:21.390654 22522 raft_consensus.cc:359] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.391667 22522 raft_consensus.cc:385] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.390645 22223 catalog_manager.cc:5697] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 0 to 1, leader changed from <none> to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 1 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.391955 22522 raft_consensus.cc:740] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.392721 22522 consensus_queue.cc:260] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.394754 22522 ts_tablet_manager.cc:1434] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:21.417040 22546 raft_consensus.cc:493] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.417688 22546 raft_consensus.cc:515] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.419759 22546 leader_election.cc:290] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.420466 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.421051 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:21.421286 22406 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.421839 22480 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.422480 22294 leader_election.cc:304] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:21.423353 22546 raft_consensus.cc:2804] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.423792 22546 raft_consensus.cc:493] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.424124 22546 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.429901 22546 raft_consensus.cc:515] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.432184 22546 leader_election.cc:290] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Requested vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.432544 22544 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.433005 22406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.433743 22406 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.433648 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:21.434512 22480 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.442764 22406 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.444149 22528 raft_consensus.cc:493] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.444455 22480 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.444823 22528 raft_consensus.cc:515] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.445828 22294 leader_election.cc:304] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:21.446879 22545 raft_consensus.cc:2804] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.447357 22545 raft_consensus.cc:697] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Becoming Leader. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Running, Role: LEADER
I20260709 13:20:21.447453 22528 leader_election.cc:290] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:21.448325 22545 consensus_queue.cc:237] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.451231 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681d9e12166944c08655e82914ad008e" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.452121 22331 raft_consensus.cc:2468] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 0.
I20260709 13:20:21.452571 22525 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.452946 22404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681d9e12166944c08655e82914ad008e" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.453632 22404 raft_consensus.cc:2468] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 0.
I20260709 13:20:21.455209 22443 leader_election.cc:304] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:21.456858 22528 raft_consensus.cc:2804] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.457254 22528 raft_consensus.cc:493] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.457659 22527 consensus_queue.cc:1048] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.457649 22528 raft_consensus.cc:3060] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.475324 22528 raft_consensus.cc:515] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.478976 22528 leader_election.cc:290] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:21.482097 22228 catalog_manager.cc:5697] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b reported cstate change: term changed from 0 to 1, leader changed from <none> to da8eff0e85fb434cad91af8490a6a46b (127.14.41.65). New cstate: current_term: 1 leader_uuid: "da8eff0e85fb434cad91af8490a6a46b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.484496 22329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681d9e12166944c08655e82914ad008e" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:21.485351 22329 raft_consensus.cc:3060] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.489114 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681d9e12166944c08655e82914ad008e" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.489957 22405 raft_consensus.cc:3060] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.494422 22527 consensus_queue.cc:1048] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.496675 22329 raft_consensus.cc:2468] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 1.
I20260709 13:20:21.498250 22445 leader_election.cc:304] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:21.498481 22405 raft_consensus.cc:2468] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 1.
I20260709 13:20:21.499383 22528 raft_consensus.cc:2804] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.499941 22528 raft_consensus.cc:697] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:21.501267 22528 consensus_queue.cc:237] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.517999 22545 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.518852 22545 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.521572 22545 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.522485 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.523156 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:21.523306 22405 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.523983 22479 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 0.
I20260709 13:20:21.524691 22294 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:21.525754 22545 raft_consensus.cc:2804] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.526180 22545 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.526574 22545 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.527180 22228 catalog_manager.cc:5697] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 1 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.532773 22545 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.534976 22545 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Requested vote from peers fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.535785 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.536113 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "da8eff0e85fb434cad91af8490a6a46b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:21.536541 22405 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.536844 22479 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.543011 22479 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.543231 22405 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da8eff0e85fb434cad91af8490a6a46b in term 1.
I20260709 13:20:21.544250 22294 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:21.545222 22545 raft_consensus.cc:2804] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.545707 22545 raft_consensus.cc:697] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Becoming Leader. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Running, Role: LEADER
I20260709 13:20:21.546424 22545 consensus_queue.cc:237] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.554750 22228 catalog_manager.cc:5697] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b reported cstate change: term changed from 0 to 1, leader changed from <none> to da8eff0e85fb434cad91af8490a6a46b (127.14.41.65). New cstate: current_term: 1 leader_uuid: "da8eff0e85fb434cad91af8490a6a46b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.579257 22479 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.604846 22545 consensus_queue.cc:1048] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.661154 22528 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.661898 22528 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.665467 22528 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:21.761926 22527 raft_consensus.cc:493] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.762537 22527 raft_consensus.cc:515] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.764988 22527 leader_election.cc:290] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:21.768919 22329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.769244 22331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b" is_pre_election: true
I20260709 13:20:21.773849 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:21.774636 22405 raft_consensus.cc:2468] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 1.
I20260709 13:20:21.789345 22546 consensus_queue.cc:1048] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.791476 22546 consensus_queue.cc:1048] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.792120 22443 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:21.794252 22569 raft_consensus.cc:2804] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:21.794682 22569 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.795049 22569 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:21.840154 22405 raft_consensus.cc:3060] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.852912 22548 consensus_queue.cc:1048] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.853086 22546 consensus_queue.cc:1048] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.854964 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:21.855321 22569 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.855842 22478 raft_consensus.cc:2393] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb48468d1edb4c0eb1cfc82296a4e2ff in current term 1: Already voted for candidate da8eff0e85fb434cad91af8490a6a46b in this term.
I20260709 13:20:21.855684 22525 consensus_queue.cc:1048] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.856491 22479 raft_consensus.cc:1240] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Rejecting Update request from peer da8eff0e85fb434cad91af8490a6a46b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:20:21.862845 22528 consensus_queue.cc:1048] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.866432 22544 consensus_queue.cc:1059] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.867276 22544 raft_consensus.cc:3055] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:21.867628 22544 raft_consensus.cc:740] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Running, Role: LEADER
I20260709 13:20:21.868475 22544 consensus_queue.cc:260] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:21.868750 22369 leader_election.cc:304] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:21.869678 22544 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:21.869715 22548 raft_consensus.cc:2749] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.876776 22525 consensus_queue.cc:1048] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.881244 22528 consensus_queue.cc:1048] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.892091 22569 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:21.892316 22404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:21.904417 22329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:21.907270 22329 raft_consensus.cc:2410] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c47f2732d2dd4be0970fd3638b63bf14 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:20:21.909667 22550 consensus_queue.cc:1048] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.911825 22445 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14; no voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:21.913429 22528 raft_consensus.cc:2749] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:22.074939 22294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:45859, user_credentials={real_user=slave}} blocked reactor thread for 199283us
I20260709 13:20:22.082592 22597 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.085124 22546 consensus_queue.cc:1048] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.091014 22546 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.094103 14501 ts_manager.cc:295] Set tserver state for da8eff0e85fb434cad91af8490a6a46b to MAINTENANCE_MODE
I20260709 13:20:22.095050 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
W20260709 13:20:22.151634 22445 consensus_peers.cc:597] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.160331 22371 consensus_peers.cc:597] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:22.166602 22569 consensus_queue.cc:1048] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.177284 22525 consensus_queue.cc:1048] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.231110 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:22.231978 14501 tablet_replica.cc:333] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.232904 14501 raft_consensus.cc:2243] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.233975 14501 raft_consensus.cc:2272] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.236827 14501 tablet_replica.cc:333] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.237614 14501 raft_consensus.cc:2243] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.238175 14501 raft_consensus.cc:2272] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.241102 14501 tablet_replica.cc:333] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.241770 14501 raft_consensus.cc:2243] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.242700 14501 raft_consensus.cc:2272] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.245052 14501 tablet_replica.cc:333] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.245539 14501 raft_consensus.cc:2243] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.245956 14501 raft_consensus.cc:2272] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.248118 14501 tablet_replica.cc:333] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.248700 14501 raft_consensus.cc:2243] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.249078 14501 raft_consensus.cc:2272] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.251201 14501 tablet_replica.cc:333] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.251742 14501 raft_consensus.cc:2243] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.252102 14501 raft_consensus.cc:2272] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.254158 14501 tablet_replica.cc:333] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.254643 14501 raft_consensus.cc:2243] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.255355 14501 raft_consensus.cc:2272] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.257436 14501 tablet_replica.cc:333] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.257931 14501 raft_consensus.cc:2243] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.258656 14501 raft_consensus.cc:2272] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.260875 14501 tablet_replica.cc:333] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.261339 14501 raft_consensus.cc:2243] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.261655 14501 raft_consensus.cc:2272] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.263274 14501 tablet_replica.cc:333] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: stopping tablet replica
I20260709 13:20:22.263696 14501 raft_consensus.cc:2243] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.264364 14501 raft_consensus.cc:2272] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.300782 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
W20260709 13:20:22.355415 22371 consensus_peers.cc:597] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.408106 22445 consensus_peers.cc:597] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.699776 22427 debug-util.cc:398] Leaking SignalData structure 0x7b0800042ea0 after lost signal to thread 14504
W20260709 13:20:22.700911 22427 debug-util.cc:398] Leaking SignalData structure 0x7b080027a8c0 after lost signal to thread 22263
W20260709 13:20:22.702612 22427 debug-util.cc:398] Leaking SignalData structure 0x7b08000fce60 after lost signal to thread 22430
W20260709 13:20:22.703554 22427 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8c20 after lost signal to thread 22504
W20260709 13:20:22.964227 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08002479e0 after lost signal to thread 14504
W20260709 13:20:22.965404 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08003ac980 after lost signal to thread 22263
W20260709 13:20:22.966468 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08001a1d00 after lost signal to thread 22355
W20260709 13:20:22.967404 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08001bbcc0 after lost signal to thread 22430
W20260709 13:20:22.968377 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3500 after lost signal to thread 22504
W20260709 13:20:23.213840 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:23.223834 22445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111) [suppressed 116 similar messages]
I20260709 13:20:23.362156 22527 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.362807 22527 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.365391 22527 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:23.367506 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:23.368367 22478 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
I20260709 13:20:23.370029 22528 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.370571 22528 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
W20260709 13:20:23.372090 22371 leader_election.cc:336] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.373406 22528 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:23.374882 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:23.375643 22403 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 1.
I20260709 13:20:23.377025 22369 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:23.378741 22443 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
W20260709 13:20:23.379505 22445 leader_election.cc:336] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.379994 22615 raft_consensus.cc:2804] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.380656 22527 raft_consensus.cc:2804] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.380695 22615 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.381628 22615 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.381218 22527 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.391176 22527 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.392659 22615 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.396739 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:23.397598 22615 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
W20260709 13:20:23.403126 22445 leader_election.cc:336] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.404695 22527 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.406165 22403 raft_consensus.cc:2393] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c47f2732d2dd4be0970fd3638b63bf14 in current term 2: Already voted for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in this term.
I20260709 13:20:23.409473 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:23.410444 22478 raft_consensus.cc:2393] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fb48468d1edb4c0eb1cfc82296a4e2ff in current term 2: Already voted for candidate c47f2732d2dd4be0970fd3638b63bf14 in this term.
W20260709 13:20:23.414383 22371 leader_election.cc:336] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.414901 22371 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:23.416193 22443 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14; no voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:23.417594 22615 raft_consensus.cc:2749] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:23.416218 22527 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:23.417305 22616 raft_consensus.cc:2749] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:23.422984 22616 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.423542 22616 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.428051 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:23.428947 22478 raft_consensus.cc:2393] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb48468d1edb4c0eb1cfc82296a4e2ff in current term 2: Already voted for candidate c47f2732d2dd4be0970fd3638b63bf14 in this term.
I20260709 13:20:23.430323 22616 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
W20260709 13:20:23.430850 22371 leader_election.cc:336] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.431473 22371 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:23.432300 22616 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.441115 22616 raft_consensus.cc:2749] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:23.608678 22615 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.609428 22615 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.612388 22615 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:23.613952 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
W20260709 13:20:23.617390 22445 leader_election.cc:336] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.617914 22445 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14; no voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:23.618798 22615 raft_consensus.cc:2749] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:23.622805 22615 raft_consensus.cc:493] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.623409 22615 raft_consensus.cc:515] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.627084 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:23.629069 22615 leader_election.cc:290] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
W20260709 13:20:23.631027 22445 leader_election.cc:336] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.631621 22445 leader_election.cc:304] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14; no voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:23.632508 22615 raft_consensus.cc:2749] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:23.662632 22616 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.663457 22616 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.665333 22615 raft_consensus.cc:493] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.667301 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:23.668138 22478 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
I20260709 13:20:23.670037 22369 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:23.666049 22615 raft_consensus.cc:515] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.672129 22527 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.672567 22527 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.672988 22527 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.675256 22616 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
W20260709 13:20:23.678664 22445 leader_election.cc:336] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.680970 22528 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.681610 22528 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.683990 22528 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:23.698200 22527 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
W20260709 13:20:23.705315 22371 leader_election.cc:336] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.699468 22615 leader_election.cc:290] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:23.702862 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:23.706605 22527 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:23.703898 22616 raft_consensus.cc:493] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.704319 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:23.704490 22617 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
W20260709 13:20:23.698871 22445 leader_election.cc:336] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.707456 22405 raft_consensus.cc:2468] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 1.
I20260709 13:20:23.708781 22617 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.709966 22403 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 1.
I20260709 13:20:23.711330 22617 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:23.713491 22616 raft_consensus.cc:515] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.713912 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:23.715538 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:23.716761 22478 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.716859 22479 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
I20260709 13:20:23.718382 22369 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:23.720574 22527 raft_consensus.cc:2804] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.721099 22527 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.721545 22527 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.727731 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:23.728497 22479 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 1.
I20260709 13:20:23.730002 22369 leader_election.cc:304] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:23.730258 22527 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.731040 22618 raft_consensus.cc:2804] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.731549 22618 raft_consensus.cc:493] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.731933 22618 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.733163 22527 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:23.734480 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:23.734872 22478 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:23.738454 22479 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.740325 22369 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:23.738690 22616 leader_election.cc:290] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:23.741230 22616 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.744374 22443 leader_election.cc:304] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:23.745796 22615 raft_consensus.cc:2804] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.746186 22615 raft_consensus.cc:493] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting leader election (detected failure of leader da8eff0e85fb434cad91af8490a6a46b)
I20260709 13:20:23.746560 22615 raft_consensus.cc:3060] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.750344 22479 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:23.751952 22369 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:23.753080 22617 raft_consensus.cc:2804] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.753643 22617 raft_consensus.cc:697] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:23.754609 22617 consensus_queue.cc:237] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.741796 22616 raft_consensus.cc:697] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:23.756260 22616 consensus_queue.cc:237] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.758133 22443 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:23.759152 22615 raft_consensus.cc:515] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.765741 22528 raft_consensus.cc:2764] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:20:23.768844 22615 leader_election.cc:290] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
W20260709 13:20:23.776973 22445 leader_election.cc:336] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.777274 22618 raft_consensus.cc:515] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.781450 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:23.782143 22479 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.791553 22479 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:23.793004 22369 leader_election.cc:304] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:23.794116 22617 raft_consensus.cc:2804] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.794670 22617 raft_consensus.cc:697] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:23.794914 22226 catalog_manager.cc:5697] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 1 to 2, leader changed from da8eff0e85fb434cad91af8490a6a46b (127.14.41.65) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 2 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.795626 22617 consensus_queue.cc:237] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.797441 22618 leader_election.cc:290] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
W20260709 13:20:23.802788 22371 leader_election.cc:336] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.803095 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a2ce4495f0644f6b665b42155ec267b" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
W20260709 13:20:23.803814 22371 leader_election.cc:336] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.803920 22403 raft_consensus.cc:3060] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:23.805362 22371 leader_election.cc:336] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
W20260709 13:20:23.807283 22371 leader_election.cc:336] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.815157 22403 raft_consensus.cc:2468] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 2.
W20260709 13:20:23.816358 22371 leader_election.cc:336] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:23.817945 22443 leader_election.cc:304] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:23.819326 22615 raft_consensus.cc:2804] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.819917 22615 raft_consensus.cc:697] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 2 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:23.820958 22615 consensus_queue.cc:237] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:23.845315 22223 catalog_manager.cc:5697] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 1 to 2, leader changed from da8eff0e85fb434cad91af8490a6a46b (127.14.41.65) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.856835 22226 catalog_manager.cc:5697] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 1 to 2, leader changed from da8eff0e85fb434cad91af8490a6a46b (127.14.41.65) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 2 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.858983 22226 catalog_manager.cc:5697] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 1 to 2, leader changed from da8eff0e85fb434cad91af8490a6a46b (127.14.41.65) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 2 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:24.075268 22615 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:24.075909 22615 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:24.079523 22615 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:24.080483 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:24.081583 22403 raft_consensus.cc:2410] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c47f2732d2dd4be0970fd3638b63bf14 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 13:20:24.084136 22445 leader_election.cc:336] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:24.084797 22445 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14; no voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:24.085640 22615 raft_consensus.cc:2749] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:24.194591 22371 consensus_peers.cc:597] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:24.213315 22403 raft_consensus.cc:1275] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:24.215106 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:24.215097 22615 consensus_queue.cc:1048] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:24.224584 22479 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.226547 22616 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:24.258724 22371 consensus_peers.cc:597] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:24.266506 22445 consensus_peers.cc:597] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:24.284777 22371 consensus_peers.cc:597] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:24.310882 22478 raft_consensus.cc:1275] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.314626 22527 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:24.317401 22478 raft_consensus.cc:1275] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.319208 22527 consensus_queue.cc:1048] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:24.562393 22371 consensus_peers.cc:597] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:24.610010 22445 consensus_peers.cc:597] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:24.851925 22371 consensus_peers.cc:597] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:24.901162 22445 consensus_peers.cc:597] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:25.216363 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:25.363059 22634 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.363768 22634 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:25.366245 22634 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:25.367621 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" is_pre_election: true
I20260709 13:20:25.368429 22403 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 2.
I20260709 13:20:25.370061 22443 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:25.371742 22634 raft_consensus.cc:2804] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:25.372241 22634 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.372715 22634 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:25.374958 22445 leader_election.cc:336] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:25.388365 22634 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
W20260709 13:20:25.396871 22445 leader_election.cc:336] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:25.399401 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:25.400043 22403 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:25.408715 22634 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:25.408401 22403 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 3.
I20260709 13:20:25.410678 22443 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:25.411909 22634 raft_consensus.cc:2804] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:25.412757 22634 raft_consensus.cc:697] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:25.413627 22634 consensus_queue.cc:237] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:25.426100 22226 catalog_manager.cc:5697] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 1 to 3, leader changed from da8eff0e85fb434cad91af8490a6a46b (127.14.41.65) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:25.434101 22527 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:25.434907 22527 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:25.439639 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14" is_pre_election: true
I20260709 13:20:25.440423 22480 raft_consensus.cc:2468] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:25.446622 22369 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:25.449358 22527 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:25.450083 22527 raft_consensus.cc:2804] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:25.450556 22527 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:25.450965 22527 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:25.452421 22371 leader_election.cc:336] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:25.462253 22527 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:25.465768 22527 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 3 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:25.468813 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:25.469535 22480 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:25.471728 22371 leader_election.cc:336] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111)
I20260709 13:20:25.475775 22480 raft_consensus.cc:2468] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 3.
I20260709 13:20:25.477046 22369 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: da8eff0e85fb434cad91af8490a6a46b
I20260709 13:20:25.477799 22527 raft_consensus.cc:2804] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:25.478332 22527 raft_consensus.cc:697] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:25.479178 22527 consensus_queue.cc:237] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:25.490065 22226 catalog_manager.cc:5697] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 1 to 3, leader changed from da8eff0e85fb434cad91af8490a6a46b (127.14.41.65) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 3 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:25.896018 22403 raft_consensus.cc:1275] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:20:25.896732 22445 consensus_peers.cc:597] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:25.897775 22634 consensus_queue.cc:1048] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:20:26.015494 22371 consensus_peers.cc:597] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:26.057000 22480 raft_consensus.cc:1275] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:26.058843 22640 consensus_queue.cc:1048] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:26.217723 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:26.604756 22371 consensus_peers.cc:597] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:26.621615 22371 consensus_peers.cc:597] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:26.779328 22371 consensus_peers.cc:597] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:26.954803 22445 consensus_peers.cc:597] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:27.000492 22371 consensus_peers.cc:597] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:27.034304 22445 consensus_peers.cc:597] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:27.219151 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:27.261556 22371 consensus_peers.cc:597] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:27.276930 22445 consensus_peers.cc:597] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:27.319952 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:27.328657 22649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:27.331362 22650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:27.341289 22652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:27.341349 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:27.343159 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:27.343515 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:27.343778 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603227343758 us; error 0 us; skew 500 ppm
I20260709 13:20:27.344729 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:27.348927 14501 webserver.cc:533] Webserver started at http://127.14.41.65:38729/ using document root <none> and password file <none>
I20260709 13:20:27.349759 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:27.350033 14501 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:20:27.356630 14501 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:27.361938 22657 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:27.362991 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:20:27.363417 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "da8eff0e85fb434cad91af8490a6a46b"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-56lb"
I20260709 13:20:27.364027 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:27.395226 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:27.396833 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:27.398960 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:27.404146 22664 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:20:27.474859 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:20:27.475186 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.072s	user 0.003s	sys 0.001s
I20260709 13:20:27.475558 14501 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:20:27.482064 22664 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.502126 22664 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.503162 22664 tablet_bootstrap.cc:492] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.503944 22664 ts_tablet_manager.cc:1403] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 13:20:27.507057 22664 raft_consensus.cc:359] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.508150 22664 raft_consensus.cc:740] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.509006 22664 consensus_queue.cc:260] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.512118 22664 ts_tablet_manager.cc:1434] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:27.513067 22664 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.530781 22664 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.531816 22664 tablet_bootstrap.cc:492] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.532506 22664 ts_tablet_manager.cc:1403] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:20:27.535439 22664 raft_consensus.cc:359] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.536199 22664 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.537097 22664 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.539321 22664 ts_tablet_manager.cc:1434] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:27.540199 22664 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.546998 14501 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:20:27.547432 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.072s	user 0.062s	sys 0.007s
I20260709 13:20:27.558502 22664 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.559978 22664 tablet_bootstrap.cc:492] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.560986 22664 ts_tablet_manager.cc:1403] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.004s
I20260709 13:20:27.564496 22664 raft_consensus.cc:359] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:27.565558 22664 raft_consensus.cc:740] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.566566 22664 consensus_queue.cc:260] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:27.569101 22664 ts_tablet_manager.cc:1434] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:27.570129 22664 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.588788 22664 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.589632 22664 tablet_bootstrap.cc:492] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.590188 22664 ts_tablet_manager.cc:1403] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:20:27.592429 22664 raft_consensus.cc:359] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.593015 22664 raft_consensus.cc:740] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.593683 22664 consensus_queue.cc:260] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.595242 22664 ts_tablet_manager.cc:1434] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:27.595934 22664 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.608165 22664 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.608982 22664 tablet_bootstrap.cc:492] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.609557 22664 ts_tablet_manager.cc:1403] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 13:20:27.611550 22664 raft_consensus.cc:359] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.612098 22664 raft_consensus.cc:740] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.612833 22664 consensus_queue.cc:260] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.614401 22664 ts_tablet_manager.cc:1434] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:20:27.615090 22664 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.629228 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:36681
I20260709 13:20:27.629427 22727 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:36681 every 8 connection(s)
I20260709 13:20:27.632161 22664 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.633255 22664 tablet_bootstrap.cc:492] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.634125 22664 ts_tablet_manager.cc:1403] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:20:27.634447 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:27.637899 22664 raft_consensus.cc:359] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.639137 22664 raft_consensus.cc:740] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.640235 22664 consensus_queue.cc:260] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.642406 22664 ts_tablet_manager.cc:1434] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:27.643903 22664 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.667356 22664 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.668118 22664 tablet_bootstrap.cc:492] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.668732 22664 ts_tablet_manager.cc:1403] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.025s	user 0.020s	sys 0.004s
I20260709 13:20:27.671241 22664 raft_consensus.cc:359] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.671903 22664 raft_consensus.cc:740] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.672660 22664 consensus_queue.cc:260] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.675357 22664 ts_tablet_manager.cc:1434] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:27.676299 22664 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.684800 22701 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.685998 22700 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.700415 22728 heartbeater.cc:344] Connected to a master server at 127.14.41.126:39315
I20260709 13:20:27.701004 22728 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:27.702194 22728 heartbeater.cc:507] Master 127.14.41.126:39315 requested a full tablet report, sending...
I20260709 13:20:27.703047 22664 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.703446 22403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:27.704579 22664 tablet_bootstrap.cc:492] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.704721 22403 raft_consensus.cc:606] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:27.705528 22664 ts_tablet_manager.cc:1403] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 13:20:27.708326 22664 raft_consensus.cc:359] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.709132 22664 raft_consensus.cc:740] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.709910 22664 consensus_queue.cc:260] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.711661 22403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:27.712106 22664 ts_tablet_manager.cc:1434] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:27.712373 22403 raft_consensus.cc:606] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:27.713070 22664 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.718441 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:27.719216 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:27.720046 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:27.730173 22664 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.731105 22664 tablet_bootstrap.cc:492] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.732641 22664 ts_tablet_manager.cc:1403] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:20:27.735280 22664 raft_consensus.cc:359] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.735980 22664 raft_consensus.cc:740] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.736724 22664 consensus_queue.cc:260] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.737269 22223 ts_manager.cc:194] Re-registered known tserver with Master: da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681)
I20260709 13:20:27.738947 22664 ts_tablet_manager.cc:1434] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:27.739877 22664 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap starting.
I20260709 13:20:27.749747 22223 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54772
I20260709 13:20:27.753885 22728 heartbeater.cc:499] Master 127.14.41.126:39315 was elected leader, sending a full tablet report...
I20260709 13:20:27.755846 22664 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.756870 22664 tablet_bootstrap.cc:492] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Bootstrap complete.
I20260709 13:20:27.757543 22664 ts_tablet_manager.cc:1403] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:20:27.760064 22664 raft_consensus.cc:359] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.760820 22664 raft_consensus.cc:740] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8eff0e85fb434cad91af8490a6a46b, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.761597 22664 consensus_queue.cc:260] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.764019 22664 ts_tablet_manager.cc:1434] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:27.777415 22743 raft_consensus.cc:993] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:27.778115 22646 raft_consensus.cc:1081] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:27.779954 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:27.780647 22480 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.781067 22480 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.787998 22480 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.789886 22480 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:27.790858 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:27.790974 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:27.791764 22701 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.791857 22403 raft_consensus.cc:3055] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:27.792328 22403 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:27.793248 22403 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.794618 22403 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:27.797434 22701 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 3.
I20260709 13:20:27.798810 22445 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:27.799930 22528 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:27.801204 22528 raft_consensus.cc:697] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:27.801595 22403 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 3.
I20260709 13:20:27.802286 22528 consensus_queue.cc:237] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:27.810534 22223 catalog_manager.cc:5697] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 2 to 3, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:27.983006 22701 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.049468 22701 raft_consensus.cc:3060] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.178054 22701 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.194984 22701 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.206248 22700 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:28.208002 22744 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:28.221698 22403 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:20:28.222186 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:28.223102 22528 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:28.260175 22743 raft_consensus.cc:993] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:28.260681 22646 raft_consensus.cc:1081] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:28.262230 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:28.262714 22480 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.263083 22480 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.272485 22480 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.274469 22480 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:28.275446 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:28.275590 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:28.276360 22701 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.276376 22403 raft_consensus.cc:3055] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:28.276978 22403 raft_consensus.cc:740] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:28.277982 22403 consensus_queue.cc:260] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.279471 22403 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.285015 22701 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 3.
I20260709 13:20:28.286491 22445 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:28.287309 22528 raft_consensus.cc:2804] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:28.287320 22403 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 3.
I20260709 13:20:28.288017 22528 raft_consensus.cc:697] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:28.289187 22528 consensus_queue.cc:237] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.296972 22223 catalog_manager.cc:5697] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 2 to 3, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:28.734143 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:28.750725 22480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
mode: GRACEFUL
new_leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:20:28.751361 22480 raft_consensus.cc:606] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Received request to transfer leadership to TS fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:28.754110 22480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "681d9e12166944c08655e82914ad008e"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
mode: GRACEFUL
new_leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:20:28.754783 22480 raft_consensus.cc:606] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Received request to transfer leadership to TS fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:28.757898 22403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e47f052715c41f8856366ad11e41415"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:28.758553 22403 raft_consensus.cc:606] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:28.759876 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:28.760567 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:28.761365 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:28.790525 22403 raft_consensus.cc:1275] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:28.791821 22744 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:28.806151 22528 raft_consensus.cc:993] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: : Instructing follower fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:28.807127 22528 raft_consensus.cc:1081] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Signalling peer fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:28.807531 22699 raft_consensus.cc:1275] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:28.809677 22405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:28.810370 22405 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.810175 22765 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:28.810801 22405 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:28.820184 22405 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.823130 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:28.823519 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:28.823761 22701 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:28.824237 22480 raft_consensus.cc:3055] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:28.824580 22480 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:28.825685 22405 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 4 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:28.825416 22480 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.826716 22480 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:28.830479 22701 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 4.
I20260709 13:20:28.831826 22371 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:28.832715 22646 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:28.833212 22646 raft_consensus.cc:697] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:28.834138 22480 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 4.
I20260709 13:20:28.834067 22646 consensus_queue.cc:237] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.841626 22226 catalog_manager.cc:5697] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 3 to 4, leader changed from c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 4 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:28.852862 22743 raft_consensus.cc:993] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:28.853417 22646 raft_consensus.cc:1081] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:28.855142 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e47f052715c41f8856366ad11e41415"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:28.855654 22480 raft_consensus.cc:493] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.855930 22480 raft_consensus.cc:3060] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.861356 22480 raft_consensus.cc:515] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.863130 22480 leader_election.cc:290] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:28.864130 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:28.864265 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e47f052715c41f8856366ad11e41415" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:28.864781 22701 raft_consensus.cc:3060] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.864945 22405 raft_consensus.cc:3055] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:28.865371 22405 raft_consensus.cc:740] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:28.866138 22405 consensus_queue.cc:260] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.867343 22405 raft_consensus.cc:3060] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.870451 22701 raft_consensus.cc:2468] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 2.
I20260709 13:20:28.871639 22445 leader_election.cc:304] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:28.872422 22765 raft_consensus.cc:2804] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:28.872956 22765 raft_consensus.cc:697] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:28.873066 22405 raft_consensus.cc:2468] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 2.
I20260709 13:20:28.874056 22765 consensus_queue.cc:237] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:28.881927 22226 catalog_manager.cc:5697] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 1 to 2, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:29.223171 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:29.290164 22701 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:29.291738 22646 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:29.303385 22480 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:29.305264 22776 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:29.326472 22744 raft_consensus.cc:993] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14: : Instructing follower fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:29.326977 22765 raft_consensus.cc:1081] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Signalling peer fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:29.328418 22405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "681d9e12166944c08655e82914ad008e"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:29.328995 22405 raft_consensus.cc:493] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.329339 22405 raft_consensus.cc:3060] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.334800 22405 raft_consensus.cc:515] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:29.336475 22405 leader_election.cc:290] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:29.337498 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681d9e12166944c08655e82914ad008e" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:29.337699 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "681d9e12166944c08655e82914ad008e" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:29.338225 22701 raft_consensus.cc:3060] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.338279 22480 raft_consensus.cc:3055] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:29.338737 22480 raft_consensus.cc:740] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:29.339706 22480 consensus_queue.cc:260] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:29.341136 22480 raft_consensus.cc:3060] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.346294 22701 raft_consensus.cc:2468] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:29.347783 22371 leader_election.cc:304] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:29.348017 22480 raft_consensus.cc:2468] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:29.348675 22776 raft_consensus.cc:2804] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:29.349174 22776 raft_consensus.cc:697] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:29.350066 22776 consensus_queue.cc:237] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:29.357613 22223 catalog_manager.cc:5697] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 1 to 2, leader changed from c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 2 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:29.462360 22405 raft_consensus.cc:1275] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.463779 22765 consensus_queue.cc:1048] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.475450 22701 raft_consensus.cc:1275] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.476864 22528 consensus_queue.cc:1048] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.768759 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:29.776185 22405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:29.776816 22405 raft_consensus.cc:606] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:29.779992 22405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:29.780534 22405 raft_consensus.cc:606] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:29.781675 22480 raft_consensus.cc:1275] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.783069 22776 consensus_queue.cc:1048] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.783262 22480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
mode: GRACEFUL
new_leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:20:29.783841 22480 raft_consensus.cc:606] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Received request to transfer leadership to TS fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:29.785254 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:29.785777 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:29.786515 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:29.794891 22701 raft_consensus.cc:1275] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.796629 22776 consensus_queue.cc:1048] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.856906 22646 raft_consensus.cc:993] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:29.857398 22776 raft_consensus.cc:1081] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:29.858954 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:29.859409 22480 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.859776 22480 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:29.865756 22480 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:29.867677 22480 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 5 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:29.868854 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:29.869549 22405 raft_consensus.cc:3055] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:20:29.869922 22405 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:29.869971 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:29.870658 22701 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:29.870765 22405 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:29.872053 22405 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:29.877199 22701 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 5.
I20260709 13:20:29.878075 22405 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 5.
I20260709 13:20:29.878499 22445 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:29.879614 22528 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:29.880039 22528 raft_consensus.cc:697] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:29.880720 22528 consensus_queue.cc:237] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:29.886991 22223 catalog_manager.cc:5697] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 4 to 5, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.133575 22765 raft_consensus.cc:993] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14: : Instructing follower fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:30.134063 22765 raft_consensus.cc:1081] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Signalling peer fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:30.135593 22405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:30.136070 22405 raft_consensus.cc:493] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.136355 22405 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.141379 22405 raft_consensus.cc:515] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.143107 22405 leader_election.cc:290] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 4 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:30.144156 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:30.144133 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8eef0f92a8149e1ab8cdc32a0c10731" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:30.145058 22480 raft_consensus.cc:3055] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:30.145105 22701 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.145511 22480 raft_consensus.cc:740] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:30.146358 22480 consensus_queue.cc:260] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.147660 22480 raft_consensus.cc:3060] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.152961 22701 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 4.
I20260709 13:20:30.154222 22371 leader_election.cc:304] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:30.154495 22480 raft_consensus.cc:2468] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 4.
I20260709 13:20:30.155046 22776 raft_consensus.cc:2804] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:30.155521 22776 raft_consensus.cc:697] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:30.156462 22776 consensus_queue.cc:237] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.164402 22223 catalog_manager.cc:5697] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 3 to 4, leader changed from c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 4 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:30.209002 22776 raft_consensus.cc:993] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:30.209471 22743 raft_consensus.cc:1081] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:30.210965 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:30.211380 22480 raft_consensus.cc:493] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.211702 22480 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.217072 22480 raft_consensus.cc:515] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.218511 22480 leader_election.cc:290] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 4 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:30.219314 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:30.219621 22405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd6da956d72042c683b48eddfc178e54" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:30.219873 22701 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.220242 22405 raft_consensus.cc:3055] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:30.220528 22405 raft_consensus.cc:740] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:30.221323 22405 consensus_queue.cc:260] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.222307 22405 raft_consensus.cc:3060] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:20:30.224156 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:30.225353 22701 raft_consensus.cc:2468] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 4.
I20260709 13:20:30.226428 22445 leader_election.cc:304] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:30.227129 22765 raft_consensus.cc:2804] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:30.227551 22765 raft_consensus.cc:697] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:30.227584 22405 raft_consensus.cc:2468] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 4.
I20260709 13:20:30.228518 22765 consensus_queue.cc:237] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.235711 22223 catalog_manager.cc:5697] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 3 to 4, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 4 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.385027 22405 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:30.386394 22765 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:30.397455 22699 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 5 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:30.399168 22528 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:30.579989 22701 raft_consensus.cc:1275] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:30.581359 22743 consensus_queue.cc:1048] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.590037 22480 raft_consensus.cc:1275] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:30.591925 22646 consensus_queue.cc:1048] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.799561 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.802057 22701 raft_consensus.cc:1275] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:30.803438 22528 consensus_queue.cc:1048] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.808864 22480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
mode: GRACEFUL
new_leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:20:30.809510 22480 raft_consensus.cc:606] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 LEADER]: Received request to transfer leadership to TS fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:30.813364 22480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
mode: GRACEFUL
new_leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:20:30.814038 22480 raft_consensus.cc:606] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Received request to transfer leadership to TS fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:30.816529 22403 raft_consensus.cc:1275] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:30.818346 22403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:30.818938 22403 raft_consensus.cc:606] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:30.820736 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:30.821636 22528 consensus_queue.cc:1048] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.824714 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:30.825904 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.929829 22798 raft_consensus.cc:993] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: : Instructing follower fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:30.930335 22528 raft_consensus.cc:1081] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 LEADER]: Signalling peer fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:30.931895 22403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:30.932410 22403 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.932796 22403 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:30.938621 22403 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.940438 22403 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 6 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:30.941278 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:30.941567 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:30.941866 22701 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:30.942178 22480 raft_consensus.cc:3055] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:20:30.942440 22480 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:30.943171 22480 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.944053 22480 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:20:30.946779 22701 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 6.
I20260709 13:20:30.947885 22371 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:30.948350 22480 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 6.
I20260709 13:20:30.948536 22776 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:20:30.949141 22776 raft_consensus.cc:697] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:30.949949 22776 consensus_queue.cc:237] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.956359 22223 catalog_manager.cc:5697] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 5 to 6, leader changed from c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 6 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:30.962018 22798 raft_consensus.cc:993] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14: : Instructing follower fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:30.962586 22528 raft_consensus.cc:1081] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Signalling peer fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:30.964023 22403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:30.964560 22403 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.965016 22403 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.970943 22403 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.972683 22403 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 4 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859)
I20260709 13:20:30.973434 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:30.973752 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:30.973997 22701 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.974349 22480 raft_consensus.cc:3055] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:30.974694 22480 raft_consensus.cc:740] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:30.975358 22480 consensus_queue.cc:260] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.976275 22480 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:30.979007 22701 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 4.
I20260709 13:20:30.980093 22371 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:30.980890 22776 raft_consensus.cc:2804] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:30.981001 22480 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 4.
I20260709 13:20:30.981343 22776 raft_consensus.cc:697] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:30.982235 22776 consensus_queue.cc:237] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:30.989504 22223 catalog_manager.cc:5697] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 3 to 4, leader changed from c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 4 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:31.009568 22646 raft_consensus.cc:993] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:31.011265 22646 raft_consensus.cc:1081] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:31.013008 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:31.013510 22480 raft_consensus.cc:493] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.013809 22480 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.019217 22480 raft_consensus.cc:515] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:31.020865 22480 leader_election.cc:290] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:31.021806 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:31.021900 22403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1eacdc3dc484f6eb8a3331e815a234f" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:31.022569 22701 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.022665 22403 raft_consensus.cc:3055] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:31.023082 22403 raft_consensus.cc:740] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:31.023854 22403 consensus_queue.cc:260] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:31.024914 22403 raft_consensus.cc:3060] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.027412 22701 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 3.
I20260709 13:20:31.028395 22445 leader_election.cc:304] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:31.029119 22528 raft_consensus.cc:2804] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:31.029507 22528 raft_consensus.cc:697] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:31.029955 22403 raft_consensus.cc:2468] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 3.
I20260709 13:20:31.030224 22528 consensus_queue.cc:237] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:31.037832 22223 catalog_manager.cc:5697] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 2 to 3, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 3 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:31.225315 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:31.879314 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:31.901750 22403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:31.902427 22403 raft_consensus.cc:606] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:31.908034 22478 raft_consensus.cc:1275] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:31.913187 22805 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:31.914384 22480 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 6 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:20:31.918588 22776 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:32.032495 22743 raft_consensus.cc:993] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:32.033178 22743 raft_consensus.cc:1081] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:32.053475 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:32.055060 22480 raft_consensus.cc:493] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.055856 22480 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:20:32.226624 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:32.246680 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
mode: GRACEFUL
new_leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:39796
I20260709 13:20:32.247380 22477 raft_consensus.cc:606] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Received request to transfer leadership to TS fb48468d1edb4c0eb1cfc82296a4e2ff
I20260709 13:20:32.249634 22480 raft_consensus.cc:515] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:32.251857 22480 leader_election.cc:290] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 7 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:32.253604 22403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
mode: GRACEFUL
new_leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:45740
I20260709 13:20:32.254243 22403 raft_consensus.cc:606] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Received request to transfer leadership to TS c47f2732d2dd4be0970fd3638b63bf14
I20260709 13:20:32.255520 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:32.256230 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:32.257073 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:32.258325 22701 raft_consensus.cc:1275] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:32.260231 22697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:32.262091 22697 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:32.262540 22811 consensus_queue.cc:1048] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:32.271257 22697 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 7.
I20260709 13:20:32.273036 22445 leader_election.cc:304] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:32.273912 22811 raft_consensus.cc:2804] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:20:32.274427 22811 raft_consensus.cc:697] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 7 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:32.275245 22811 consensus_queue.cc:237] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:32.287053 22698 raft_consensus.cc:1240] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 7 FOLLOWER]: Rejecting Update request from peer fb48468d1edb4c0eb1cfc82296a4e2ff for earlier term 6. Current term is 7. Ops: []
I20260709 13:20:32.289007 22406 raft_consensus.cc:1275] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:32.291013 22698 raft_consensus.cc:1275] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:32.291394 22402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37729c984b4445d3b95335c0764a72f3" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:32.292119 22402 raft_consensus.cc:3055] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:20:32.292451 22402 raft_consensus.cc:740] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:32.293304 22402 consensus_queue.cc:260] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:32.293767 22812 consensus_queue.cc:1048] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:32.293934 22805 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:32.294483 22402 raft_consensus.cc:3060] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:20:32.296365 22528 raft_consensus.cc:993] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14: : Instructing follower fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:32.296890 22528 raft_consensus.cc:1081] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Signalling peer fb48468d1edb4c0eb1cfc82296a4e2ff to start an election
I20260709 13:20:32.303026 22406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2"
dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
 from {username='slave'} at 127.0.0.1:33868
I20260709 13:20:32.303658 22406 raft_consensus.cc:493] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.304062 22406 raft_consensus.cc:3060] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:32.307893 22370 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:20:32.316519 22406 raft_consensus.cc:515] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
W20260709 13:20:32.317250 22646 consensus_queue.cc:1175] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "da8eff0e85fb434cad91af8490a6a46b" responder_term: 7 status { last_received { term: 5 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fb48468d1edb4c0eb1cfc82296a4e2ff for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:20:32.331713 22406 leader_election.cc:290] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Requested vote from peers c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67:45859), da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681)
I20260709 13:20:32.333069 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
I20260709 13:20:32.334033 22480 raft_consensus.cc:3055] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:32.334510 22480 raft_consensus.cc:740] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:32.338922 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e451b65bbc54f34aaa29b0b9307f6a2" candidate_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:32.339633 22701 raft_consensus.cc:3060] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:32.335799 22480 consensus_queue.cc:260] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
I20260709 13:20:32.340909 22480 raft_consensus.cc:3060] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:32.328150 22402 raft_consensus.cc:2468] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 7.
I20260709 13:20:32.326716 22228 catalog_manager.cc:5697] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 6 to 7, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 7 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.349020 22701 raft_consensus.cc:2468] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:32.349144 22480 raft_consensus.cc:2468] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb48468d1edb4c0eb1cfc82296a4e2ff in term 2.
I20260709 13:20:32.350485 22371 leader_election.cc:304] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: da8eff0e85fb434cad91af8490a6a46b, fb48468d1edb4c0eb1cfc82296a4e2ff; no voters: 
I20260709 13:20:32.351256 22646 raft_consensus.cc:2804] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:32.351753 22646 raft_consensus.cc:697] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Becoming Leader. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:32.352706 22646 consensus_queue.cc:237] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } }
W20260709 13:20:32.362970 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08002985e0 after lost signal to thread 14504
W20260709 13:20:32.364272 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf660 after lost signal to thread 22263
W20260709 13:20:32.365712 22260 debug-util.cc:398] Leaking SignalData structure 0x7b080015abe0 after lost signal to thread 22430
W20260709 13:20:32.366905 22260 debug-util.cc:398] Leaking SignalData structure 0x7b08002100c0 after lost signal to thread 22504
W20260709 13:20:32.368155 22260 debug-util.cc:398] Leaking SignalData structure 0x7b080017bc60 after lost signal to thread 22727
I20260709 13:20:32.373947 22226 catalog_manager.cc:5697] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff reported cstate change: term changed from 1 to 2, leader changed from c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67) to fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66). New cstate: current_term: 2 leader_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.467411 22776 raft_consensus.cc:993] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: : Instructing follower c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:32.467981 22646 raft_consensus.cc:1081] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Signalling peer c47f2732d2dd4be0970fd3638b63bf14 to start an election
I20260709 13:20:32.469712 22480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495"
dest_uuid: "c47f2732d2dd4be0970fd3638b63bf14"
 from {username='slave'} at 127.0.0.1:47676
I20260709 13:20:32.470216 22480 raft_consensus.cc:493] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.470500 22480 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:32.475872 22480 raft_consensus.cc:515] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:32.478263 22480 leader_election.cc:290] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 5 election: Requested vote from peers da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681), fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451)
I20260709 13:20:32.478623 22701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "da8eff0e85fb434cad91af8490a6a46b"
I20260709 13:20:32.478961 22404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1f9319550a4d60bd962dbf56a63495" candidate_uuid: "c47f2732d2dd4be0970fd3638b63bf14" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff"
I20260709 13:20:32.479844 22701 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:32.479980 22404 raft_consensus.cc:3055] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:20:32.480484 22404 raft_consensus.cc:740] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fb48468d1edb4c0eb1cfc82296a4e2ff, State: Running, Role: LEADER
I20260709 13:20:32.481397 22404 consensus_queue.cc:260] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:32.482455 22404 raft_consensus.cc:3060] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:32.487768 22701 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 5.
I20260709 13:20:32.489012 22404 raft_consensus.cc:2468] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47f2732d2dd4be0970fd3638b63bf14 in term 5.
I20260709 13:20:32.489248 22445 leader_election.cc:304] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c47f2732d2dd4be0970fd3638b63bf14, da8eff0e85fb434cad91af8490a6a46b; no voters: 
I20260709 13:20:32.490275 22811 raft_consensus.cc:2804] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:32.490777 22811 raft_consensus.cc:697] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 LEADER]: Becoming Leader. State: Replica: c47f2732d2dd4be0970fd3638b63bf14, State: Running, Role: LEADER
I20260709 13:20:32.491561 22811 consensus_queue.cc:237] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } }
I20260709 13:20:32.499243 22226 catalog_manager.cc:5697] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 reported cstate change: term changed from 4 to 5, leader changed from fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66) to c47f2732d2dd4be0970fd3638b63bf14 (127.14.41.67). New cstate: current_term: 5 leader_uuid: "c47f2732d2dd4be0970fd3638b63bf14" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.658545 22701 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 7 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:20:32.660022 22811 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:20:32.671329 22404 raft_consensus.cc:1275] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 7 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:20:32.672880 22806 consensus_queue.cc:1048] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:20:32.878026 22701 raft_consensus.cc:1275] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:32.879226 22646 consensus_queue.cc:1048] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:32.892318 22480 raft_consensus.cc:1275] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Refusing update from remote peer fb48468d1edb4c0eb1cfc82296a4e2ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:32.893673 22828 consensus_queue.cc:1048] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47f2732d2dd4be0970fd3638b63bf14" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 45859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:32.955708 22404 raft_consensus.cc:1275] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:32.957026 22806 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb48468d1edb4c0eb1cfc82296a4e2ff" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 37451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:32.964564 22701 raft_consensus.cc:1275] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 5 FOLLOWER]: Refusing update from remote peer c47f2732d2dd4be0970fd3638b63bf14: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:32.966157 22811 consensus_queue.cc:1048] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da8eff0e85fb434cad91af8490a6a46b" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:20:33.227924 22277 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:33.308506 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:33.337692 14501 tablet_server.cc:179] TabletServer@127.14.41.65:36681 shutting down...
W20260709 13:20:33.352526 22371 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 94 similar messages]
W20260709 13:20:33.366645 22371 consensus_peers.cc:597] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.370517 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.371469 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.372251 14501 raft_consensus.cc:2243] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.372814 14501 raft_consensus.cc:2272] T d1eacdc3dc484f6eb8a3331e815a234f P da8eff0e85fb434cad91af8490a6a46b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.375339 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.375995 14501 raft_consensus.cc:2243] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.376497 14501 raft_consensus.cc:2272] T 6a2ce4495f0644f6b665b42155ec267b P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.378520 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.379107 14501 raft_consensus.cc:2243] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.379642 14501 raft_consensus.cc:2272] T 6e47f052715c41f8856366ad11e41415 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.381660 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.382252 14501 raft_consensus.cc:2243] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.382714 14501 raft_consensus.cc:2272] T e8eef0f92a8149e1ab8cdc32a0c10731 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.384876 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.385448 14501 raft_consensus.cc:2243] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.386061 14501 raft_consensus.cc:2272] T 37729c984b4445d3b95335c0764a72f3 P da8eff0e85fb434cad91af8490a6a46b [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.389179 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.389772 14501 raft_consensus.cc:2243] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.390342 14501 raft_consensus.cc:2272] T 681d9e12166944c08655e82914ad008e P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.393064 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.393791 14501 raft_consensus.cc:2243] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.394323 14501 raft_consensus.cc:2272] T dd6da956d72042c683b48eddfc178e54 P da8eff0e85fb434cad91af8490a6a46b [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.395612 22445 consensus_peers.cc:597] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.396473 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.397125 14501 raft_consensus.cc:2243] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.397517 14501 raft_consensus.cc:2272] T 553c7e5dff85428d8dcd6f1288878654 P da8eff0e85fb434cad91af8490a6a46b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.399395 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.399915 14501 raft_consensus.cc:2243] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.400341 14501 raft_consensus.cc:2272] T 5e451b65bbc54f34aaa29b0b9307f6a2 P da8eff0e85fb434cad91af8490a6a46b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.402756 14501 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:33.403270 14501 raft_consensus.cc:2243] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.403741 14501 raft_consensus.cc:2272] T be1f9319550a4d60bd962dbf56a63495 P da8eff0e85fb434cad91af8490a6a46b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.420215 22658 connection.cc:466] server connection from 127.0.0.1:39060 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39060 (request call id 76) could send its response
W20260709 13:20:33.428380 22445 consensus_peers.cc:597] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.438812 14501 tablet_server.cc:196] TabletServer@127.14.41.65:36681 shutdown complete.
I20260709 13:20:33.459789 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
W20260709 13:20:33.484938 22443 consensus_peers.cc:597] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Couldn't send request to peer fb48468d1edb4c0eb1cfc82296a4e2ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.489897 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.490772 14501 tablet_replica.cc:333] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.491580 14501 raft_consensus.cc:2243] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.492093 14501 raft_consensus.cc:2272] T be1f9319550a4d60bd962dbf56a63495 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.495338 14501 tablet_replica.cc:333] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.496006 14501 raft_consensus.cc:2243] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.496500 14501 raft_consensus.cc:2272] T 6a2ce4495f0644f6b665b42155ec267b P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.498579 14501 tablet_replica.cc:333] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.499147 14501 raft_consensus.cc:2243] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.499576 14501 raft_consensus.cc:2272] T d1eacdc3dc484f6eb8a3331e815a234f P fb48468d1edb4c0eb1cfc82296a4e2ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.501683 14501 tablet_replica.cc:333] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.502242 14501 raft_consensus.cc:2243] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.502662 14501 raft_consensus.cc:2272] T dd6da956d72042c683b48eddfc178e54 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.505422 14501 tablet_replica.cc:333] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.506417 14501 raft_consensus.cc:2243] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.507576 14501 raft_consensus.cc:2272] T e8eef0f92a8149e1ab8cdc32a0c10731 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.510936 14501 tablet_replica.cc:333] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.511731 14501 raft_consensus.cc:2243] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.512966 14501 raft_consensus.cc:2272] T 681d9e12166944c08655e82914ad008e P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.515507 14501 tablet_replica.cc:333] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.516193 14501 raft_consensus.cc:2243] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.516842 14501 raft_consensus.cc:2272] T 37729c984b4445d3b95335c0764a72f3 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.520185 14501 tablet_replica.cc:333] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.520848 14501 raft_consensus.cc:2243] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.521296 14501 raft_consensus.cc:2272] T 6e47f052715c41f8856366ad11e41415 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.521740 22445 consensus_peers.cc:597] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.523710 14501 tablet_replica.cc:333] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.524397 14501 raft_consensus.cc:2243] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.525228 14501 raft_consensus.cc:2272] T 5e451b65bbc54f34aaa29b0b9307f6a2 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.527679 14501 tablet_replica.cc:333] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff: stopping tablet replica
I20260709 13:20:33.528256 14501 raft_consensus.cc:2243] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.529103 14501 raft_consensus.cc:2272] T 553c7e5dff85428d8dcd6f1288878654 P fb48468d1edb4c0eb1cfc82296a4e2ff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.538450 22445 consensus_peers.cc:597] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer da8eff0e85fb434cad91af8490a6a46b (127.14.41.65:36681): Couldn't send request to peer da8eff0e85fb434cad91af8490a6a46b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.581736 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
W20260709 13:20:33.586263 22443 consensus_peers.cc:597] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Couldn't send request to peer fb48468d1edb4c0eb1cfc82296a4e2ff. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:33.603557 22443 consensus_peers.cc:597] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 -> Peer fb48468d1edb4c0eb1cfc82296a4e2ff (127.14.41.66:37451): Couldn't send request to peer fb48468d1edb4c0eb1cfc82296a4e2ff. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:37451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.607323 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
I20260709 13:20:33.633872 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.634635 14501 tablet_replica.cc:333] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.635457 14501 raft_consensus.cc:2243] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.636283 14501 raft_consensus.cc:2272] T dd6da956d72042c683b48eddfc178e54 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.638530 14501 tablet_replica.cc:333] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.639117 14501 raft_consensus.cc:2243] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.639930 14501 raft_consensus.cc:2272] T 6e47f052715c41f8856366ad11e41415 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.642103 14501 tablet_replica.cc:333] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.642737 14501 raft_consensus.cc:2243] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.643570 14501 raft_consensus.cc:2272] T be1f9319550a4d60bd962dbf56a63495 P c47f2732d2dd4be0970fd3638b63bf14 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.646714 14501 tablet_replica.cc:333] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.647329 14501 raft_consensus.cc:2243] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.647784 14501 raft_consensus.cc:2272] T 681d9e12166944c08655e82914ad008e P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.650058 14501 tablet_replica.cc:333] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.650660 14501 raft_consensus.cc:2243] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.651430 14501 raft_consensus.cc:2272] T 37729c984b4445d3b95335c0764a72f3 P c47f2732d2dd4be0970fd3638b63bf14 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.654110 14501 tablet_replica.cc:333] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.654670 14501 raft_consensus.cc:2243] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.655112 14501 raft_consensus.cc:2272] T e8eef0f92a8149e1ab8cdc32a0c10731 P c47f2732d2dd4be0970fd3638b63bf14 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.657287 14501 tablet_replica.cc:333] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.657812 14501 raft_consensus.cc:2243] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.658550 14501 raft_consensus.cc:2272] T d1eacdc3dc484f6eb8a3331e815a234f P c47f2732d2dd4be0970fd3638b63bf14 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.660429 14501 tablet_replica.cc:333] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.660938 14501 raft_consensus.cc:2243] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.661688 14501 raft_consensus.cc:2272] T 6a2ce4495f0644f6b665b42155ec267b P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.663875 14501 tablet_replica.cc:333] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.664424 14501 raft_consensus.cc:2243] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.664862 14501 raft_consensus.cc:2272] T 5e451b65bbc54f34aaa29b0b9307f6a2 P c47f2732d2dd4be0970fd3638b63bf14 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.667358 14501 tablet_replica.cc:333] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14: stopping tablet replica
I20260709 13:20:33.667879 14501 raft_consensus.cc:2243] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.668292 14501 raft_consensus.cc:2272] T 553c7e5dff85428d8dcd6f1288878654 P c47f2732d2dd4be0970fd3638b63bf14 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.701529 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:20:33.724519 14501 master.cc:562] Master@127.14.41.126:39315 shutting down...
I20260709 13:20:33.748911 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.749560 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.749950 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3434f15e5f3a4d32a50c2d4e3ba53031: stopping tablet replica
I20260709 13:20:33.800194 14501 master.cc:584] Master@127.14.41.126:39315 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14031 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:20:33.847784 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:36665
I20260709 13:20:33.849116 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:33.854159 22837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.854722 22838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.856088 22840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:33.856796 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:33.857985 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:33.858179 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:33.858304 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603233858291 us; error 0 us; skew 500 ppm
I20260709 13:20:33.858820 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:33.861624 14501 webserver.cc:533] Webserver started at http://127.14.41.126:41745/ using document root <none> and password file <none>
I20260709 13:20:33.862144 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:33.862306 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:33.862562 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:33.863826 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "54c2782133144805aa0efd3401f941e7"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-56lb"
I20260709 13:20:33.868736 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:20:33.872361 22845 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.873217 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:33.873494 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "54c2782133144805aa0efd3401f941e7"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-56lb"
I20260709 13:20:33.873731 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:33.884101 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:33.885515 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:33.924840 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:36665
I20260709 13:20:33.924966 22896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:36665 every 8 connection(s)
I20260709 13:20:33.928810 22897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:33.940233 22897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7: Bootstrap starting.
I20260709 13:20:33.945000 22897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:33.949266 22897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7: No bootstrap required, opened a new log
I20260709 13:20:33.951412 22897 raft_consensus.cc:359] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54c2782133144805aa0efd3401f941e7" member_type: VOTER }
I20260709 13:20:33.951809 22897 raft_consensus.cc:385] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:33.951988 22897 raft_consensus.cc:740] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54c2782133144805aa0efd3401f941e7, State: Initialized, Role: FOLLOWER
I20260709 13:20:33.952545 22897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54c2782133144805aa0efd3401f941e7" member_type: VOTER }
I20260709 13:20:33.953013 22897 raft_consensus.cc:399] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:33.953202 22897 raft_consensus.cc:493] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:33.953419 22897 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:33.958281 22897 raft_consensus.cc:515] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54c2782133144805aa0efd3401f941e7" member_type: VOTER }
I20260709 13:20:33.958760 22897 leader_election.cc:304] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54c2782133144805aa0efd3401f941e7; no voters: 
I20260709 13:20:33.959851 22897 leader_election.cc:290] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:33.960225 22900 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:33.961731 22900 raft_consensus.cc:697] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 1 LEADER]: Becoming Leader. State: Replica: 54c2782133144805aa0efd3401f941e7, State: Running, Role: LEADER
I20260709 13:20:33.962347 22900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54c2782133144805aa0efd3401f941e7" member_type: VOTER }
I20260709 13:20:33.962891 22897 sys_catalog.cc:565] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:33.966747 22901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54c2782133144805aa0efd3401f941e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54c2782133144805aa0efd3401f941e7" member_type: VOTER } }
I20260709 13:20:33.968345 22901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:33.967665 22902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54c2782133144805aa0efd3401f941e7. Latest consensus state: current_term: 1 leader_uuid: "54c2782133144805aa0efd3401f941e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54c2782133144805aa0efd3401f941e7" member_type: VOTER } }
I20260709 13:20:33.969411 22902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:33.971138 22908 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:33.979198 22908 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:33.980262 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:33.988389 22908 catalog_manager.cc:1383] Generated new cluster ID: 078803a3ef014a6d9c895cdac0d459c8
I20260709 13:20:33.988739 22908 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:34.009752 22908 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:34.011101 22908 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:34.026016 22908 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7: Generated new TSK 0
I20260709 13:20:34.026649 22908 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:34.047775 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:34.053787 22918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:34.054948 22919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:34.056481 22921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:34.056739 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:34.057787 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:34.057977 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:34.058100 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603234058089 us; error 0 us; skew 500 ppm
I20260709 13:20:34.058561 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:34.061003 14501 webserver.cc:533] Webserver started at http://127.14.41.65:34391/ using document root <none> and password file <none>
I20260709 13:20:34.061466 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:34.061619 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:34.061841 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:34.062901 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "dc681d515e064dcfb15351d955cdd08c"
format_stamp: "Formatted at 2026-07-09 13:20:34 on dist-test-slave-56lb"
I20260709 13:20:34.067857 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:34.071657 22926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.072652 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:34.072995 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "dc681d515e064dcfb15351d955cdd08c"
format_stamp: "Formatted at 2026-07-09 13:20:34 on dist-test-slave-56lb"
I20260709 13:20:34.073256 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:34.107704 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:34.108894 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:34.110324 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:34.112620 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:34.112836 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.113099 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:34.113255 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.155148 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:38729
I20260709 13:20:34.155318 22988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:38729 every 8 connection(s)
I20260709 13:20:34.160400 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:34.167392 22993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:34.168467 22994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:34.171764 14501 server_base.cc:1061] running on GCE node
W20260709 13:20:34.172350 22996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:34.173640 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:34.173909 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:34.174072 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603234174061 us; error 0 us; skew 500 ppm
I20260709 13:20:34.174608 22989 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36665
I20260709 13:20:34.174811 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:34.175069 22989 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:34.176127 22989 heartbeater.cc:507] Master 127.14.41.126:36665 requested a full tablet report, sending...
I20260709 13:20:34.177714 14501 webserver.cc:533] Webserver started at http://127.14.41.66:42531/ using document root <none> and password file <none>
I20260709 13:20:34.178373 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:34.178586 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:34.178510 22862 ts_manager.cc:194] Registered new tserver with Master: dc681d515e064dcfb15351d955cdd08c (127.14.41.65:38729)
I20260709 13:20:34.179112 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:34.180327 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "75220bdd9251477b916b13807b9d72d9"
format_stamp: "Formatted at 2026-07-09 13:20:34 on dist-test-slave-56lb"
I20260709 13:20:34.180548 22862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36342
I20260709 13:20:34.184909 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:34.188475 23001 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.189406 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:20:34.189667 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "75220bdd9251477b916b13807b9d72d9"
format_stamp: "Formatted at 2026-07-09 13:20:34 on dist-test-slave-56lb"
I20260709 13:20:34.189895 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:34.224764 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:34.225924 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:34.227320 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:34.229696 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:34.229871 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.230181 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:34.230345 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.271548 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:42609
I20260709 13:20:34.271662 23063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:42609 every 8 connection(s)
I20260709 13:20:34.276582 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:34.283555 23067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:34.286873 23068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:34.288987 23070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:34.289539 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:34.290059 23064 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36665
I20260709 13:20:34.290556 23064 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:34.290812 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:34.291131 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:34.291335 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603234291319 us; error 0 us; skew 500 ppm
I20260709 13:20:34.291553 23064 heartbeater.cc:507] Master 127.14.41.126:36665 requested a full tablet report, sending...
I20260709 13:20:34.292161 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:34.294209 22862 ts_manager.cc:194] Registered new tserver with Master: 75220bdd9251477b916b13807b9d72d9 (127.14.41.66:42609)
I20260709 13:20:34.295248 14501 webserver.cc:533] Webserver started at http://127.14.41.67:37473/ using document root <none> and password file <none>
I20260709 13:20:34.296000 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:34.296238 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:34.296221 22862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36348
I20260709 13:20:34.296919 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:34.298470 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
format_stamp: "Formatted at 2026-07-09 13:20:34 on dist-test-slave-56lb"
I20260709 13:20:34.303474 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:34.307106 23075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.308024 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:20:34.308387 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
format_stamp: "Formatted at 2026-07-09 13:20:34 on dist-test-slave-56lb"
I20260709 13:20:34.308765 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:34.326563 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:34.327953 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:34.329556 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:34.331871 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:34.332118 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.332366 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:34.332540 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:34.375631 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:41307
I20260709 13:20:34.375801 23137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:41307 every 8 connection(s)
I20260709 13:20:34.390749 23138 heartbeater.cc:344] Connected to a master server at 127.14.41.126:36665
I20260709 13:20:34.391351 23138 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:34.392251 23138 heartbeater.cc:507] Master 127.14.41.126:36665 requested a full tablet report, sending...
I20260709 13:20:34.394474 22862 ts_manager.cc:194] Registered new tserver with Master: cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:34.394790 14501 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016091599s
I20260709 13:20:34.396423 22862 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36350
I20260709 13:20:34.422966 22862 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36366:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:34.425316 22862 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:34.473531 22954 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1d886df8a14c06b6ffb1c41d53c6bd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d20033b52b7a46b6a84e4a2cd6076109]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.475082 22954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1d886df8a14c06b6ffb1c41d53c6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.479200 22953 tablet_service.cc:1511] Processing CreateTablet for tablet dd046ea63b444ee8a070e0d47b5e45de (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d20033b52b7a46b6a84e4a2cd6076109]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.480832 22953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd046ea63b444ee8a070e0d47b5e45de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.484923 23029 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1d886df8a14c06b6ffb1c41d53c6bd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d20033b52b7a46b6a84e4a2cd6076109]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.486429 23029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1d886df8a14c06b6ffb1c41d53c6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.493949 23103 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1d886df8a14c06b6ffb1c41d53c6bd (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d20033b52b7a46b6a84e4a2cd6076109]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.494225 23102 tablet_service.cc:1511] Processing CreateTablet for tablet dd046ea63b444ee8a070e0d47b5e45de (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d20033b52b7a46b6a84e4a2cd6076109]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.495448 23103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1d886df8a14c06b6ffb1c41d53c6bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.497375 23028 tablet_service.cc:1511] Processing CreateTablet for tablet dd046ea63b444ee8a070e0d47b5e45de (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=d20033b52b7a46b6a84e4a2cd6076109]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.499251 23028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd046ea63b444ee8a070e0d47b5e45de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.501917 23102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd046ea63b444ee8a070e0d47b5e45de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.512053 23154 tablet_bootstrap.cc:492] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9: Bootstrap starting.
I20260709 13:20:34.520345 23153 tablet_bootstrap.cc:492] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: Bootstrap starting.
I20260709 13:20:34.523272 23155 tablet_bootstrap.cc:492] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2: Bootstrap starting.
I20260709 13:20:34.528627 23154 tablet_bootstrap.cc:654] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.535526 23155 tablet_bootstrap.cc:654] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.540247 23153 tablet_bootstrap.cc:654] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.543884 23154 tablet_bootstrap.cc:492] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9: No bootstrap required, opened a new log
I20260709 13:20:34.544072 23155 tablet_bootstrap.cc:492] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2: No bootstrap required, opened a new log
I20260709 13:20:34.544487 23154 ts_tablet_manager.cc:1403] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.007s
I20260709 13:20:34.544917 23155 ts_tablet_manager.cc:1403] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:20:34.547075 23153 tablet_bootstrap.cc:492] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: No bootstrap required, opened a new log
I20260709 13:20:34.547201 23154 raft_consensus.cc:359] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.547646 23153 ts_tablet_manager.cc:1403] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 13:20:34.547995 23154 raft_consensus.cc:385] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.547827 23155 raft_consensus.cc:359] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.548457 23154 raft_consensus.cc:740] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75220bdd9251477b916b13807b9d72d9, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.548713 23155 raft_consensus.cc:385] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.549088 23155 raft_consensus.cc:740] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd0ce5298ac4b72a167896f3a7d46d2, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.549319 23154 consensus_queue.cc:260] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.549839 23155 consensus_queue.cc:260] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.550818 23153 raft_consensus.cc:359] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.551954 23153 raft_consensus.cc:385] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.552377 23153 raft_consensus.cc:740] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.552464 23138 heartbeater.cc:499] Master 127.14.41.126:36665 was elected leader, sending a full tablet report...
I20260709 13:20:34.552924 23155 ts_tablet_manager.cc:1434] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:34.553776 23064 heartbeater.cc:499] Master 127.14.41.126:36665 was elected leader, sending a full tablet report...
I20260709 13:20:34.554003 23155 tablet_bootstrap.cc:492] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2: Bootstrap starting.
I20260709 13:20:34.554154 23154 ts_tablet_manager.cc:1434] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:20:34.555233 23154 tablet_bootstrap.cc:492] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9: Bootstrap starting.
I20260709 13:20:34.555409 23153 consensus_queue.cc:260] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.559021 22989 heartbeater.cc:499] Master 127.14.41.126:36665 was elected leader, sending a full tablet report...
I20260709 13:20:34.560175 23153 ts_tablet_manager.cc:1434] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:20:34.561306 23153 tablet_bootstrap.cc:492] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c: Bootstrap starting.
I20260709 13:20:34.566884 23154 tablet_bootstrap.cc:654] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.567951 23153 tablet_bootstrap.cc:654] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.573680 23159 raft_consensus.cc:493] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.574520 23159 raft_consensus.cc:515] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.576683 23154 tablet_bootstrap.cc:492] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9: No bootstrap required, opened a new log
I20260709 13:20:34.576968 23153 tablet_bootstrap.cc:492] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c: No bootstrap required, opened a new log
I20260709 13:20:34.577277 23154 ts_tablet_manager.cc:1403] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:20:34.577467 23153 ts_tablet_manager.cc:1403] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.006s
I20260709 13:20:34.581153 23155 tablet_bootstrap.cc:654] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.583359 23154 raft_consensus.cc:359] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.584297 23154 raft_consensus.cc:385] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.584652 23154 raft_consensus.cc:740] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75220bdd9251477b916b13807b9d72d9, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.585534 23154 consensus_queue.cc:260] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.586763 23159 leader_election.cc:290] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc681d515e064dcfb15351d955cdd08c (127.14.41.65:38729), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:34.587632 23153 raft_consensus.cc:359] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.588491 23153 raft_consensus.cc:385] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.588900 23153 raft_consensus.cc:740] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.589833 23153 consensus_queue.cc:260] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.593420 23153 ts_tablet_manager.cc:1434] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:20:34.595580 22964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc681d515e064dcfb15351d955cdd08c" is_pre_election: true
I20260709 13:20:34.596251 22964 raft_consensus.cc:2468] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 0.
I20260709 13:20:34.597784 23005 leader_election.cc:304] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75220bdd9251477b916b13807b9d72d9, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:34.598850 23159 raft_consensus.cc:2804] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:34.599314 23159 raft_consensus.cc:493] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.599856 23159 raft_consensus.cc:3060] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.609897 23159 raft_consensus.cc:515] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.613651 22964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc681d515e064dcfb15351d955cdd08c"
I20260709 13:20:34.614719 22964 raft_consensus.cc:3060] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.621264 23159 leader_election.cc:290] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 election: Requested vote from peers dc681d515e064dcfb15351d955cdd08c (127.14.41.65:38729), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:34.623121 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" is_pre_election: true
I20260709 13:20:34.626461 23113 raft_consensus.cc:2468] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 0.
I20260709 13:20:34.624807 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
I20260709 13:20:34.627693 23112 raft_consensus.cc:3060] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.627863 23154 ts_tablet_manager.cc:1434] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9: Time spent starting tablet: real 0.050s	user 0.013s	sys 0.025s
I20260709 13:20:34.628441 23155 tablet_bootstrap.cc:492] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2: No bootstrap required, opened a new log
I20260709 13:20:34.628980 23155 ts_tablet_manager.cc:1403] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.024s
I20260709 13:20:34.631974 23155 raft_consensus.cc:359] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.625500 22964 raft_consensus.cc:2468] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 1.
I20260709 13:20:34.632735 23155 raft_consensus.cc:385] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.633332 23155 raft_consensus.cc:740] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd0ce5298ac4b72a167896f3a7d46d2, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.633999 23005 leader_election.cc:304] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75220bdd9251477b916b13807b9d72d9, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:34.634310 23155 consensus_queue.cc:260] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.635098 23159 raft_consensus.cc:2804] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:34.635776 23112 raft_consensus.cc:2468] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 1.
I20260709 13:20:34.635792 23159 raft_consensus.cc:697] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 LEADER]: Becoming Leader. State: Replica: 75220bdd9251477b916b13807b9d72d9, State: Running, Role: LEADER
I20260709 13:20:34.637902 23155 ts_tablet_manager.cc:1434] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:20:34.637704 23159 consensus_queue.cc:237] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:34.648171 22860 catalog_manager.cc:5697] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75220bdd9251477b916b13807b9d72d9 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "75220bdd9251477b916b13807b9d72d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.826702 23159 raft_consensus.cc:493] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.827242 23159 raft_consensus.cc:515] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.829111 23159 leader_election.cc:290] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dc681d515e064dcfb15351d955cdd08c (127.14.41.65:38729), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:34.830277 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd046ea63b444ee8a070e0d47b5e45de" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" is_pre_election: true
I20260709 13:20:34.830271 22964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd046ea63b444ee8a070e0d47b5e45de" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc681d515e064dcfb15351d955cdd08c" is_pre_election: true
I20260709 13:20:34.831265 23112 raft_consensus.cc:2468] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 0.
I20260709 13:20:34.831374 22964 raft_consensus.cc:2468] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 0.
I20260709 13:20:34.832458 23003 leader_election.cc:304] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75220bdd9251477b916b13807b9d72d9, cdd0ce5298ac4b72a167896f3a7d46d2; no voters: 
I20260709 13:20:34.833240 23159 raft_consensus.cc:2804] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:34.833659 23159 raft_consensus.cc:493] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.833961 23159 raft_consensus.cc:3060] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.839088 23159 raft_consensus.cc:515] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.840929 23159 leader_election.cc:290] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 election: Requested vote from peers dc681d515e064dcfb15351d955cdd08c (127.14.41.65:38729), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:34.841835 22964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd046ea63b444ee8a070e0d47b5e45de" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc681d515e064dcfb15351d955cdd08c"
I20260709 13:20:34.842060 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd046ea63b444ee8a070e0d47b5e45de" candidate_uuid: "75220bdd9251477b916b13807b9d72d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
I20260709 13:20:34.842433 22964 raft_consensus.cc:3060] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.842722 23112 raft_consensus.cc:3060] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.847805 22964 raft_consensus.cc:2468] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 1.
I20260709 13:20:34.848003 23112 raft_consensus.cc:2468] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75220bdd9251477b916b13807b9d72d9 in term 1.
I20260709 13:20:34.849131 23005 leader_election.cc:304] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75220bdd9251477b916b13807b9d72d9, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:34.849857 23159 raft_consensus.cc:2804] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:34.850308 23159 raft_consensus.cc:697] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 1 LEADER]: Becoming Leader. State: Replica: 75220bdd9251477b916b13807b9d72d9, State: Running, Role: LEADER
I20260709 13:20:34.850972 23159 consensus_queue.cc:237] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:34.857877 22860 catalog_manager.cc:5697] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75220bdd9251477b916b13807b9d72d9 (127.14.41.66). New cstate: current_term: 1 leader_uuid: "75220bdd9251477b916b13807b9d72d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.973668 22860 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36368:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:34.975998 22860 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:35.001055 22953 tablet_service.cc:1511] Processing CreateTablet for tablet 876c58408658441fb583b2bbd69ca1a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d67524c2df04c0f8bbdd207345b4fa3]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:35.002425 22953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876c58408658441fb583b2bbd69ca1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.002290 23028 tablet_service.cc:1511] Processing CreateTablet for tablet 876c58408658441fb583b2bbd69ca1a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d67524c2df04c0f8bbdd207345b4fa3]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:35.003756 23028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876c58408658441fb583b2bbd69ca1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.004922 23102 tablet_service.cc:1511] Processing CreateTablet for tablet 876c58408658441fb583b2bbd69ca1a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d67524c2df04c0f8bbdd207345b4fa3]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:35.006311 23102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 876c58408658441fb583b2bbd69ca1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.008247 23103 tablet_service.cc:1511] Processing CreateTablet for tablet 2163fe8ba01045a688528b6a6660409b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d67524c2df04c0f8bbdd207345b4fa3]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:35.009101 23029 tablet_service.cc:1511] Processing CreateTablet for tablet 2163fe8ba01045a688528b6a6660409b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d67524c2df04c0f8bbdd207345b4fa3]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:35.009704 23103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2163fe8ba01045a688528b6a6660409b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.010673 23029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2163fe8ba01045a688528b6a6660409b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.013736 22954 tablet_service.cc:1511] Processing CreateTablet for tablet 2163fe8ba01045a688528b6a6660409b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7d67524c2df04c0f8bbdd207345b4fa3]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:35.015197 22954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2163fe8ba01045a688528b6a6660409b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.021171 23153 tablet_bootstrap.cc:492] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c: Bootstrap starting.
I20260709 13:20:35.025871 23155 tablet_bootstrap.cc:492] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: Bootstrap starting.
I20260709 13:20:35.027899 23153 tablet_bootstrap.cc:654] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:35.032323 23155 tablet_bootstrap.cc:654] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:35.032584 23159 consensus_queue.cc:1048] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:35.057938 23155 tablet_bootstrap.cc:492] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: No bootstrap required, opened a new log
I20260709 13:20:35.058674 23155 ts_tablet_manager.cc:1403] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.005s
I20260709 13:20:35.061645 23154 tablet_bootstrap.cc:492] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9: Bootstrap starting.
I20260709 13:20:35.071100 23154 tablet_bootstrap.cc:654] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:35.071447 23155 raft_consensus.cc:359] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.072468 23155 raft_consensus.cc:385] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:35.074972 23155 raft_consensus.cc:740] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd0ce5298ac4b72a167896f3a7d46d2, State: Initialized, Role: FOLLOWER
I20260709 13:20:35.076749 23159 consensus_queue.cc:1048] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:35.076989 23155 consensus_queue.cc:260] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.108222 23155 ts_tablet_manager.cc:1434] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.004s
I20260709 13:20:35.112005 23155 tablet_bootstrap.cc:492] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2: Bootstrap starting.
I20260709 13:20:35.114216 23153 tablet_bootstrap.cc:492] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c: No bootstrap required, opened a new log
I20260709 13:20:35.117956 23153 ts_tablet_manager.cc:1403] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c: Time spent bootstrapping tablet: real 0.097s	user 0.031s	sys 0.028s
I20260709 13:20:35.118242 23154 tablet_bootstrap.cc:492] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9: No bootstrap required, opened a new log
I20260709 13:20:35.119083 23154 ts_tablet_manager.cc:1403] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.025s
I20260709 13:20:35.121830 23153 raft_consensus.cc:359] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.122818 23153 raft_consensus.cc:385] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:35.123165 23153 raft_consensus.cc:740] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Initialized, Role: FOLLOWER
I20260709 13:20:35.123337 23154 raft_consensus.cc:359] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.124454 23154 raft_consensus.cc:385] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:35.124862 23154 raft_consensus.cc:740] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75220bdd9251477b916b13807b9d72d9, State: Initialized, Role: FOLLOWER
I20260709 13:20:35.126125 23154 consensus_queue.cc:260] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.128886 23154 ts_tablet_manager.cc:1434] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:20:35.130254 23154 tablet_bootstrap.cc:492] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9: Bootstrap starting.
I20260709 13:20:35.133037 23153 consensus_queue.cc:260] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.134156 23155 tablet_bootstrap.cc:654] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:35.135933 23153 ts_tablet_manager.cc:1434] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:20:35.137271 23153 tablet_bootstrap.cc:492] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c: Bootstrap starting.
I20260709 13:20:35.138546 23154 tablet_bootstrap.cc:654] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:35.149817 23153 tablet_bootstrap.cc:654] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:35.151126 23155 tablet_bootstrap.cc:492] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2: No bootstrap required, opened a new log
I20260709 13:20:35.151835 23155 ts_tablet_manager.cc:1403] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.001s
I20260709 13:20:35.155745 23155 raft_consensus.cc:359] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.156441 23155 raft_consensus.cc:385] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:35.156837 23155 raft_consensus.cc:740] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd0ce5298ac4b72a167896f3a7d46d2, State: Initialized, Role: FOLLOWER
I20260709 13:20:35.158026 23155 consensus_queue.cc:260] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.158576 23154 tablet_bootstrap.cc:492] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9: No bootstrap required, opened a new log
I20260709 13:20:35.159544 23154 ts_tablet_manager.cc:1403] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.000s
I20260709 13:20:35.162096 23153 tablet_bootstrap.cc:492] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c: No bootstrap required, opened a new log
I20260709 13:20:35.162838 23153 ts_tablet_manager.cc:1403] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:20:35.163205 23154 raft_consensus.cc:359] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.164202 23154 raft_consensus.cc:385] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:35.164726 23154 raft_consensus.cc:740] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75220bdd9251477b916b13807b9d72d9, State: Initialized, Role: FOLLOWER
I20260709 13:20:35.165807 23154 consensus_queue.cc:260] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.168815 23154 ts_tablet_manager.cc:1434] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:20:35.166862 23153 raft_consensus.cc:359] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.170428 23153 raft_consensus.cc:385] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:35.172850 23153 raft_consensus.cc:740] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Initialized, Role: FOLLOWER
I20260709 13:20:35.173560 23155 ts_tablet_manager.cc:1434] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:20:35.173787 23153 consensus_queue.cc:260] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.176975 23153 ts_tablet_manager.cc:1434] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 13:20:35.229068 23182 raft_consensus.cc:493] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.229635 23182 raft_consensus.cc:515] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.232291 23182 leader_election.cc:290] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75220bdd9251477b916b13807b9d72d9 (127.14.41.66:42609), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:35.255833 23039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2163fe8ba01045a688528b6a6660409b" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75220bdd9251477b916b13807b9d72d9" is_pre_election: true
I20260709 13:20:35.256738 23039 raft_consensus.cc:2468] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 0.
I20260709 13:20:35.257054 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2163fe8ba01045a688528b6a6660409b" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" is_pre_election: true
I20260709 13:20:35.257262 23159 consensus_queue.cc:1048] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:35.257786 23112 raft_consensus.cc:2468] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 0.
I20260709 13:20:35.258281 22927 leader_election.cc:304] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75220bdd9251477b916b13807b9d72d9, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:35.259262 23182 raft_consensus.cc:2804] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:35.259665 23182 raft_consensus.cc:493] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.259943 23182 raft_consensus.cc:3060] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:35.269389 23182 raft_consensus.cc:515] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.271584 23182 leader_election.cc:290] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 election: Requested vote from peers 75220bdd9251477b916b13807b9d72d9 (127.14.41.66:42609), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:35.271939 23166 consensus_queue.cc:1048] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:35.273502 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2163fe8ba01045a688528b6a6660409b" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
I20260709 13:20:35.274189 23112 raft_consensus.cc:3060] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:35.282212 23112 raft_consensus.cc:2468] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 1.
I20260709 13:20:35.282433 23039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2163fe8ba01045a688528b6a6660409b" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75220bdd9251477b916b13807b9d72d9"
I20260709 13:20:35.283144 23039 raft_consensus.cc:3060] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:35.283557 22928 leader_election.cc:304] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cdd0ce5298ac4b72a167896f3a7d46d2, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:35.284557 23192 raft_consensus.cc:2804] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:35.285072 23192 raft_consensus.cc:697] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 1 LEADER]: Becoming Leader. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Running, Role: LEADER
I20260709 13:20:35.285918 23192 consensus_queue.cc:237] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.293576 23039 raft_consensus.cc:2468] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 1.
I20260709 13:20:35.295288 22861 catalog_manager.cc:5697] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c reported cstate change: term changed from 0 to 1, leader changed from <none> to dc681d515e064dcfb15351d955cdd08c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "dc681d515e064dcfb15351d955cdd08c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.384203 23192 raft_consensus.cc:493] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:35.384912 23192 raft_consensus.cc:515] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.386747 23192 leader_election.cc:290] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75220bdd9251477b916b13807b9d72d9 (127.14.41.66:42609), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:35.387734 23039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75220bdd9251477b916b13807b9d72d9" is_pre_election: true
I20260709 13:20:35.387979 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" is_pre_election: true
I20260709 13:20:35.388540 23039 raft_consensus.cc:2468] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 0.
I20260709 13:20:35.388561 23113 raft_consensus.cc:2468] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 0.
I20260709 13:20:35.389874 22927 leader_election.cc:304] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75220bdd9251477b916b13807b9d72d9, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:35.390609 23192 raft_consensus.cc:2804] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:35.390998 23192 raft_consensus.cc:493] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:35.391350 23192 raft_consensus.cc:3060] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:35.397256 23192 raft_consensus.cc:515] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.398893 23192 leader_election.cc:290] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 election: Requested vote from peers 75220bdd9251477b916b13807b9d72d9 (127.14.41.66:42609), cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307)
I20260709 13:20:35.399802 23039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75220bdd9251477b916b13807b9d72d9"
I20260709 13:20:35.399971 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
I20260709 13:20:35.400339 23039 raft_consensus.cc:3060] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:35.400677 23113 raft_consensus.cc:3060] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:35.405614 23039 raft_consensus.cc:2468] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 1.
I20260709 13:20:35.405851 23113 raft_consensus.cc:2468] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 1.
I20260709 13:20:35.406889 22927 leader_election.cc:304] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75220bdd9251477b916b13807b9d72d9, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:35.407792 23192 raft_consensus.cc:2804] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:35.408139 23192 raft_consensus.cc:697] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 LEADER]: Becoming Leader. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Running, Role: LEADER
I20260709 13:20:35.408967 23192 consensus_queue.cc:237] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.416021 22861 catalog_manager.cc:5697] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c reported cstate change: term changed from 0 to 1, leader changed from <none> to dc681d515e064dcfb15351d955cdd08c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "dc681d515e064dcfb15351d955cdd08c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.464762 23039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd"
dest_uuid: "75220bdd9251477b916b13807b9d72d9"
mode: GRACEFUL
new_leader_uuid: "dc681d515e064dcfb15351d955cdd08c"
 from {username='slave'} at 127.0.0.1:44320
I20260709 13:20:35.465372 23039 raft_consensus.cc:606] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 LEADER]: Received request to transfer leadership to TS dc681d515e064dcfb15351d955cdd08c
I20260709 13:20:35.645901 23159 raft_consensus.cc:993] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9: : Instructing follower dc681d515e064dcfb15351d955cdd08c to start an election
I20260709 13:20:35.646417 23166 raft_consensus.cc:1081] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 LEADER]: Signalling peer dc681d515e064dcfb15351d955cdd08c to start an election
I20260709 13:20:35.648195 22963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd"
dest_uuid: "dc681d515e064dcfb15351d955cdd08c"
 from {username='slave'} at 127.0.0.1:54616
I20260709 13:20:35.648799 22963 raft_consensus.cc:493] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:35.649127 22963 raft_consensus.cc:3060] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.654727 22963 raft_consensus.cc:515] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:35.656697 22963 leader_election.cc:290] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 2 election: Requested vote from peers cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67:41307), 75220bdd9251477b916b13807b9d72d9 (127.14.41.66:42609)
I20260709 13:20:35.657594 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
I20260709 13:20:35.657829 23039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1d886df8a14c06b6ffb1c41d53c6bd" candidate_uuid: "dc681d515e064dcfb15351d955cdd08c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75220bdd9251477b916b13807b9d72d9"
I20260709 13:20:35.658218 23113 raft_consensus.cc:3060] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.658601 23039 raft_consensus.cc:3055] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:35.658912 23039 raft_consensus.cc:740] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 75220bdd9251477b916b13807b9d72d9, State: Running, Role: LEADER
I20260709 13:20:35.659636 23039 consensus_queue.cc:260] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:35.660871 23039 raft_consensus.cc:3060] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.663929 23113 raft_consensus.cc:2468] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 2.
I20260709 13:20:35.665428 22928 leader_election.cc:304] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cdd0ce5298ac4b72a167896f3a7d46d2, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:35.666209 23192 raft_consensus.cc:2804] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:35.666692 23192 raft_consensus.cc:697] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 2 LEADER]: Becoming Leader. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Running, Role: LEADER
I20260709 13:20:35.667327 23039 raft_consensus.cc:2468] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc681d515e064dcfb15351d955cdd08c in term 2.
I20260709 13:20:35.667441 23192 consensus_queue.cc:237] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } }
I20260709 13:20:35.675944 23182 consensus_queue.cc:1048] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:35.676851 22861 catalog_manager.cc:5697] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c reported cstate change: term changed from 1 to 2, leader changed from 75220bdd9251477b916b13807b9d72d9 (127.14.41.66) to dc681d515e064dcfb15351d955cdd08c (127.14.41.65). New cstate: current_term: 2 leader_uuid: "dc681d515e064dcfb15351d955cdd08c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.678722 23182 consensus_queue.cc:1048] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [LEADER]: Connected to new peer: Peer: permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:35.802083 14501 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:20:35.803678 14501 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:20:35.804070 14501 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:20:35.816433 22963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3"
dest_uuid: "dc681d515e064dcfb15351d955cdd08c"
mode: GRACEFUL
new_leader_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
 from {username='slave'} at 127.0.0.1:54624
I20260709 13:20:35.817037 22963 raft_consensus.cc:606] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 LEADER]: Received request to transfer leadership to TS cdd0ce5298ac4b72a167896f3a7d46d2
I20260709 13:20:35.818358 14501 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:20:35.930642 23200 consensus_queue.cc:1048] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:35.937429 23182 raft_consensus.cc:993] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c: : Instructing follower cdd0ce5298ac4b72a167896f3a7d46d2 to start an election
I20260709 13:20:35.937999 23192 raft_consensus.cc:1081] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 LEADER]: Signalling peer cdd0ce5298ac4b72a167896f3a7d46d2 to start an election
I20260709 13:20:35.939953 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3"
dest_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2"
 from {username='slave'} at 127.0.0.1:36772
I20260709 13:20:35.940662 23113 raft_consensus.cc:493] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:35.941524 23113 raft_consensus.cc:3060] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.944700 23182 consensus_queue.cc:1048] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [LEADER]: Connected to new peer: Peer: permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:35.949024 23113 raft_consensus.cc:515] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.958190 23113 leader_election.cc:290] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [CANDIDATE]: Term 2 election: Requested vote from peers dc681d515e064dcfb15351d955cdd08c (127.14.41.65:38729), 75220bdd9251477b916b13807b9d72d9 (127.14.41.66:42609)
I20260709 13:20:35.972589 22963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3" candidate_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc681d515e064dcfb15351d955cdd08c"
I20260709 13:20:35.973320 22963 raft_consensus.cc:3055] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:35.973660 22963 raft_consensus.cc:740] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc681d515e064dcfb15351d955cdd08c, State: Running, Role: LEADER
I20260709 13:20:35.974581 22963 consensus_queue.cc:260] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.974896 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "876c58408658441fb583b2bbd69ca1a3" candidate_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "75220bdd9251477b916b13807b9d72d9"
I20260709 13:20:35.975678 23038 raft_consensus.cc:3060] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.975767 22963 raft_consensus.cc:3060] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.981719 22963 raft_consensus.cc:2468] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd0ce5298ac4b72a167896f3a7d46d2 in term 2.
I20260709 13:20:35.982939 23079 leader_election.cc:304] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cdd0ce5298ac4b72a167896f3a7d46d2, dc681d515e064dcfb15351d955cdd08c; no voters: 
I20260709 13:20:35.983846 23160 raft_consensus.cc:2804] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:35.985162 23160 raft_consensus.cc:697] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 LEADER]: Becoming Leader. State: Replica: cdd0ce5298ac4b72a167896f3a7d46d2, State: Running, Role: LEADER
I20260709 13:20:35.985945 23160 consensus_queue.cc:237] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } }
I20260709 13:20:35.987310 23038 raft_consensus.cc:2468] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd0ce5298ac4b72a167896f3a7d46d2 in term 2.
I20260709 13:20:35.992476 22860 catalog_manager.cc:5697] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 reported cstate change: term changed from 1 to 2, leader changed from dc681d515e064dcfb15351d955cdd08c (127.14.41.65) to cdd0ce5298ac4b72a167896f3a7d46d2 (127.14.41.67). New cstate: current_term: 2 leader_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dc681d515e064dcfb15351d955cdd08c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 38729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75220bdd9251477b916b13807b9d72d9" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd0ce5298ac4b72a167896f3a7d46d2" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41307 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:36.039160 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
I20260709 13:20:36.060823 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:36.061440 14501 tablet_replica.cc:333] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c: stopping tablet replica
I20260709 13:20:36.061954 14501 raft_consensus.cc:2243] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:36.062711 14501 raft_consensus.cc:2272] T 2163fe8ba01045a688528b6a6660409b P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.065271 14501 tablet_replica.cc:333] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c: stopping tablet replica
I20260709 13:20:36.065804 14501 raft_consensus.cc:2243] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.066198 14501 raft_consensus.cc:2272] T 876c58408658441fb583b2bbd69ca1a3 P dc681d515e064dcfb15351d955cdd08c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.068392 14501 tablet_replica.cc:333] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c: stopping tablet replica
I20260709 13:20:36.068974 14501 raft_consensus.cc:2243] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.069355 14501 raft_consensus.cc:2272] T dd046ea63b444ee8a070e0d47b5e45de P dc681d515e064dcfb15351d955cdd08c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.071794 14501 tablet_replica.cc:333] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: stopping tablet replica
I20260709 13:20:36.072377 14501 raft_consensus.cc:2243] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:36.073071 14501 pending_rounds.cc:70] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: Trying to abort 1 pending ops.
I20260709 13:20:36.073226 14501 pending_rounds.cc:77] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638853303357440 op_type: NO_OP noop_request { }
I20260709 13:20:36.073480 14501 raft_consensus.cc:2889] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:36.073699 14501 raft_consensus.cc:2272] T 0e1d886df8a14c06b6ffb1c41d53c6bd P dc681d515e064dcfb15351d955cdd08c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.087407 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
I20260709 13:20:36.099784 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
I20260709 13:20:36.118137 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:36.118860 14501 tablet_replica.cc:333] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9: stopping tablet replica
I20260709 13:20:36.119441 14501 raft_consensus.cc:2243] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.119905 14501 raft_consensus.cc:2272] T 2163fe8ba01045a688528b6a6660409b P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.122303 14501 tablet_replica.cc:333] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9: stopping tablet replica
I20260709 13:20:36.122866 14501 raft_consensus.cc:2243] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.123302 14501 raft_consensus.cc:2272] T 876c58408658441fb583b2bbd69ca1a3 P 75220bdd9251477b916b13807b9d72d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.125674 14501 tablet_replica.cc:333] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9: stopping tablet replica
I20260709 13:20:36.126212 14501 raft_consensus.cc:2243] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:36.127015 14501 raft_consensus.cc:2272] T dd046ea63b444ee8a070e0d47b5e45de P 75220bdd9251477b916b13807b9d72d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.129456 14501 tablet_replica.cc:333] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9: stopping tablet replica
I20260709 13:20:36.129961 14501 raft_consensus.cc:2243] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.130354 14501 raft_consensus.cc:2272] T 0e1d886df8a14c06b6ffb1c41d53c6bd P 75220bdd9251477b916b13807b9d72d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.153725 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
I20260709 13:20:36.166266 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
I20260709 13:20:36.185740 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:36.186444 14501 tablet_replica.cc:333] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2: stopping tablet replica
I20260709 13:20:36.187074 14501 raft_consensus.cc:2243] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.187551 14501 raft_consensus.cc:2272] T 2163fe8ba01045a688528b6a6660409b P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.190169 14501 tablet_replica.cc:333] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: stopping tablet replica
I20260709 13:20:36.190706 14501 raft_consensus.cc:2243] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:36.191310 14501 pending_rounds.cc:70] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: Trying to abort 1 pending ops.
I20260709 13:20:36.191489 14501 pending_rounds.cc:77] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638854605676544 op_type: NO_OP noop_request { }
I20260709 13:20:36.191766 14501 raft_consensus.cc:2889] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:36.192056 14501 raft_consensus.cc:2272] T 876c58408658441fb583b2bbd69ca1a3 P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.194603 14501 tablet_replica.cc:333] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2: stopping tablet replica
I20260709 13:20:36.195142 14501 raft_consensus.cc:2243] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.195580 14501 raft_consensus.cc:2272] T dd046ea63b444ee8a070e0d47b5e45de P cdd0ce5298ac4b72a167896f3a7d46d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.197829 14501 tablet_replica.cc:333] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2: stopping tablet replica
I20260709 13:20:36.198319 14501 raft_consensus.cc:2243] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:36.198729 14501 raft_consensus.cc:2272] T 0e1d886df8a14c06b6ffb1c41d53c6bd P cdd0ce5298ac4b72a167896f3a7d46d2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.211046 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:20:36.223186 14501 master.cc:562] Master@127.14.41.126:36665 shutting down...
I20260709 13:20:36.239974 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:36.240568 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:36.240994 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P 54c2782133144805aa0efd3401f941e7: stopping tablet replica
I20260709 13:20:36.252470 14501 master.cc:584] Master@127.14.41.126:36665 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2437 ms)
[----------] 6 tests from LeaderRebalancerTest (256813 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:20:36.285442 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:43723
I20260709 13:20:36.286574 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.291882 23208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.291908 23209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.293705 23211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.294983 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:36.295883 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.296083 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.296201 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603236296190 us; error 0 us; skew 500 ppm
I20260709 13:20:36.296733 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.299520 14501 webserver.cc:533] Webserver started at http://127.14.41.126:38869/ using document root <none> and password file <none>
I20260709 13:20:36.299984 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.300143 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.300352 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.301568 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "de6b0f7603164b2189111efa201cd9dc"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.306367 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:36.309930 23216 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.310810 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:36.311152 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "de6b0f7603164b2189111efa201cd9dc"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.311450 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.335937 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.337064 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.373747 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:43723
I20260709 13:20:36.373862 23267 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:43723 every 8 connection(s)
I20260709 13:20:36.377782 23268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.389245 23268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc: Bootstrap starting.
I20260709 13:20:36.393728 23268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.397861 23268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc: No bootstrap required, opened a new log
I20260709 13:20:36.399964 23268 raft_consensus.cc:359] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6b0f7603164b2189111efa201cd9dc" member_type: VOTER }
I20260709 13:20:36.400353 23268 raft_consensus.cc:385] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.400542 23268 raft_consensus.cc:740] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de6b0f7603164b2189111efa201cd9dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.401163 23268 consensus_queue.cc:260] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6b0f7603164b2189111efa201cd9dc" member_type: VOTER }
I20260709 13:20:36.401595 23268 raft_consensus.cc:399] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:36.401779 23268 raft_consensus.cc:493] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:36.401997 23268 raft_consensus.cc:3060] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.406978 23268 raft_consensus.cc:515] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6b0f7603164b2189111efa201cd9dc" member_type: VOTER }
I20260709 13:20:36.407513 23268 leader_election.cc:304] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de6b0f7603164b2189111efa201cd9dc; no voters: 
I20260709 13:20:36.408783 23268 leader_election.cc:290] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:36.409173 23271 raft_consensus.cc:2804] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:36.410669 23271 raft_consensus.cc:697] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 1 LEADER]: Becoming Leader. State: Replica: de6b0f7603164b2189111efa201cd9dc, State: Running, Role: LEADER
I20260709 13:20:36.411438 23271 consensus_queue.cc:237] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6b0f7603164b2189111efa201cd9dc" member_type: VOTER }
I20260709 13:20:36.411942 23268 sys_catalog.cc:565] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:36.414469 23272 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de6b0f7603164b2189111efa201cd9dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6b0f7603164b2189111efa201cd9dc" member_type: VOTER } }
I20260709 13:20:36.414549 23273 sys_catalog.cc:455] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader de6b0f7603164b2189111efa201cd9dc. Latest consensus state: current_term: 1 leader_uuid: "de6b0f7603164b2189111efa201cd9dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de6b0f7603164b2189111efa201cd9dc" member_type: VOTER } }
I20260709 13:20:36.415443 23273 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:36.415390 23272 sys_catalog.cc:458] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:36.420507 23276 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:36.426718 23276 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:36.427767 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:36.436064 23276 catalog_manager.cc:1383] Generated new cluster ID: 247ea46b3e6246db8793cbd8044b4274
I20260709 13:20:36.436692 23276 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:36.449476 23276 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:36.450834 23276 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:36.472293 23276 catalog_manager.cc:6070] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc: Generated new TSK 0
I20260709 13:20:36.473028 23276 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:36.495071 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.501576 23289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.502836 23290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.504582 23292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.504647 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:36.505862 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.506078 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.506244 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603236506231 us; error 0 us; skew 500 ppm
I20260709 13:20:36.506839 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.509274 14501 webserver.cc:533] Webserver started at http://127.14.41.65:39509/ using document root <none> and password file <none>
I20260709 13:20:36.509791 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.509990 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.510277 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.511411 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.516716 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:20:36.520723 23297 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.521683 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:36.522128 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.522493 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.536223 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.537525 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.539150 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.541752 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.542060 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.542330 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.542515 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.583808 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:40035
I20260709 13:20:36.583937 23359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:40035 every 8 connection(s)
I20260709 13:20:36.589311 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.597715 23364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.599640 23365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.601130 14501 server_base.cc:1061] running on GCE node
W20260709 13:20:36.602761 23367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.602936 23360 heartbeater.cc:344] Connected to a master server at 127.14.41.126:43723
I20260709 13:20:36.603469 23360 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:36.604056 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.604429 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.604277 23360 heartbeater.cc:507] Master 127.14.41.126:43723 requested a full tablet report, sending...
I20260709 13:20:36.604823 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603236604801 us; error 0 us; skew 500 ppm
I20260709 13:20:36.605522 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.607134 23233 ts_manager.cc:194] Registered new tserver with Master: 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035)
I20260709 13:20:36.608331 14501 webserver.cc:533] Webserver started at http://127.14.41.66:37949/ using document root <none> and password file <none>
I20260709 13:20:36.608975 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.609215 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.609323 23233 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47664
I20260709 13:20:36.609498 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.610989 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "738afc0ebeed4f6eb80163fcd3006efb"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.616115 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:20:36.619985 23372 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.621040 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:20:36.621408 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "738afc0ebeed4f6eb80163fcd3006efb"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.621721 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.658542 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.659754 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.661294 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.663837 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.664095 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.664371 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.664557 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.707629 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:41889
I20260709 13:20:36.707770 23434 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:41889 every 8 connection(s)
I20260709 13:20:36.712800 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.722373 23438 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.724841 23439 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.728942 23441 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.729365 23435 heartbeater.cc:344] Connected to a master server at 127.14.41.126:43723
I20260709 13:20:36.729545 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:36.730090 23435 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:36.730700 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.730983 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.731027 23435 heartbeater.cc:507] Master 127.14.41.126:43723 requested a full tablet report, sending...
I20260709 13:20:36.731173 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603236731137 us; error 0 us; skew 500 ppm
I20260709 13:20:36.732064 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.733525 23233 ts_manager.cc:194] Registered new tserver with Master: 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:36.735041 14501 webserver.cc:533] Webserver started at http://127.14.41.67:35281/ using document root <none> and password file <none>
I20260709 13:20:36.735245 23233 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47666
I20260709 13:20:36.735682 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.735980 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.736263 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.737505 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "d55654925a034a05b49afa7b64e1febf"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.742165 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:36.745905 23446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.746727 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:20:36.747082 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "d55654925a034a05b49afa7b64e1febf"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-56lb"
I20260709 13:20:36.747396 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.760283 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.761538 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.763067 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.765533 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.765785 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.766073 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.766312 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.850011 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:41431
I20260709 13:20:36.850152 23509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:41431 every 8 connection(s)
I20260709 13:20:36.868786 23510 heartbeater.cc:344] Connected to a master server at 127.14.41.126:43723
I20260709 13:20:36.869206 23510 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:36.870162 23510 heartbeater.cc:507] Master 127.14.41.126:43723 requested a full tablet report, sending...
I20260709 13:20:36.872866 23233 ts_manager.cc:194] Registered new tserver with Master: d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:36.873405 14501 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018898065s
I20260709 13:20:36.875062 23233 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47682
I20260709 13:20:36.905030 23233 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47690:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:36.908164 23233 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:36.980979 23400 tablet_service.cc:1511] Processing CreateTablet for tablet be0192c3bed641f28d70fbdc314c602e (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:36.983158 23400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0192c3bed641f28d70fbdc314c602e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.990845 23397 tablet_service.cc:1511] Processing CreateTablet for tablet d0c42e7d0697419394362b8cfb0d2f11 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:36.992545 23397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c42e7d0697419394362b8cfb0d2f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.983501 23399 tablet_service.cc:1511] Processing CreateTablet for tablet b8c3eaa1a95b4446870b696c08f305b5 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:36.997696 23399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c3eaa1a95b4446870b696c08f305b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.000792 23474 tablet_service.cc:1511] Processing CreateTablet for tablet b8c3eaa1a95b4446870b696c08f305b5 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:37.001665 23475 tablet_service.cc:1511] Processing CreateTablet for tablet be0192c3bed641f28d70fbdc314c602e (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:37.002578 23474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c3eaa1a95b4446870b696c08f305b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.002928 23325 tablet_service.cc:1511] Processing CreateTablet for tablet be0192c3bed641f28d70fbdc314c602e (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:37.003422 23475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0192c3bed641f28d70fbdc314c602e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.985559 23398 tablet_service.cc:1511] Processing CreateTablet for tablet df221801e57f4d60b2e276ea25d5c609 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:37.009358 23322 tablet_service.cc:1511] Processing CreateTablet for tablet d0c42e7d0697419394362b8cfb0d2f11 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:37.014209 23395 tablet_service.cc:1511] Processing CreateTablet for tablet d0cd9a81cc7049ad91e8cd9c680dfe1c (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:37.018219 23470 tablet_service.cc:1511] Processing CreateTablet for tablet d0cd9a81cc7049ad91e8cd9c680dfe1c (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:37.023453 23395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cd9a81cc7049ad91e8cd9c680dfe1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.024993 23470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cd9a81cc7049ad91e8cd9c680dfe1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.007601 23323 tablet_service.cc:1511] Processing CreateTablet for tablet df221801e57f4d60b2e276ea25d5c609 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:37.025298 23320 tablet_service.cc:1511] Processing CreateTablet for tablet d0cd9a81cc7049ad91e8cd9c680dfe1c (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:37.016458 23471 tablet_service.cc:1511] Processing CreateTablet for tablet 254995c426e1458891deefc10a44988b (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:37.010900 23321 tablet_service.cc:1511] Processing CreateTablet for tablet 254995c426e1458891deefc10a44988b (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:37.028198 23319 tablet_service.cc:1511] Processing CreateTablet for tablet f5abc3429e1c4cb1bdd420b10b7193a8 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:37.016345 23394 tablet_service.cc:1511] Processing CreateTablet for tablet f5abc3429e1c4cb1bdd420b10b7193a8 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:37.021723 23469 tablet_service.cc:1511] Processing CreateTablet for tablet f5abc3429e1c4cb1bdd420b10b7193a8 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:37.030800 23469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5abc3429e1c4cb1bdd420b10b7193a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.012060 23396 tablet_service.cc:1511] Processing CreateTablet for tablet 254995c426e1458891deefc10a44988b (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:37.005165 23473 tablet_service.cc:1511] Processing CreateTablet for tablet df221801e57f4d60b2e276ea25d5c609 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:37.032965 23471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254995c426e1458891deefc10a44988b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.004546 23325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be0192c3bed641f28d70fbdc314c602e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.006595 23472 tablet_service.cc:1511] Processing CreateTablet for tablet d0c42e7d0697419394362b8cfb0d2f11 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:37.036204 23472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c42e7d0697419394362b8cfb0d2f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.036248 23468 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6b34608a4742518655634e5c95cee4 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:37.039041 23467 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5226718aaa41678f08260fcab186a6 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:37.041040 23473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df221801e57f4d60b2e276ea25d5c609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.041738 23320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cd9a81cc7049ad91e8cd9c680dfe1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.042976 23322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0c42e7d0697419394362b8cfb0d2f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.043808 23321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254995c426e1458891deefc10a44988b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.049029 23319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5abc3429e1c4cb1bdd420b10b7193a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.005990 23324 tablet_service.cc:1511] Processing CreateTablet for tablet b8c3eaa1a95b4446870b696c08f305b5 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:37.051746 23324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c3eaa1a95b4446870b696c08f305b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.051187 23318 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6b34608a4742518655634e5c95cee4 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:37.049032 23468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6b34608a4742518655634e5c95cee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.053491 23318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6b34608a4742518655634e5c95cee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.057070 23323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df221801e57f4d60b2e276ea25d5c609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.057070 23467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5226718aaa41678f08260fcab186a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.059531 23317 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5226718aaa41678f08260fcab186a6 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:37.066366 23317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5226718aaa41678f08260fcab186a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.082439 23398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df221801e57f4d60b2e276ea25d5c609. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.082787 23393 tablet_service.cc:1511] Processing CreateTablet for tablet 5e6b34608a4742518655634e5c95cee4 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:37.086079 23392 tablet_service.cc:1511] Processing CreateTablet for tablet 9b5226718aaa41678f08260fcab186a6 (DEFAULT_TABLE table=test-workload [id=6c70a6129b904950aad8a7e9cf55fbf4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:37.084507 23393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e6b34608a4742518655634e5c95cee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.093829 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5abc3429e1c4cb1bdd420b10b7193a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.108769 23392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b5226718aaa41678f08260fcab186a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.111675 23396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254995c426e1458891deefc10a44988b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:37.185819 23524 tablet_bootstrap.cc:492] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.201454 23525 tablet_bootstrap.cc:492] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.249681 23524 tablet_bootstrap.cc:654] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.250115 23525 tablet_bootstrap.cc:654] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.254621 23526 tablet_bootstrap.cc:492] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.262637 23525 tablet_bootstrap.cc:492] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.262683 23524 tablet_bootstrap.cc:492] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.263515 23525 ts_tablet_manager.cc:1403] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.003s
I20260709 13:20:37.263540 23524 ts_tablet_manager.cc:1403] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.009s
I20260709 13:20:37.264564 23526 tablet_bootstrap.cc:654] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.267530 23525 raft_consensus.cc:359] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.267678 23524 raft_consensus.cc:359] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.268900 23525 raft_consensus.cc:385] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.269018 23524 raft_consensus.cc:385] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.269271 23525 raft_consensus.cc:740] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.269464 23524 raft_consensus.cc:740] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.270663 23526 tablet_bootstrap.cc:492] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.270445 23525 consensus_queue.cc:260] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.270433 23524 consensus_queue.cc:260] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.271237 23526 ts_tablet_manager.cc:1403] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:20:37.273450 23435 heartbeater.cc:499] Master 127.14.41.126:43723 was elected leader, sending a full tablet report...
I20260709 13:20:37.273911 23525 ts_tablet_manager.cc:1434] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.001s
I20260709 13:20:37.274991 23525 tablet_bootstrap.cc:492] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.275723 23526 raft_consensus.cc:359] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.276891 23526 raft_consensus.cc:385] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.277283 23526 raft_consensus.cc:740] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.278481 23526 consensus_queue.cc:260] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.282262 23525 tablet_bootstrap.cc:654] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.282327 23524 ts_tablet_manager.cc:1434] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.010s
I20260709 13:20:37.284108 23524 tablet_bootstrap.cc:492] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.284886 23510 heartbeater.cc:499] Master 127.14.41.126:43723 was elected leader, sending a full tablet report...
I20260709 13:20:37.293720 23524 tablet_bootstrap.cc:654] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.298409 23525 tablet_bootstrap.cc:492] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.299017 23525 ts_tablet_manager.cc:1403] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 13:20:37.302286 23525 raft_consensus.cc:359] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.303117 23525 raft_consensus.cc:385] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.303436 23525 raft_consensus.cc:740] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.304557 23525 consensus_queue.cc:260] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.306887 23525 ts_tablet_manager.cc:1434] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:20:37.307971 23525 tablet_bootstrap.cc:492] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.315200 23525 tablet_bootstrap.cc:654] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.327234 23525 tablet_bootstrap.cc:492] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.327821 23525 ts_tablet_manager.cc:1403] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:20:37.331521 23360 heartbeater.cc:499] Master 127.14.41.126:43723 was elected leader, sending a full tablet report...
I20260709 13:20:37.331285 23525 raft_consensus.cc:359] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.332105 23525 raft_consensus.cc:385] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.332398 23526 ts_tablet_manager.cc:1434] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.061s	user 0.021s	sys 0.037s
I20260709 13:20:37.332413 23525 raft_consensus.cc:740] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.334076 23526 tablet_bootstrap.cc:492] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.333793 23525 consensus_queue.cc:260] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.336333 23525 ts_tablet_manager.cc:1434] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:20:37.337498 23525 tablet_bootstrap.cc:492] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.344723 23525 tablet_bootstrap.cc:654] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.346145 23526 tablet_bootstrap.cc:654] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.350090 23524 tablet_bootstrap.cc:492] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.350905 23524 ts_tablet_manager.cc:1403] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.040s
I20260709 13:20:37.355355 23524 raft_consensus.cc:359] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.356276 23524 raft_consensus.cc:385] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.356630 23524 raft_consensus.cc:740] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.358560 23526 tablet_bootstrap.cc:492] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.358253 23524 consensus_queue.cc:260] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.359184 23526 ts_tablet_manager.cc:1403] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.005s
I20260709 13:20:37.362555 23526 raft_consensus.cc:359] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.363142 23524 ts_tablet_manager.cc:1434] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:20:37.363349 23526 raft_consensus.cc:385] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.363708 23526 raft_consensus.cc:740] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.364331 23524 tablet_bootstrap.cc:492] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.364526 23526 consensus_queue.cc:260] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.366859 23526 ts_tablet_manager.cc:1434] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:20:37.367362 23525 tablet_bootstrap.cc:492] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.367906 23526 tablet_bootstrap.cc:492] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.367960 23525 ts_tablet_manager.cc:1403] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.013s
I20260709 13:20:37.371637 23525 raft_consensus.cc:359] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.372493 23525 raft_consensus.cc:385] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.372495 23524 tablet_bootstrap.cc:654] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.372936 23525 raft_consensus.cc:740] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.374099 23525 consensus_queue.cc:260] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.376577 23526 tablet_bootstrap.cc:654] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.376928 23525 ts_tablet_manager.cc:1434] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:37.378099 23525 tablet_bootstrap.cc:492] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.385118 23525 tablet_bootstrap.cc:654] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.385763 23524 tablet_bootstrap.cc:492] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.386584 23524 ts_tablet_manager.cc:1403] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:20:37.389636 23526 tablet_bootstrap.cc:492] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.390244 23526 ts_tablet_manager.cc:1403] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:20:37.390003 23524 raft_consensus.cc:359] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.390817 23524 raft_consensus.cc:385] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.391156 23524 raft_consensus.cc:740] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.392234 23524 consensus_queue.cc:260] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.393520 23526 raft_consensus.cc:359] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.394297 23526 raft_consensus.cc:385] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.395637 23526 raft_consensus.cc:740] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.397431 23524 ts_tablet_manager.cc:1434] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:20:37.398643 23524 tablet_bootstrap.cc:492] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.398905 23526 consensus_queue.cc:260] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.401664 23526 ts_tablet_manager.cc:1434] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:37.402784 23526 tablet_bootstrap.cc:492] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.405396 23524 tablet_bootstrap.cc:654] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.409946 23526 tablet_bootstrap.cc:654] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.411473 23524 tablet_bootstrap.cc:492] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.412078 23524 ts_tablet_manager.cc:1403] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.007s
I20260709 13:20:37.415027 23525 tablet_bootstrap.cc:492] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.415601 23525 ts_tablet_manager.cc:1403] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.012s
I20260709 13:20:37.416008 23524 raft_consensus.cc:359] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.417181 23524 raft_consensus.cc:385] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.417567 23524 raft_consensus.cc:740] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.418296 23524 consensus_queue.cc:260] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.418756 23525 raft_consensus.cc:359] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.419441 23525 raft_consensus.cc:385] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.419744 23525 raft_consensus.cc:740] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.419854 23526 tablet_bootstrap.cc:492] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.420456 23526 ts_tablet_manager.cc:1403] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:20:37.420562 23525 consensus_queue.cc:260] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
W20260709 13:20:37.422650 23281 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:37.420770 23524 ts_tablet_manager.cc:1434] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.004s
I20260709 13:20:37.423863 23525 ts_tablet_manager.cc:1434] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:37.423709 23526 raft_consensus.cc:359] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.424346 23524 tablet_bootstrap.cc:492] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.424561 23526 raft_consensus.cc:385] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.424919 23526 raft_consensus.cc:740] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.425298 23525 tablet_bootstrap.cc:492] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.425798 23526 consensus_queue.cc:260] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.431831 23524 tablet_bootstrap.cc:654] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.432708 23525 tablet_bootstrap.cc:654] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.435657 23526 ts_tablet_manager.cc:1434] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:20:37.440766 23526 tablet_bootstrap.cc:492] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.443810 23532 raft_consensus.cc:493] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.444743 23532 raft_consensus.cc:515] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.461203 23524 tablet_bootstrap.cc:492] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.461542 23532 leader_election.cc:290] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.461853 23524 ts_tablet_manager.cc:1403] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.022s
I20260709 13:20:37.461916 23525 tablet_bootstrap.cc:492] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.462704 23525 ts_tablet_manager.cc:1403] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.016s
I20260709 13:20:37.463496 23532 raft_consensus.cc:493] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.464012 23532 raft_consensus.cc:515] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.466022 23525 raft_consensus.cc:359] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.466851 23525 raft_consensus.cc:385] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.467163 23525 raft_consensus.cc:740] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.468058 23525 consensus_queue.cc:260] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.465587 23524 raft_consensus.cc:359] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.469296 23524 raft_consensus.cc:385] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.469689 23524 raft_consensus.cc:740] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.470886 23524 consensus_queue.cc:260] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.466166 23532 leader_election.cc:290] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.472729 23525 ts_tablet_manager.cc:1434] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:20:37.473905 23525 tablet_bootstrap.cc:492] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.476898 23524 ts_tablet_manager.cc:1434] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:20:37.478389 23524 tablet_bootstrap.cc:492] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.480892 23525 tablet_bootstrap.cc:654] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.481597 23526 tablet_bootstrap.cc:654] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.486135 23524 tablet_bootstrap.cc:654] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.504076 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:37.506596 23524 tablet_bootstrap.cc:492] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.507157 23526 tablet_bootstrap.cc:492] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.507869 23526 ts_tablet_manager.cc:1403] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.004s
I20260709 13:20:37.508708 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:37.509419 23410 raft_consensus.cc:2468] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 0.
I20260709 13:20:37.510238 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
W20260709 13:20:37.511409 23300 leader_election.cc:343] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:37.512086 23298 leader_election.cc:343] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.512874 23300 leader_election.cc:304] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: d55654925a034a05b49afa7b64e1febf
I20260709 13:20:37.513691 23525 tablet_bootstrap.cc:492] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.511108 23526 raft_consensus.cc:359] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.514117 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:37.514407 23525 ts_tablet_manager.cc:1403] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.022s
I20260709 13:20:37.514519 23526 raft_consensus.cc:385] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.514744 23532 raft_consensus.cc:493] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.515065 23526 raft_consensus.cc:740] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.507313 23524 ts_tablet_manager.cc:1403] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.017s
I20260709 13:20:37.516225 23526 consensus_queue.cc:260] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.514361 23547 raft_consensus.cc:2804] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.517318 23547 raft_consensus.cc:493] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.517688 23547 raft_consensus.cc:3060] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.518042 23525 raft_consensus.cc:359] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.519201 23525 raft_consensus.cc:385] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.519621 23525 raft_consensus.cc:740] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
W20260709 13:20:37.516479 23298 leader_election.cc:343] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.520267 23524 raft_consensus.cc:359] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.520879 23298 leader_election.cc:304] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4; no voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:37.515399 23532 raft_consensus.cc:515] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.521500 23524 raft_consensus.cc:385] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.520725 23525 consensus_queue.cc:260] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.522024 23524 raft_consensus.cc:740] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.523473 23532 leader_election.cc:290] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.523152 23524 consensus_queue.cc:260] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.524370 23525 ts_tablet_manager.cc:1434] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:20:37.525570 23525 tablet_bootstrap.cc:492] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.529918 23524 ts_tablet_manager.cc:1434] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:20:37.531349 23524 tablet_bootstrap.cc:492] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.532219 23525 tablet_bootstrap.cc:654] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.532621 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:37.533532 23485 raft_consensus.cc:2468] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 0.
I20260709 13:20:37.531173 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:37.534955 23532 raft_consensus.cc:2749] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:37.536772 23300 leader_election.cc:343] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.539000 23298 leader_election.cc:304] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:37.540800 23532 raft_consensus.cc:2804] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.541363 23532 raft_consensus.cc:493] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.541909 23532 raft_consensus.cc:3060] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.545451 23530 raft_consensus.cc:493] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.546315 23530 raft_consensus.cc:515] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.548368 23524 tablet_bootstrap.cc:654] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.551497 23547 raft_consensus.cc:515] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.561344 23547 leader_election.cc:290] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.560258 23532 raft_consensus.cc:515] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.564297 23526 ts_tablet_manager.cc:1434] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.056s	user 0.012s	sys 0.015s
I20260709 13:20:37.565251 23530 leader_election.cc:290] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.565747 23526 tablet_bootstrap.cc:492] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.567778 23525 tablet_bootstrap.cc:492] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.568378 23525 ts_tablet_manager.cc:1403] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.029s
I20260709 13:20:37.569733 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:37.574625 23532 leader_election.cc:290] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.571872 23525 raft_consensus.cc:359] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.575083 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:37.575613 23525 raft_consensus.cc:385] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.575911 23410 raft_consensus.cc:3060] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.576081 23524 tablet_bootstrap.cc:492] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.576015 23525 raft_consensus.cc:740] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.577205 23524 ts_tablet_manager.cc:1403] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.003s
I20260709 13:20:37.577287 23525 consensus_queue.cc:260] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.581279 23530 raft_consensus.cc:493] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.581986 23530 raft_consensus.cc:515] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.584328 23531 raft_consensus.cc:493] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.585002 23531 raft_consensus.cc:515] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.586320 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:37.586985 23485 raft_consensus.cc:3060] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.590313 23531 leader_election.cc:290] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:37.584311 23530 leader_election.cc:290] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
W20260709 13:20:37.591629 23298 leader_election.cc:343] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.585011 23526 tablet_bootstrap.cc:654] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.593418 23524 raft_consensus.cc:359] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.596458 23524 raft_consensus.cc:385] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.599601 23525 ts_tablet_manager.cc:1434] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.031s	user 0.021s	sys 0.003s
I20260709 13:20:37.599184 23524 raft_consensus.cc:740] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.600953 23525 tablet_bootstrap.cc:492] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:37.600764 23524 consensus_queue.cc:260] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.594937 23410 raft_consensus.cc:2468] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 1.
I20260709 13:20:37.609871 23524 ts_tablet_manager.cc:1434] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:20:37.615108 23524 tablet_bootstrap.cc:492] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.615979 23485 raft_consensus.cc:2468] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 1.
I20260709 13:20:37.622267 23524 tablet_bootstrap.cc:654] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.630028 23298 leader_election.cc:304] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:37.635108 23526 tablet_bootstrap.cc:492] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.635754 23526 ts_tablet_manager.cc:1403] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.070s	user 0.021s	sys 0.010s
I20260709 13:20:37.641672 23300 leader_election.cc:304] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: d55654925a034a05b49afa7b64e1febf
I20260709 13:20:37.643023 23525 tablet_bootstrap.cc:654] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.645262 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:37.650851 23335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.651752 23335 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.652100 23532 raft_consensus.cc:2804] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.652665 23532 raft_consensus.cc:697] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:37.653225 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.653294 23373 leader_election.cc:304] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.653630 23532 consensus_queue.cc:237] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.654131 23334 raft_consensus.cc:2468] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.654371 23530 raft_consensus.cc:2804] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.654803 23530 raft_consensus.cc:493] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.655145 23530 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.655354 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:37.656232 23485 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.658066 23526 raft_consensus.cc:359] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.658509 23531 raft_consensus.cc:493] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.658842 23526 raft_consensus.cc:385] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.659183 23531 raft_consensus.cc:515] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
W20260709 13:20:37.660167 23300 leader_election.cc:343] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.661027 23551 raft_consensus.cc:2804] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.661543 23551 raft_consensus.cc:697] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:37.662125 23531 leader_election.cc:290] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035)
I20260709 13:20:37.662384 23551 consensus_queue.cc:237] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.659212 23526 raft_consensus.cc:740] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.663760 23530 raft_consensus.cc:515] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.663947 23526 consensus_queue.cc:260] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.668323 23526 ts_tablet_manager.cc:1434] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.004s
I20260709 13:20:37.668205 23373 leader_election.cc:304] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.669200 23555 raft_consensus.cc:2804] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.669391 23526 tablet_bootstrap.cc:492] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.669639 23555 raft_consensus.cc:493] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.670029 23555 raft_consensus.cc:3060] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.670747 23531 raft_consensus.cc:493] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.671254 23531 raft_consensus.cc:515] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.669862 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:37.679066 23531 leader_election.cc:290] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:37.679466 23485 raft_consensus.cc:2468] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.694193 23530 leader_election.cc:290] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.696245 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.697903 23334 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.700304 23335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
W20260709 13:20:37.702658 23447 leader_election.cc:343] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.702999 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.704018 23332 raft_consensus.cc:2468] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
I20260709 13:20:37.705643 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.706509 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:37.696180 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:37.708439 23485 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.708930 23409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:37.709627 23409 raft_consensus.cc:2468] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
I20260709 13:20:37.701175 23555 raft_consensus.cc:515] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.707211 23410 raft_consensus.cc:2468] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
I20260709 13:20:37.717301 23531 raft_consensus.cc:493] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.716527 23526 tablet_bootstrap.cc:654] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.717492 23447 leader_election.cc:304] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:37.718869 23485 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:37.711287 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:37.712489 23449 leader_election.cc:304] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:37.728189 23531 raft_consensus.cc:515] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.728979 23334 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:37.733918 23555 leader_election.cc:290] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.733960 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.735040 23333 raft_consensus.cc:3060] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.735188 23230 catalog_manager.cc:5697] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.737036 23408 raft_consensus.cc:2393] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d55654925a034a05b49afa7b64e1febf in current term 1: Already voted for candidate 738afc0ebeed4f6eb80163fcd3006efb in this term.
I20260709 13:20:37.737030 23230 catalog_manager.cc:5697] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.740193 23524 tablet_bootstrap.cc:492] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.740885 23524 ts_tablet_manager.cc:1403] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.126s	user 0.030s	sys 0.051s
I20260709 13:20:37.739919 23531 leader_election.cc:290] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:37.741600 23531 raft_consensus.cc:2804] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.741921 23531 raft_consensus.cc:493] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.742211 23531 raft_consensus.cc:3060] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.743788 23524 raft_consensus.cc:359] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.744560 23524 raft_consensus.cc:385] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.744992 23524 raft_consensus.cc:740] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.746004 23373 leader_election.cc:304] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.745925 23524 consensus_queue.cc:260] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.746964 23555 raft_consensus.cc:2804] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.747133 23525 tablet_bootstrap.cc:492] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:37.750922 23525 ts_tablet_manager.cc:1403] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.150s	user 0.018s	sys 0.006s
I20260709 13:20:37.748202 23524 ts_tablet_manager.cc:1434] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:20:37.752426 23530 raft_consensus.cc:493] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.752676 23524 tablet_bootstrap.cc:492] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:37.749086 23565 raft_consensus.cc:2804] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.753031 23530 raft_consensus.cc:515] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.753463 23565 raft_consensus.cc:493] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.750456 23531 raft_consensus.cc:515] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.754875 23565 raft_consensus.cc:3060] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.755493 23530 leader_election.cc:290] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.756465 23531 leader_election.cc:290] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:37.757726 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd9a81cc7049ad91e8cd9c680dfe1c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.758458 23332 raft_consensus.cc:2468] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.759789 23373 leader_election.cc:304] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.760695 23530 raft_consensus.cc:2804] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.761075 23530 raft_consensus.cc:493] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.762035 23530 raft_consensus.cc:3060] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.762696 23524 tablet_bootstrap.cc:654] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.759944 23525 raft_consensus.cc:359] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.767402 23525 raft_consensus.cc:385] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.768428 23525 raft_consensus.cc:740] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
W20260709 13:20:37.751168 23447 leader_election.cc:343] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.770428 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.747474 23555 raft_consensus.cc:697] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:37.773103 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd9a81cc7049ad91e8cd9c680dfe1c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:37.773321 23555 consensus_queue.cc:237] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.774040 23484 raft_consensus.cc:2468] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
W20260709 13:20:37.775982 23447 leader_election.cc:343] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.744426 23333 raft_consensus.cc:2468] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:37.778474 23373 leader_election.cc:304] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.779767 23525 consensus_queue.cc:260] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.785235 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.786312 23334 raft_consensus.cc:2393] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d55654925a034a05b49afa7b64e1febf in current term 1: Already voted for candidate 738afc0ebeed4f6eb80163fcd3006efb in this term.
I20260709 13:20:37.769363 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:37.787660 23485 raft_consensus.cc:2393] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 738afc0ebeed4f6eb80163fcd3006efb in current term 1: Already voted for candidate d55654925a034a05b49afa7b64e1febf in this term.
W20260709 13:20:37.789402 23449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:41889, user_credentials={real_user=slave}} blocked reactor thread for 77132.3us
I20260709 13:20:37.791604 23449 leader_election.cc:304] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:37.792196 23572 raft_consensus.cc:493] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.793022 23572 raft_consensus.cc:515] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.795881 23572 leader_election.cc:290] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.796916 23567 raft_consensus.cc:2804] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.797477 23567 raft_consensus.cc:493] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.797832 23567 raft_consensus.cc:3060] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.797875 23524 tablet_bootstrap.cc:492] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:37.799751 23524 ts_tablet_manager.cc:1403] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.015s
I20260709 13:20:37.798900 23565 raft_consensus.cc:515] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.803036 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.806143 23565 leader_election.cc:290] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035)
I20260709 13:20:37.819660 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:37.820556 23485 raft_consensus.cc:2468] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.822794 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.820808 23524 raft_consensus.cc:359] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
W20260709 13:20:37.825366 23447 leader_election.cc:343] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.825748 23524 raft_consensus.cc:385] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.826176 23524 raft_consensus.cc:740] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.827270 23524 consensus_queue.cc:260] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.829237 23526 tablet_bootstrap.cc:492] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.829778 23524 ts_tablet_manager.cc:1434] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.005s
I20260709 13:20:37.829838 23526 ts_tablet_manager.cc:1403] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.017s
I20260709 13:20:37.834638 23526 raft_consensus.cc:359] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.835383 23526 raft_consensus.cc:385] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.835670 23526 raft_consensus.cc:740] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.839366 23555 raft_consensus.cc:493] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.839977 23555 raft_consensus.cc:515] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.842075 23555 leader_election.cc:290] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.844616 23525 ts_tablet_manager.cc:1434] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.093s	user 0.022s	sys 0.021s
I20260709 13:20:37.846274 23233 catalog_manager.cc:5697] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 1 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.848901 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:37.849575 23334 raft_consensus.cc:2468] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.846639 23530 raft_consensus.cc:515] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.850659 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:37.851348 23408 raft_consensus.cc:2468] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
I20260709 13:20:37.851660 23530 leader_election.cc:290] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
W20260709 13:20:37.848663 23373 leader_election.cc:343] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.852778 23373 leader_election.cc:304] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:37.852846 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:37.853607 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:37.854166 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:37.854432 23485 raft_consensus.cc:2468] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:37.854676 23373 leader_election.cc:304] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.854992 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd9a81cc7049ad91e8cd9c680dfe1c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.855475 23572 raft_consensus.cc:2804] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.855906 23334 raft_consensus.cc:3060] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.856226 23526 consensus_queue.cc:260] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.854800 23410 raft_consensus.cc:3060] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.858845 23526 ts_tablet_manager.cc:1434] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:20:37.853641 23530 raft_consensus.cc:2804] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.860888 23572 raft_consensus.cc:697] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:37.861001 23530 raft_consensus.cc:493] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.861860 23572 consensus_queue.cc:237] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.861877 23530 raft_consensus.cc:3060] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.866478 23410 raft_consensus.cc:2468] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:37.867007 23567 raft_consensus.cc:515] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.859906 23526 tablet_bootstrap.cc:492] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.860428 23571 raft_consensus.cc:2804] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.867811 23449 leader_election.cc:304] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:37.868081 23571 raft_consensus.cc:493] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.868688 23571 raft_consensus.cc:3060] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.869153 23565 raft_consensus.cc:2804] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.869567 23565 raft_consensus.cc:493] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.869722 23567 leader_election.cc:290] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:37.869985 23565 raft_consensus.cc:3060] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.874325 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd9a81cc7049ad91e8cd9c680dfe1c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:37.875061 23485 raft_consensus.cc:3060] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.880190 23449 leader_election.cc:304] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:37.881507 23567 raft_consensus.cc:2804] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.882025 23567 raft_consensus.cc:697] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:37.882858 23567 consensus_queue.cc:237] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.885601 23334 raft_consensus.cc:2468] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:37.886181 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:37.890105 23410 raft_consensus.cc:3060] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.890142 23373 leader_election.cc:304] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.891340 23574 raft_consensus.cc:2804] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.887671 23565 raft_consensus.cc:515] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.888649 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.891736 23574 raft_consensus.cc:697] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:37.892113 23449 leader_election.cc:304] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb
W20260709 13:20:37.893023 23447 leader_election.cc:343] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.892684 23574 consensus_queue.cc:237] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.893707 23531 raft_consensus.cc:2749] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:37.900724 23565 leader_election.cc:290] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:37.901497 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.902247 23333 raft_consensus.cc:3060] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.902258 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:37.903790 23571 raft_consensus.cc:515] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.906065 23571 leader_election.cc:290] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.906762 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.907114 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:37.907404 23332 raft_consensus.cc:3060] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.906599 23230 catalog_manager.cc:5697] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 1 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.907815 23484 raft_consensus.cc:3060] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.882797 23485 raft_consensus.cc:2468] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:37.911307 23530 raft_consensus.cc:515] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.912966 23408 raft_consensus.cc:2393] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d55654925a034a05b49afa7b64e1febf in current term 1: Already voted for candidate 738afc0ebeed4f6eb80163fcd3006efb in this term.
I20260709 13:20:37.914721 23526 tablet_bootstrap.cc:654] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.918421 23530 leader_election.cc:290] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:37.920176 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:37.920399 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:37.921141 23485 raft_consensus.cc:2393] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 738afc0ebeed4f6eb80163fcd3006efb in current term 1: Already voted for candidate d55654925a034a05b49afa7b64e1febf in this term.
I20260709 13:20:37.900981 23410 raft_consensus.cc:2468] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:37.923033 23449 leader_election.cc:304] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:37.922950 23373 leader_election.cc:304] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:37.924153 23567 raft_consensus.cc:2804] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.918071 23332 raft_consensus.cc:2468] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:37.924674 23567 raft_consensus.cc:697] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:37.921773 23333 raft_consensus.cc:2468] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:37.925897 23567 consensus_queue.cc:237] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.926260 23447 leader_election.cc:304] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:37.927412 23531 raft_consensus.cc:2804] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.927884 23531 raft_consensus.cc:697] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:37.928714 23531 consensus_queue.cc:237] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.924489 23530 raft_consensus.cc:2749] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:37.933861 23484 raft_consensus.cc:2468] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:37.934053 23230 catalog_manager.cc:5697] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 1 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.934893 23373 leader_election.cc:304] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:37.935915 23530 raft_consensus.cc:2804] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.936864 23530 raft_consensus.cc:697] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:37.938045 23530 consensus_queue.cc:237] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.943114 23233 catalog_manager.cc:5697] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 0 to 1, leader changed from <none> to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.944793 23526 tablet_bootstrap.cc:492] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.945417 23526 ts_tablet_manager.cc:1403] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.086s	user 0.016s	sys 0.019s
I20260709 13:20:37.948371 23526 raft_consensus.cc:359] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.949349 23526 raft_consensus.cc:385] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.949764 23526 raft_consensus.cc:740] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.950485 23526 consensus_queue.cc:260] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:37.952097 23526 ts_tablet_manager.cc:1434] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:37.953572 23526 tablet_bootstrap.cc:492] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:37.960148 23526 tablet_bootstrap.cc:654] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.959931 23231 catalog_manager.cc:5697] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 1 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.972518 23526 tablet_bootstrap.cc:492] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:37.973016 23526 ts_tablet_manager.cc:1403] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.005s
I20260709 13:20:37.973052 23230 catalog_manager.cc:5697] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 0 to 1, leader changed from <none> to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.974610 23230 catalog_manager.cc:5697] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 0 to 1, leader changed from <none> to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.975819 23526 raft_consensus.cc:359] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.976552 23526 raft_consensus.cc:385] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.976861 23526 raft_consensus.cc:740] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.977561 23526 consensus_queue.cc:260] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:37.979168 23526 ts_tablet_manager.cc:1434] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:38.057634 23410 raft_consensus.cc:3060] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.064214 23551 consensus_queue.cc:1048] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.066036 23551 consensus_queue.cc:1048] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.087513 23587 raft_consensus.cc:493] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.088044 23587 raft_consensus.cc:515] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.090408 23587 leader_election.cc:290] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.091100 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:38.091451 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:38.091850 23410 raft_consensus.cc:2393] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in current term 1: Already voted for candidate d55654925a034a05b49afa7b64e1febf in this term.
I20260709 13:20:38.093343 23298 leader_election.cc:304] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4; no voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:38.094131 23587 raft_consensus.cc:3060] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.100155 23587 raft_consensus.cc:2749] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.114964 23484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:40148
I20260709 13:20:38.115641 23484 raft_consensus.cc:606] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:38.128489 23410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:20:38.129125 23410 raft_consensus.cc:606] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:38.134534 23484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:40148
I20260709 13:20:38.135082 23484 raft_consensus.cc:606] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:38.140353 23410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:20:38.141110 23410 raft_consensus.cc:606] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:38.151331 23484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
mode: GRACEFUL
new_leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:40148
I20260709 13:20:38.151830 23484 raft_consensus.cc:606] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Received request to transfer leadership to TS 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:38.164165 23332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
mode: GRACEFUL
new_leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:46244
I20260709 13:20:38.164783 23332 raft_consensus.cc:606] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Received request to transfer leadership to TS 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:38.170070 23332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
mode: GRACEFUL
new_leader_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:46244
I20260709 13:20:38.170603 23332 raft_consensus.cc:606] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Received request to transfer leadership to TS d55654925a034a05b49afa7b64e1febf
I20260709 13:20:38.193238 23484 raft_consensus.cc:3060] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.199697 23587 consensus_queue.cc:1048] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.206348 23547 raft_consensus.cc:993] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4: : Instructing follower d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:38.206946 23532 raft_consensus.cc:1081] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Signalling peer d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:38.208642 23485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:40126
I20260709 13:20:38.209743 23485 raft_consensus.cc:493] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.210175 23485 raft_consensus.cc:3060] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.213315 23587 consensus_queue.cc:1048] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.217024 23485 raft_consensus.cc:515] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.220661 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:38.221318 23332 raft_consensus.cc:3055] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.221396 23485 leader_election.cc:290] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:38.221702 23332 raft_consensus.cc:740] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:38.222719 23332 consensus_queue.cc:260] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.223802 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b5226718aaa41678f08260fcab186a6" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:38.224426 23332 raft_consensus.cc:3060] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.224797 23410 raft_consensus.cc:3060] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.230294 23530 consensus_queue.cc:1048] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.239938 23587 raft_consensus.cc:493] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:38.240674 23587 raft_consensus.cc:515] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:38.243112 23410 raft_consensus.cc:2468] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 2.
I20260709 13:20:38.243985 23332 raft_consensus.cc:2468] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 2.
I20260709 13:20:38.244742 23449 leader_election.cc:304] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:38.245715 23567 raft_consensus.cc:2804] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.246261 23567 raft_consensus.cc:697] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 2 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:38.247073 23567 consensus_queue.cc:237] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.256419 23587 leader_election.cc:290] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.257354 23571 consensus_queue.cc:1048] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.257970 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:38.259620 23572 raft_consensus.cc:993] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.260156 23572 raft_consensus.cc:1081] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.267659 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:38.268522 23410 raft_consensus.cc:2393] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in current term 1: Already voted for candidate d55654925a034a05b49afa7b64e1febf in this term.
I20260709 13:20:38.269294 23233 catalog_manager.cc:5697] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 1 to 2, leader changed from 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65) to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 2 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.270623 23300 leader_election.cc:304] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4; no voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:38.271575 23587 raft_consensus.cc:3060] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:38.272276 23333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46228
I20260709 13:20:38.272962 23333 raft_consensus.cc:493] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.273347 23333 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.280197 23587 raft_consensus.cc:2749] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:38.281958 23333 raft_consensus.cc:515] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.284029 23333 leader_election.cc:290] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.284857 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:38.285498 23410 raft_consensus.cc:3055] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.285836 23410 raft_consensus.cc:740] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:38.286651 23410 consensus_queue.cc:260] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.286876 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:38.287595 23485 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.287977 23410 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.293190 23485 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:38.293193 23410 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:38.294615 23300 leader_election.cc:304] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:38.295445 23587 raft_consensus.cc:2804] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.295981 23587 raft_consensus.cc:697] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:38.296979 23587 consensus_queue.cc:237] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.304127 23233 catalog_manager.cc:5697] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.355358 23567 consensus_queue.cc:1048] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.367933 23565 consensus_queue.cc:1048] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.376766 23530 consensus_queue.cc:1048] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.377028 23531 raft_consensus.cc:993] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.380340 23565 consensus_queue.cc:1048] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.380977 23531 raft_consensus.cc:1081] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.383126 23334 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46238
I20260709 13:20:38.383711 23334 raft_consensus.cc:493] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.384045 23334 raft_consensus.cc:3060] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.393007 23530 consensus_queue.cc:1048] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.393949 23567 raft_consensus.cc:993] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.394476 23567 raft_consensus.cc:1081] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.394515 23334 raft_consensus.cc:515] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.397624 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:38.398272 23408 raft_consensus.cc:3060] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.398212 23565 consensus_queue.cc:1048] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.405085 23334 leader_election.cc:290] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.400048 23333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46238
I20260709 13:20:38.406677 23333 raft_consensus.cc:493] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.407075 23333 raft_consensus.cc:3060] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.408921 23408 raft_consensus.cc:2468] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:38.409536 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df221801e57f4d60b2e276ea25d5c609" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:38.410179 23484 raft_consensus.cc:3055] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.410483 23484 raft_consensus.cc:740] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:38.410446 23300 leader_election.cc:304] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:38.411573 23484 consensus_queue.cc:260] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.412412 23587 raft_consensus.cc:2804] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.412807 23484 raft_consensus.cc:3060] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.412985 23587 raft_consensus.cc:697] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:38.413990 23587 consensus_queue.cc:237] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.426182 23484 raft_consensus.cc:2468] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:38.426339 23333 raft_consensus.cc:515] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:38.429126 23332 raft_consensus.cc:1240] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Rejecting Update request from peer d55654925a034a05b49afa7b64e1febf for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:38.429927 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:38.432648 23567 consensus_queue.cc:1059] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.433601 23565 raft_consensus.cc:3055] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.434111 23565 raft_consensus.cc:740] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:38.433470 23231 catalog_manager.cc:5697] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from d55654925a034a05b49afa7b64e1febf (127.14.41.67) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.435096 23565 consensus_queue.cc:260] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:38.439378 23565 raft_consensus.cc:3060] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.442674 23333 leader_election.cc:290] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.447829 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be0192c3bed641f28d70fbdc314c602e" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:38.449841 23571 consensus_queue.cc:1048] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.450728 23555 consensus_queue.cc:1048] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.462828 23567 consensus_queue.cc:1048] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.477550 23567 raft_consensus.cc:993] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf: : Instructing follower 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:38.477993 23567 raft_consensus.cc:1081] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Signalling peer 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:38.481269 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:34136
I20260709 13:20:38.481928 23408 raft_consensus.cc:493] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.482410 23408 raft_consensus.cc:3060] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.484454 23531 consensus_queue.cc:1048] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.494589 23408 raft_consensus.cc:515] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.495584 23410 raft_consensus.cc:1240] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Rejecting Update request from peer d55654925a034a05b49afa7b64e1febf for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:38.497860 23567 consensus_queue.cc:1059] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.498313 23408 leader_election.cc:290] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.498739 23567 raft_consensus.cc:3055] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.498991 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:38.499181 23567 raft_consensus.cc:740] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:38.497965 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5abc3429e1c4cb1bdd420b10b7193a8" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:38.500556 23567 consensus_queue.cc:260] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.501782 23567 raft_consensus.cc:3060] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.504643 23484 raft_consensus.cc:2468] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:38.506801 23298 leader_election.cc:304] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:38.507628 23587 raft_consensus.cc:2804] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.508114 23587 raft_consensus.cc:697] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:38.509014 23587 consensus_queue.cc:237] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } }
I20260709 13:20:38.516155 23483 raft_consensus.cc:2468] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:38.518558 23373 leader_election.cc:304] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:38.519430 23572 raft_consensus.cc:2804] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.519948 23572 raft_consensus.cc:697] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:38.520838 23572 consensus_queue.cc:237] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.522415 23231 catalog_manager.cc:5697] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from d55654925a034a05b49afa7b64e1febf (127.14.41.67) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:38.531224 23572 consensus_queue.cc:1048] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.532418 23230 catalog_manager.cc:5697] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 1 to 2, leader changed from d55654925a034a05b49afa7b64e1febf (127.14.41.67) to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 2 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.539095 23530 raft_consensus.cc:993] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.539670 23555 raft_consensus.cc:1081] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:38.542068 23332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46228
I20260709 13:20:38.542717 23332 raft_consensus.cc:493] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.543128 23332 raft_consensus.cc:3060] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.547194 23572 consensus_queue.cc:1048] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:38.550239 23332 raft_consensus.cc:515] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.551281 23333 raft_consensus.cc:1240] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Rejecting Update request from peer 738afc0ebeed4f6eb80163fcd3006efb for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:38.552563 23332 leader_election.cc:290] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.553395 23572 consensus_queue.cc:1059] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.554080 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:38.554419 23555 raft_consensus.cc:3055] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.554814 23555 raft_consensus.cc:740] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:38.555545 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0c42e7d0697419394362b8cfb0d2f11" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:38.555698 23555 consensus_queue.cc:260] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.556187 23483 raft_consensus.cc:3060] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.556948 23555 raft_consensus.cc:3060] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.563777 23483 raft_consensus.cc:2468] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:38.565186 23298 leader_election.cc:304] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:38.566020 23587 raft_consensus.cc:2804] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.566427 23587 raft_consensus.cc:697] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:38.567178 23587 consensus_queue.cc:237] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.570096 23408 raft_consensus.cc:2468] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:38.573544 23231 catalog_manager.cc:5697] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.669401 23547 raft_consensus.cc:993] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4: : Instructing follower 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:38.670009 23587 raft_consensus.cc:1081] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Signalling peer 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:38.671998 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:20:38.672712 23408 raft_consensus.cc:493] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.673122 23408 raft_consensus.cc:3060] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.680760 23408 raft_consensus.cc:515] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.683101 23408 leader_election.cc:290] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:38.684206 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:38.684916 23483 raft_consensus.cc:3060] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.685554 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e6b34608a4742518655634e5c95cee4" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:38.686383 23332 raft_consensus.cc:3055] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.686796 23332 raft_consensus.cc:740] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:38.687805 23332 consensus_queue.cc:260] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.689471 23332 raft_consensus.cc:3060] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.690550 23483 raft_consensus.cc:2468] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:38.691687 23373 leader_election.cc:304] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:38.692423 23555 raft_consensus.cc:2804] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.692916 23555 raft_consensus.cc:697] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:38.693774 23555 consensus_queue.cc:237] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:38.698588 23332 raft_consensus.cc:2468] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:38.702394 23231 catalog_manager.cc:5697] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 1 to 2, leader changed from 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65) to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 2 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.771638 23483 raft_consensus.cc:1275] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.773005 23587 consensus_queue.cc:1048] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.781699 23408 raft_consensus.cc:1275] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.783730 23607 consensus_queue.cc:1048] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.827752 23332 raft_consensus.cc:1275] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.829136 23567 consensus_queue.cc:1048] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.831337 23408 raft_consensus.cc:1275] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.833068 23607 consensus_queue.cc:1048] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.837992 23410 raft_consensus.cc:1275] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.844022 23565 consensus_queue.cc:1048] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.852573 23483 raft_consensus.cc:1275] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.853960 23607 consensus_queue.cc:1048] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.901335 23332 raft_consensus.cc:3060] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.907003 23332 raft_consensus.cc:1275] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.908442 23555 consensus_queue.cc:1048] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.916913 23483 raft_consensus.cc:1275] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.918385 23572 consensus_queue.cc:1048] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.979476 23483 raft_consensus.cc:1275] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.980819 23607 consensus_queue.cc:1048] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.988793 23410 raft_consensus.cc:3060] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.996659 23410 raft_consensus.cc:1275] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.998171 23587 consensus_queue.cc:1048] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.093654 23483 raft_consensus.cc:1275] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.094928 23587 consensus_queue.cc:1048] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.103116 23410 raft_consensus.cc:1275] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.104763 23587 consensus_queue.cc:1048] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.265741 23332 raft_consensus.cc:1275] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.267143 23555 consensus_queue.cc:1048] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:39.271660 23483 raft_consensus.cc:1275] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:39.273047 23555 consensus_queue.cc:1048] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:41.197779 23233 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47700:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:41.199884 23233 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:41.250020 23325 tablet_service.cc:1511] Processing CreateTablet for tablet 64ed631afb5b40deab23c5105b53c92c (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:41.251322 23325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ed631afb5b40deab23c5105b53c92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.251995 23393 tablet_service.cc:1511] Processing CreateTablet for tablet 64ed631afb5b40deab23c5105b53c92c (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:41.253384 23393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ed631afb5b40deab23c5105b53c92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.254838 23467 tablet_service.cc:1511] Processing CreateTablet for tablet 64ed631afb5b40deab23c5105b53c92c (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:41.255224 23319 tablet_service.cc:1511] Processing CreateTablet for tablet a825c60bd0164a5c9e666b550895674c (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:41.256151 23467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ed631afb5b40deab23c5105b53c92c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.258986 23320 tablet_service.cc:1511] Processing CreateTablet for tablet 0ac50ce746d3415d9fafdac4d5b6d7ad (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:41.261672 23470 tablet_service.cc:1511] Processing CreateTablet for tablet a825c60bd0164a5c9e666b550895674c (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:41.263080 23470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a825c60bd0164a5c9e666b550895674c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.270455 23323 tablet_service.cc:1511] Processing CreateTablet for tablet 6328a0664df342d596a4cd4e2d461429 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:41.272647 23321 tablet_service.cc:1511] Processing CreateTablet for tablet 242019cbacb74194aa9ce7408f9621c0 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:41.275274 23472 tablet_service.cc:1511] Processing CreateTablet for tablet 0ac50ce746d3415d9fafdac4d5b6d7ad (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:41.275638 23468 tablet_service.cc:1511] Processing CreateTablet for tablet 6328a0664df342d596a4cd4e2d461429 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:41.276697 23472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac50ce746d3415d9fafdac4d5b6d7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.256585 23319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a825c60bd0164a5c9e666b550895674c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.277384 23468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6328a0664df342d596a4cd4e2d461429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.278836 23474 tablet_service.cc:1511] Processing CreateTablet for tablet 242019cbacb74194aa9ce7408f9621c0 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:41.280151 23474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242019cbacb74194aa9ce7408f9621c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.280308 23323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6328a0664df342d596a4cd4e2d461429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.283458 23321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242019cbacb74194aa9ce7408f9621c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.283702 23317 tablet_service.cc:1511] Processing CreateTablet for tablet 292f35692307405f8137fab0ccb56b42 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:41.285060 23317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292f35692307405f8137fab0ccb56b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.289708 23473 tablet_service.cc:1511] Processing CreateTablet for tablet 292f35692307405f8137fab0ccb56b42 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:41.291134 23473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292f35692307405f8137fab0ccb56b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.292973 23320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac50ce746d3415d9fafdac4d5b6d7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.300153 23324 tablet_service.cc:1511] Processing CreateTablet for tablet 17d977355e4c47b0b512afd66397f579 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:41.300467 23322 tablet_service.cc:1511] Processing CreateTablet for tablet 0d140b9e8bb443d59f1825a41cf7c678 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:41.301604 23475 tablet_service.cc:1511] Processing CreateTablet for tablet 0d140b9e8bb443d59f1825a41cf7c678 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:41.301661 23324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d977355e4c47b0b512afd66397f579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.303798 23322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d140b9e8bb443d59f1825a41cf7c678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.302636 23469 tablet_service.cc:1511] Processing CreateTablet for tablet 17d977355e4c47b0b512afd66397f579 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:41.304095 23471 tablet_service.cc:1511] Processing CreateTablet for tablet 5baac476c5b34c1997d95e49815a9e08 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:41.302977 23475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d140b9e8bb443d59f1825a41cf7c678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.302698 23318 tablet_service.cc:1511] Processing CreateTablet for tablet 5baac476c5b34c1997d95e49815a9e08 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:41.307116 23318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5baac476c5b34c1997d95e49815a9e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.308328 23400 tablet_service.cc:1511] Processing CreateTablet for tablet a825c60bd0164a5c9e666b550895674c (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:41.309116 23394 tablet_service.cc:1511] Processing CreateTablet for tablet 0ac50ce746d3415d9fafdac4d5b6d7ad (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:41.309655 23400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a825c60bd0164a5c9e666b550895674c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.310403 23394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ac50ce746d3415d9fafdac4d5b6d7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.313216 23469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d977355e4c47b0b512afd66397f579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.313949 23471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5baac476c5b34c1997d95e49815a9e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.325057 23397 tablet_service.cc:1511] Processing CreateTablet for tablet 6328a0664df342d596a4cd4e2d461429 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:41.326534 23397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6328a0664df342d596a4cd4e2d461429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.328634 23398 tablet_service.cc:1511] Processing CreateTablet for tablet 292f35692307405f8137fab0ccb56b42 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:41.329622 23396 tablet_service.cc:1511] Processing CreateTablet for tablet 242019cbacb74194aa9ce7408f9621c0 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:41.330081 23398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 292f35692307405f8137fab0ccb56b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.331032 23396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242019cbacb74194aa9ce7408f9621c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.332195 23399 tablet_service.cc:1511] Processing CreateTablet for tablet 17d977355e4c47b0b512afd66397f579 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:41.333508 23399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d977355e4c47b0b512afd66397f579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.335021 23392 tablet_service.cc:1511] Processing CreateTablet for tablet 5baac476c5b34c1997d95e49815a9e08 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:41.335845 23395 tablet_service.cc:1511] Processing CreateTablet for tablet 0d140b9e8bb443d59f1825a41cf7c678 (DEFAULT_TABLE table=soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:41.336275 23392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5baac476c5b34c1997d95e49815a9e08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.337153 23395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d140b9e8bb443d59f1825a41cf7c678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:41.362092 23623 tablet_bootstrap.cc:492] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.378687 23625 tablet_bootstrap.cc:492] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:41.385387 23625 tablet_bootstrap.cc:654] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.453714 23626 tablet_bootstrap.cc:492] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.477955 23625 tablet_bootstrap.cc:492] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.478609 23625 ts_tablet_manager.cc:1403] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.100s	user 0.040s	sys 0.043s
I20260709 13:20:41.481935 23625 raft_consensus.cc:359] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.482714 23625 raft_consensus.cc:385] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.483057 23625 raft_consensus.cc:740] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.484200 23626 tablet_bootstrap.cc:654] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.483851 23625 consensus_queue.cc:260] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.491621 23625 ts_tablet_manager.cc:1434] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:20:41.493032 23625 tablet_bootstrap.cc:492] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
W20260709 13:20:41.499621 23281 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:41.499890 23625 tablet_bootstrap.cc:654] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.505687 23626 tablet_bootstrap.cc:492] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.506453 23626 ts_tablet_manager.cc:1403] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.003s
I20260709 13:20:41.517246 23626 raft_consensus.cc:359] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.518378 23626 raft_consensus.cc:385] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.518788 23626 raft_consensus.cc:740] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.520015 23626 consensus_queue.cc:260] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.523633 23626 ts_tablet_manager.cc:1434] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 13:20:41.525285 23626 tablet_bootstrap.cc:492] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.536866 23626 tablet_bootstrap.cc:654] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.551299 23626 tablet_bootstrap.cc:492] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.552078 23626 ts_tablet_manager.cc:1403] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.004s
I20260709 13:20:41.556422 23626 raft_consensus.cc:359] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.557246 23626 raft_consensus.cc:385] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.557844 23626 raft_consensus.cc:740] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.559051 23623 tablet_bootstrap.cc:654] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.558714 23626 consensus_queue.cc:260] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
W20260709 13:20:41.557199 23373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:41431, user_credentials={real_user=slave}} blocked reactor thread for 84283.9us
I20260709 13:20:41.563485 23626 ts_tablet_manager.cc:1434] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.007s
I20260709 13:20:41.565133 23625 tablet_bootstrap.cc:492] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.565699 23625 ts_tablet_manager.cc:1403] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.043s
I20260709 13:20:41.565811 23626 tablet_bootstrap.cc:492] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.566509 23623 tablet_bootstrap.cc:492] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:41.567102 23623 ts_tablet_manager.cc:1403] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.206s	user 0.007s	sys 0.009s
I20260709 13:20:41.570434 23623 raft_consensus.cc:359] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.571323 23623 raft_consensus.cc:385] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.571724 23623 raft_consensus.cc:740] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.572510 23625 raft_consensus.cc:359] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.572527 23623 consensus_queue.cc:260] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.573395 23626 tablet_bootstrap.cc:654] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.573479 23625 raft_consensus.cc:385] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.574025 23625 raft_consensus.cc:740] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.574962 23625 consensus_queue.cc:260] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.579358 23623 ts_tablet_manager.cc:1434] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:41.581189 23623 tablet_bootstrap.cc:492] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.586169 23626 tablet_bootstrap.cc:492] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.579504 23625 ts_tablet_manager.cc:1434] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.007s
I20260709 13:20:41.586838 23626 ts_tablet_manager.cc:1403] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:20:41.587723 23625 tablet_bootstrap.cc:492] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:41.590188 23626 raft_consensus.cc:359] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.590962 23626 raft_consensus.cc:385] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.591281 23626 raft_consensus.cc:740] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.592339 23626 consensus_queue.cc:260] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.594836 23626 ts_tablet_manager.cc:1434] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:41.595924 23626 tablet_bootstrap.cc:492] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.597586 23623 tablet_bootstrap.cc:654] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.603227 23626 tablet_bootstrap.cc:654] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.598569 23625 tablet_bootstrap.cc:654] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.610890 23623 tablet_bootstrap.cc:492] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:41.611584 23623 ts_tablet_manager.cc:1403] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.010s
I20260709 13:20:41.613547 23626 tablet_bootstrap.cc:492] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.613619 23625 tablet_bootstrap.cc:492] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.614238 23626 ts_tablet_manager.cc:1403] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:20:41.614328 23625 ts_tablet_manager.cc:1403] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.005s
I20260709 13:20:41.615422 23623 raft_consensus.cc:359] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.616291 23623 raft_consensus.cc:385] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.616612 23623 raft_consensus.cc:740] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.617244 23625 raft_consensus.cc:359] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.617925 23625 raft_consensus.cc:385] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.617386 23623 consensus_queue.cc:260] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.617615 23626 raft_consensus.cc:359] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.618247 23625 raft_consensus.cc:740] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.618539 23626 raft_consensus.cc:385] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.618888 23626 raft_consensus.cc:740] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.619062 23625 consensus_queue.cc:260] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.619791 23626 consensus_queue.cc:260] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.620544 23623 ts_tablet_manager.cc:1434] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:41.621622 23623 tablet_bootstrap.cc:492] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.621938 23625 ts_tablet_manager.cc:1434] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:41.622453 23626 ts_tablet_manager.cc:1434] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:20:41.623101 23625 tablet_bootstrap.cc:492] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:41.623518 23626 tablet_bootstrap.cc:492] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.629029 23623 tablet_bootstrap.cc:654] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.630227 23625 tablet_bootstrap.cc:654] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.631111 23626 tablet_bootstrap.cc:654] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.634989 23567 raft_consensus.cc:493] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.635725 23567 raft_consensus.cc:515] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.638636 23567 leader_election.cc:290] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:41.640739 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:41.641750 23410 raft_consensus.cc:2468] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
I20260709 13:20:41.640739 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
W20260709 13:20:41.645057 23447 leader_election.cc:343] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.647578 23449 leader_election.cc:304] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:41.649286 23567 raft_consensus.cc:2804] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.649816 23567 raft_consensus.cc:493] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.650257 23567 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.656502 23625 tablet_bootstrap.cc:492] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.657063 23625 ts_tablet_manager.cc:1403] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.009s
I20260709 13:20:41.659243 23625 raft_consensus.cc:359] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.659765 23625 raft_consensus.cc:385] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.659950 23625 raft_consensus.cc:740] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.660566 23625 consensus_queue.cc:260] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.662341 23625 ts_tablet_manager.cc:1434] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:20:41.662935 23623 tablet_bootstrap.cc:492] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:41.663595 23623 ts_tablet_manager.cc:1403] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.005s
I20260709 13:20:41.663724 23625 tablet_bootstrap.cc:492] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:41.665297 23626 tablet_bootstrap.cc:492] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.667157 23623 raft_consensus.cc:359] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.668046 23623 raft_consensus.cc:385] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.668443 23623 raft_consensus.cc:740] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.669296 23623 consensus_queue.cc:260] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.671384 23625 tablet_bootstrap.cc:654] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.671510 23626 ts_tablet_manager.cc:1403] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.008s
I20260709 13:20:41.676229 23623 ts_tablet_manager.cc:1434] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 13:20:41.676994 23626 raft_consensus.cc:359] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.677805 23626 raft_consensus.cc:385] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.678124 23626 raft_consensus.cc:740] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.678998 23626 consensus_queue.cc:260] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.681190 23623 tablet_bootstrap.cc:492] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.687117 23624 raft_consensus.cc:493] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.687889 23624 raft_consensus.cc:515] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.689499 23623 tablet_bootstrap.cc:654] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.694141 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:41.695981 23624 leader_election.cc:290] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
W20260709 13:20:41.697523 23300 leader_election.cc:343] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.699656 23624 raft_consensus.cc:493] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.679526 23567 raft_consensus.cc:515] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.700259 23624 raft_consensus.cc:515] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.705799 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:41.706818 23623 tablet_bootstrap.cc:492] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:41.706920 23625 tablet_bootstrap.cc:492] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.707571 23623 ts_tablet_manager.cc:1403] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 13:20:41.707633 23625 ts_tablet_manager.cc:1403] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.010s
I20260709 13:20:41.710942 23623 raft_consensus.cc:359] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.711700 23623 raft_consensus.cc:385] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.711990 23623 raft_consensus.cc:740] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.712735 23623 consensus_queue.cc:260] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.715508 23624 leader_election.cc:290] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
W20260709 13:20:41.715667 23298 leader_election.cc:343] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.716161 23298 leader_election.cc:304] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4; no voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:41.717131 23567 leader_election.cc:290] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:41.717870 23624 raft_consensus.cc:2749] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.718852 23623 ts_tablet_manager.cc:1434] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:20:41.719647 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:41.720141 23623 tablet_bootstrap.cc:492] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.720305 23410 raft_consensus.cc:2468] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 0.
I20260709 13:20:41.720655 23626 ts_tablet_manager.cc:1434] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.049s	user 0.013s	sys 0.013s
I20260709 13:20:41.721840 23626 tablet_bootstrap.cc:492] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.722576 23300 leader_election.cc:304] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:41.718950 23625 raft_consensus.cc:359] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.724197 23625 raft_consensus.cc:385] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.724481 23625 raft_consensus.cc:740] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.724632 23612 raft_consensus.cc:2804] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.725116 23612 raft_consensus.cc:493] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.725497 23612 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.725301 23625 consensus_queue.cc:260] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.727499 23623 tablet_bootstrap.cc:654] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.734970 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:41.735756 23410 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.735872 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:41.737082 23626 tablet_bootstrap.cc:654] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.742970 23625 ts_tablet_manager.cc:1434] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.003s
I20260709 13:20:41.744204 23625 tablet_bootstrap.cc:492] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:41.745122 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:41.745350 23642 raft_consensus.cc:493] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.746057 23484 raft_consensus.cc:2393] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in current term 1: Already voted for candidate d55654925a034a05b49afa7b64e1febf in this term.
I20260709 13:20:41.745915 23642 raft_consensus.cc:515] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.746651 23612 raft_consensus.cc:515] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.754716 23612 leader_election.cc:290] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:41.755178 23642 leader_election.cc:290] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:41.755586 23332 raft_consensus.cc:2393] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d55654925a034a05b49afa7b64e1febf in current term 1: Already voted for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in this term.
I20260709 13:20:41.757699 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:41.758415 23333 raft_consensus.cc:2468] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
I20260709 13:20:41.758823 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:41.760888 23447 leader_election.cc:304] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:41.762074 23642 raft_consensus.cc:2804] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.762437 23642 raft_consensus.cc:493] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.762742 23642 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.769186 23567 raft_consensus.cc:493] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.770085 23410 raft_consensus.cc:2468] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:41.769953 23567 raft_consensus.cc:515] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.771281 23642 raft_consensus.cc:515] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.771991 23625 tablet_bootstrap.cc:654] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.772212 23567 leader_election.cc:290] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:41.773725 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:41.774096 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5baac476c5b34c1997d95e49815a9e08" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:41.774044 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5baac476c5b34c1997d95e49815a9e08" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:41.775041 23408 raft_consensus.cc:2468] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
W20260709 13:20:41.776008 23447 leader_election.cc:343] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.773653 23449 leader_election.cc:304] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:41.776479 23623 tablet_bootstrap.cc:492] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:41.777432 23567 raft_consensus.cc:2804] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.777738 23623 ts_tablet_manager.cc:1403] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.019s
I20260709 13:20:41.778342 23628 raft_consensus.cc:493] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.778496 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:41.778880 23628 raft_consensus.cc:515] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.779211 23567 raft_consensus.cc:697] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:41.780298 23567 consensus_queue.cc:237] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.781186 23628 leader_election.cc:290] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:41.782002 23623 raft_consensus.cc:359] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
W20260709 13:20:41.782662 23449 leader_election.cc:343] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.782958 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:41.783085 23623 raft_consensus.cc:385] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.783646 23623 raft_consensus.cc:740] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.783804 23449 leader_election.cc:304] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:41.784974 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:41.785647 23642 leader_election.cc:290] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
W20260709 13:20:41.787074 23373 leader_election.cc:343] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.787271 23642 raft_consensus.cc:2804] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.787642 23642 raft_consensus.cc:493] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.787775 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:41.788004 23642 raft_consensus.cc:3060] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.788542 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:41.789197 23332 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.777010 23626 tablet_bootstrap.cc:492] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.793689 23626 ts_tablet_manager.cc:1403] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.005s
I20260709 13:20:41.795691 23642 raft_consensus.cc:515] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.783715 23333 raft_consensus.cc:2468] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:41.797780 23373 leader_election.cc:304] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: d55654925a034a05b49afa7b64e1febf
I20260709 13:20:41.798525 23642 leader_election.cc:290] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:41.798103 23626 raft_consensus.cc:359] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.784906 23623 consensus_queue.cc:260] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.799003 23626 raft_consensus.cc:385] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.799033 23628 raft_consensus.cc:2804] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.799461 23626 raft_consensus.cc:740] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.799691 23408 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.799614 23628 raft_consensus.cc:493] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.800318 23626 consensus_queue.cc:260] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.801013 23623 ts_tablet_manager.cc:1434] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:20:41.801199 23628 raft_consensus.cc:3060] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.802160 23623 tablet_bootstrap.cc:492] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.803021 23626 ts_tablet_manager.cc:1434] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:20:41.799214 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5baac476c5b34c1997d95e49815a9e08" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:41.804211 23410 raft_consensus.cc:3060] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.804492 23626 tablet_bootstrap.cc:492] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.809665 23623 tablet_bootstrap.cc:654] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.810138 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5baac476c5b34c1997d95e49815a9e08" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:41.811825 23626 tablet_bootstrap.cc:654] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:41.811834 23447 leader_election.cc:343] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.815066 23332 raft_consensus.cc:2468] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:41.820236 23408 raft_consensus.cc:2468] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:41.831646 23410 raft_consensus.cc:2468] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:41.844439 23623 tablet_bootstrap.cc:492] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:41.845312 23623 ts_tablet_manager.cc:1403] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.031s
I20260709 13:20:41.821874 23447 leader_election.cc:304] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:41.849757 23623 raft_consensus.cc:359] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.850970 23623 raft_consensus.cc:385] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.851385 23623 raft_consensus.cc:740] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.852459 23623 consensus_queue.cc:260] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.856031 23623 ts_tablet_manager.cc:1434] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:20:41.857214 23642 raft_consensus.cc:2804] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.857429 23449 leader_election.cc:304] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:41.857892 23642 raft_consensus.cc:697] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:41.858911 23298 leader_election.cc:304] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4; no voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:41.858839 23642 consensus_queue.cc:237] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.860735 23612 raft_consensus.cc:2749] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.862274 23623 tablet_bootstrap.cc:492] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.867228 23567 raft_consensus.cc:493] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.868013 23640 raft_consensus.cc:2804] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.870311 23640 raft_consensus.cc:697] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:41.871469 23640 consensus_queue.cc:237] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.822794 23628 raft_consensus.cc:515] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.874913 23628 leader_election.cc:290] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:41.888484 23623 tablet_bootstrap.cc:654] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.888931 23626 tablet_bootstrap.cc:492] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.888932 23625 tablet_bootstrap.cc:492] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.889644 23626 ts_tablet_manager.cc:1403] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.086s	user 0.040s	sys 0.025s
I20260709 13:20:41.889468 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:41.889783 23625 ts_tablet_manager.cc:1403] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.146s	user 0.039s	sys 0.041s
I20260709 13:20:41.890754 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:41.893112 23626 raft_consensus.cc:359] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.893658 23625 raft_consensus.cc:359] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.868072 23567 raft_consensus.cc:515] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.897948 23332 raft_consensus.cc:3060] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.898824 23626 raft_consensus.cc:385] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.899149 23626 raft_consensus.cc:740] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.888780 23230 catalog_manager.cc:5697] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 0 to 1, leader changed from <none> to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:41.898088 23625 raft_consensus.cc:385] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.897006 23623 tablet_bootstrap.cc:492] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:41.900084 23625 raft_consensus.cc:740] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.899928 23626 consensus_queue.cc:260] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.900686 23623 ts_tablet_manager.cc:1403] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.003s
I20260709 13:20:41.904250 23484 raft_consensus.cc:3060] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.908010 23626 ts_tablet_manager.cc:1434] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:20:41.908628 23625 consensus_queue.cc:260] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.912590 23626 tablet_bootstrap.cc:492] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.914316 23567 leader_election.cc:290] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:41.915908 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:41.916522 23623 raft_consensus.cc:359] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
W20260709 13:20:41.917351 23449 leader_election.cc:343] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.917796 23623 raft_consensus.cc:385] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.918138 23623 raft_consensus.cc:740] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.918870 23623 consensus_queue.cc:260] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.920681 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:41.921154 23625 ts_tablet_manager.cc:1434] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:20:41.922272 23625 tablet_bootstrap.cc:492] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
W20260709 13:20:41.922183 23447 leader_election.cc:343] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.922806 23447 leader_election.cc:304] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:41.924043 23567 raft_consensus.cc:2749] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.933184 23626 tablet_bootstrap.cc:654] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.933427 23625 tablet_bootstrap.cc:654] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.934264 23623 ts_tablet_manager.cc:1434] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.004s
I20260709 13:20:41.939083 23484 raft_consensus.cc:2468] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:41.941797 23373 leader_election.cc:304] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:41.943281 23530 raft_consensus.cc:2804] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.943953 23530 raft_consensus.cc:697] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:41.944974 23530 consensus_queue.cc:237] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.947281 23628 raft_consensus.cc:493] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.948042 23628 raft_consensus.cc:515] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.950739 23628 leader_election.cc:290] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:41.952023 23623 tablet_bootstrap.cc:492] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:41.953194 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
W20260709 13:20:41.954717 23373 leader_election.cc:343] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.955687 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:41.956787 23484 raft_consensus.cc:2468] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:41.959476 23626 tablet_bootstrap.cc:492] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:41.960031 23626 ts_tablet_manager.cc:1403] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.004s
I20260709 13:20:41.960462 23373 leader_election.cc:304] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:41.961370 23628 raft_consensus.cc:2804] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.961755 23628 raft_consensus.cc:493] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.962100 23628 raft_consensus.cc:3060] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.962793 23623 tablet_bootstrap.cc:654] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.959491 23625 tablet_bootstrap.cc:492] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.963835 23625 ts_tablet_manager.cc:1403] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:20:41.967626 23625 raft_consensus.cc:359] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.968808 23625 raft_consensus.cc:385] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.962839 23626 raft_consensus.cc:359] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.969206 23625 raft_consensus.cc:740] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.969339 23626 raft_consensus.cc:385] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.969803 23626 raft_consensus.cc:740] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.970502 23626 consensus_queue.cc:260] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.970517 23625 consensus_queue.cc:260] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.973093 23626 ts_tablet_manager.cc:1434] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
I20260709 13:20:41.973227 23625 ts_tablet_manager.cc:1434] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:41.974098 23626 tablet_bootstrap.cc:492] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf: Bootstrap starting.
I20260709 13:20:41.974728 23625 tablet_bootstrap.cc:492] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:41.977490 23642 raft_consensus.cc:493] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.978077 23642 raft_consensus.cc:515] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.981571 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:41.982201 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:41.981592 23642 leader_election.cc:290] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:41.983644 23625 tablet_bootstrap.cc:654] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.978099 23332 raft_consensus.cc:2468] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
W20260709 13:20:41.984016 23449 leader_election.cc:343] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.982319 23333 raft_consensus.cc:2468] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 0.
I20260709 13:20:41.985917 23447 leader_election.cc:304] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:41.987224 23642 raft_consensus.cc:2804] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.987680 23642 raft_consensus.cc:493] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.988123 23642 raft_consensus.cc:3060] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.987775 23628 raft_consensus.cc:515] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:41.988862 23626 tablet_bootstrap.cc:654] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.990931 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
W20260709 13:20:41.992373 23373 leader_election.cc:343] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.995967 23625 tablet_bootstrap.cc:492] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:41.996788 23625 ts_tablet_manager.cc:1403] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:20:41.997064 23642 raft_consensus.cc:515] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.006255 23628 leader_election.cc:290] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.007175 23625 raft_consensus.cc:359] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.008239 23642 leader_election.cc:290] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:42.012001 23625 raft_consensus.cc:385] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.012486 23625 raft_consensus.cc:740] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.014025 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:42.015049 23623 tablet_bootstrap.cc:492] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:42.014142 23231 catalog_manager.cc:5697] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 1 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.015573 23623 ts_tablet_manager.cc:1403] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.013s
I20260709 13:20:42.017165 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.017803 23484 raft_consensus.cc:3060] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.018656 23623 raft_consensus.cc:359] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.019373 23623 raft_consensus.cc:385] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.019634 23623 raft_consensus.cc:740] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.018666 23625 consensus_queue.cc:260] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.020823 23623 consensus_queue.cc:260] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
W20260709 13:20:42.015671 23449 leader_election.cc:343] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:42.022676 23625 ts_tablet_manager.cc:1434] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:20:42.023021 23623 ts_tablet_manager.cc:1434] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:42.023775 23625 tablet_bootstrap.cc:492] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Bootstrap starting.
I20260709 13:20:42.024138 23623 tablet_bootstrap.cc:492] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: Bootstrap starting.
I20260709 13:20:42.030506 23623 tablet_bootstrap.cc:654] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.031491 23626 tablet_bootstrap.cc:492] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf: No bootstrap required, opened a new log
I20260709 13:20:42.032020 23626 ts_tablet_manager.cc:1403] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.016s
I20260709 13:20:42.032642 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:42.033340 23332 raft_consensus.cc:3060] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.035074 23484 raft_consensus.cc:2468] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:42.034814 23626 raft_consensus.cc:359] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.035598 23626 raft_consensus.cc:385] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.035902 23626 raft_consensus.cc:740] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.036521 23626 consensus_queue.cc:260] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.037109 23625 tablet_bootstrap.cc:654] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:42.038708 23626 ts_tablet_manager.cc:1434] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:42.040782 23373 leader_election.cc:304] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:42.041903 23628 raft_consensus.cc:2804] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.042403 23628 raft_consensus.cc:697] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.043223 23628 consensus_queue.cc:237] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.046154 23332 raft_consensus.cc:2468] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 1.
I20260709 13:20:42.047755 23447 leader_election.cc:304] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:42.048635 23642 raft_consensus.cc:2804] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.049147 23642 raft_consensus.cc:697] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:42.049966 23642 consensus_queue.cc:237] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.061744 23232 catalog_manager.cc:5697] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 0 to 1, leader changed from <none> to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:42.072707 23612 raft_consensus.cc:493] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.073446 23612 raft_consensus.cc:515] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.075130 23625 tablet_bootstrap.cc:492] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: No bootstrap required, opened a new log
I20260709 13:20:42.071396 23232 catalog_manager.cc:5697] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 0 to 1, leader changed from <none> to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:42.075927 23625 ts_tablet_manager.cc:1403] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent bootstrapping tablet: real 0.052s	user 0.022s	sys 0.009s
I20260709 13:20:42.077353 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5baac476c5b34c1997d95e49815a9e08" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:42.079728 23612 leader_election.cc:290] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.079932 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5baac476c5b34c1997d95e49815a9e08" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:42.080832 23410 raft_consensus.cc:2393] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in current term 1: Already voted for candidate d55654925a034a05b49afa7b64e1febf in this term.
I20260709 13:20:42.082094 23300 leader_election.cc:304] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4; no voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:42.083756 23623 tablet_bootstrap.cc:492] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: No bootstrap required, opened a new log
I20260709 13:20:42.084360 23623 ts_tablet_manager.cc:1403] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent bootstrapping tablet: real 0.060s	user 0.033s	sys 0.011s
I20260709 13:20:42.084537 23612 raft_consensus.cc:3060] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.085999 23625 raft_consensus.cc:359] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.086779 23625 raft_consensus.cc:385] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.087066 23625 raft_consensus.cc:740] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.087790 23625 consensus_queue.cc:260] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.088136 23623 raft_consensus.cc:359] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.088946 23623 raft_consensus.cc:385] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:42.089233 23623 raft_consensus.cc:740] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Initialized, Role: FOLLOWER
I20260709 13:20:42.090029 23623 consensus_queue.cc:260] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.091436 23625 ts_tablet_manager.cc:1434] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 13:20:42.092496 23623 ts_tablet_manager.cc:1434] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:20:42.095283 23231 catalog_manager.cc:5697] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 1 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.095794 23612 raft_consensus.cc:2749] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.107657 23230 catalog_manager.cc:5697] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 0 to 1, leader changed from <none> to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 1 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:42.109467 23612 raft_consensus.cc:493] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.109992 23612 raft_consensus.cc:515] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.114456 23612 leader_election.cc:290] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.115557 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d977355e4c47b0b512afd66397f579" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:42.115669 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d977355e4c47b0b512afd66397f579" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:42.116405 23484 raft_consensus.cc:2468] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 0.
I20260709 13:20:42.116475 23410 raft_consensus.cc:2468] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 0.
I20260709 13:20:42.117619 23298 leader_election.cc:304] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.118496 23612 raft_consensus.cc:2804] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.118870 23612 raft_consensus.cc:493] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.119227 23612 raft_consensus.cc:3060] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.125257 23612 raft_consensus.cc:515] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.126824 23612 leader_election.cc:290] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.127700 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d977355e4c47b0b512afd66397f579" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:42.127803 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d977355e4c47b0b512afd66397f579" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.128284 23410 raft_consensus.cc:3060] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.128487 23484 raft_consensus.cc:3060] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.128497 23612 raft_consensus.cc:493] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.129294 23612 raft_consensus.cc:515] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.132365 23612 leader_election.cc:290] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.132733 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:42.133507 23483 raft_consensus.cc:2468] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 0.
I20260709 13:20:42.132365 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:42.134805 23298 leader_election.cc:304] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.134969 23408 raft_consensus.cc:2468] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 0.
I20260709 13:20:42.135187 23410 raft_consensus.cc:2468] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 1.
I20260709 13:20:42.135787 23612 raft_consensus.cc:2804] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.135949 23484 raft_consensus.cc:2468] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 1.
I20260709 13:20:42.136132 23612 raft_consensus.cc:493] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.136678 23612 raft_consensus.cc:3060] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.137329 23298 leader_election.cc:304] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.138206 23624 raft_consensus.cc:2804] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.138669 23624 raft_consensus.cc:697] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.139415 23624 consensus_queue.cc:237] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.142809 23612 raft_consensus.cc:515] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.145951 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:42.146286 23612 leader_election.cc:290] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.146595 23410 raft_consensus.cc:3060] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.146523 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.147517 23484 raft_consensus.cc:3060] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.149598 23231 catalog_manager.cc:5697] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.153898 23410 raft_consensus.cc:2468] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 1.
I20260709 13:20:42.155135 23300 leader_election.cc:304] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:42.156076 23612 raft_consensus.cc:2804] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.155310 23484 raft_consensus.cc:2468] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 1.
I20260709 13:20:42.156589 23612 raft_consensus.cc:697] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.157505 23612 consensus_queue.cc:237] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.164191 23628 raft_consensus.cc:493] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.164778 23628 raft_consensus.cc:515] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.166496 23628 leader_election.cc:290] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.166136 23231 catalog_manager.cc:5697] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 1 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.167258 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:42.167493 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:42.167937 23332 raft_consensus.cc:2468] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:42.168123 23484 raft_consensus.cc:2468] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 0.
I20260709 13:20:42.169027 23373 leader_election.cc:304] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:42.169654 23628 raft_consensus.cc:2804] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:42.170037 23628 raft_consensus.cc:493] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:42.170369 23628 raft_consensus.cc:3060] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.177651 23628 raft_consensus.cc:515] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.179502 23628 leader_election.cc:290] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.180190 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:42.180405 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.180855 23332 raft_consensus.cc:3060] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.181054 23484 raft_consensus.cc:3060] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.186262 23484 raft_consensus.cc:2468] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:42.187312 23373 leader_election.cc:304] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.187372 23332 raft_consensus.cc:2468] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 1.
I20260709 13:20:42.188061 23628 raft_consensus.cc:2804] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:42.188664 23628 raft_consensus.cc:697] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.189483 23628 consensus_queue.cc:237] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.197104 23612 raft_consensus.cc:493] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.196853 23231 catalog_manager.cc:5697] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 0 to 1, leader changed from <none> to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 1 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.197669 23612 raft_consensus.cc:515] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.200124 23612 leader_election.cc:290] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.200366 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb" is_pre_election: true
I20260709 13:20:42.202059 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:42.202744 23484 raft_consensus.cc:2393] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in current term 1: Already voted for candidate 738afc0ebeed4f6eb80163fcd3006efb in this term.
I20260709 13:20:42.203749 23298 leader_election.cc:304] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4; no voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:42.204888 23612 raft_consensus.cc:3060] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.210294 23612 raft_consensus.cc:2749] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.248551 23642 consensus_queue.cc:1048] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.259958 23567 consensus_queue.cc:1048] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.293516 23567 consensus_queue.cc:1048] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.294927 23567 consensus_queue.cc:1048] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.309135 23652 consensus_queue.cc:1048] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.316183 23567 consensus_queue.cc:1048] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.356343 23410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:20:42.356957 23410 raft_consensus.cc:606] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:42.362318 23410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:20:42.362844 23410 raft_consensus.cc:606] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:42.363044 23628 consensus_queue.cc:1048] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.369333 23484 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:40148
I20260709 13:20:42.369971 23484 raft_consensus.cc:606] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:42.372135 23659 raft_consensus.cc:993] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.372728 23659 raft_consensus.cc:1081] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.378520 23332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46228
I20260709 13:20:42.379184 23332 raft_consensus.cc:493] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.379621 23332 raft_consensus.cc:3060] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.386467 23530 consensus_queue.cc:1048] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:42.386801 23410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
mode: GRACEFUL
new_leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:34150
I20260709 13:20:42.387660 23410 raft_consensus.cc:606] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Received request to transfer leadership to TS 5e58c4e5ee784a64bd7f5ab1045d33f4
I20260709 13:20:42.386538 23332 raft_consensus.cc:515] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.393432 23332 leader_election.cc:290] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.394265 23485 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
mode: GRACEFUL
new_leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:40148
I20260709 13:20:42.395015 23485 raft_consensus.cc:606] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Received request to transfer leadership to TS 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:42.395975 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.396577 23483 raft_consensus.cc:3060] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.399861 23530 raft_consensus.cc:493] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:42.400430 23530 raft_consensus.cc:515] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.401676 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64ed631afb5b40deab23c5105b53c92c" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:42.402158 23410 raft_consensus.cc:3055] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.402448 23410 raft_consensus.cc:740] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.402540 23530 leader_election.cc:290] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.403311 23410 consensus_queue.cc:260] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.403927 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d55654925a034a05b49afa7b64e1febf" is_pre_election: true
I20260709 13:20:42.404563 23410 raft_consensus.cc:3060] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.405156 23333 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "292f35692307405f8137fab0ccb56b42"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
mode: GRACEFUL
new_leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:46244
I20260709 13:20:42.405557 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" is_pre_election: true
I20260709 13:20:42.405776 23333 raft_consensus.cc:606] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Received request to transfer leadership to TS 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:42.405972 23483 raft_consensus.cc:2468] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.406308 23332 raft_consensus.cc:2393] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 738afc0ebeed4f6eb80163fcd3006efb in current term 1: Already voted for candidate d55654925a034a05b49afa7b64e1febf in this term.
I20260709 13:20:42.407917 23373 leader_election.cc:304] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb; no voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf
I20260709 13:20:42.408960 23530 raft_consensus.cc:3060] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:42.409612 23298 leader_election.cc:304] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.410560 23612 raft_consensus.cc:2804] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.411029 23612 raft_consensus.cc:697] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.411410 23410 raft_consensus.cc:2468] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.411854 23612 consensus_queue.cc:237] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.417025 23332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d977355e4c47b0b512afd66397f579"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
mode: GRACEFUL
new_leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:46244
I20260709 13:20:42.417615 23332 raft_consensus.cc:606] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Received request to transfer leadership to TS 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:42.424508 23530 raft_consensus.cc:2749] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:42.424726 23483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
mode: GRACEFUL
new_leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:40148
I20260709 13:20:42.425433 23483 raft_consensus.cc:606] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Received request to transfer leadership to TS 738afc0ebeed4f6eb80163fcd3006efb
I20260709 13:20:42.425509 23231 catalog_manager.cc:5697] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.446739 23530 consensus_queue.cc:1048] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.453469 23628 raft_consensus.cc:993] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.454030 23682 raft_consensus.cc:1081] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.457273 23333 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46228
I20260709 13:20:42.457895 23333 raft_consensus.cc:493] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.458336 23333 raft_consensus.cc:3060] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.459267 23530 consensus_queue.cc:1048] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:42.466737 23333 raft_consensus.cc:515] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.470547 23333 leader_election.cc:290] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.471367 23410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:42.472024 23410 raft_consensus.cc:3055] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.472359 23410 raft_consensus.cc:740] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.472406 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a825c60bd0164a5c9e666b550895674c" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.473197 23483 raft_consensus.cc:3060] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.473330 23410 consensus_queue.cc:260] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.475008 23410 raft_consensus.cc:3060] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.479092 23483 raft_consensus.cc:2468] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.479902 23410 raft_consensus.cc:2468] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.480427 23298 leader_election.cc:304] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.481348 23612 raft_consensus.cc:2804] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.481757 23612 raft_consensus.cc:697] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.482515 23612 consensus_queue.cc:237] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.489862 23230 catalog_manager.cc:5697] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.528836 23612 consensus_queue.cc:1048] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.535928 23624 raft_consensus.cc:993] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: : Instructing follower 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.536583 23644 raft_consensus.cc:1081] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Signalling peer 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.542459 23624 consensus_queue.cc:1048] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.542737 23410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d977355e4c47b0b512afd66397f579"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:20:42.546334 23410 raft_consensus.cc:493] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.546770 23410 raft_consensus.cc:3060] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.549191 23612 consensus_queue.cc:1048] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:42.555243 23410 raft_consensus.cc:515] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.559598 23410 leader_election.cc:290] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.560650 23333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d977355e4c47b0b512afd66397f579" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:42.561416 23333 raft_consensus.cc:3055] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.561754 23333 raft_consensus.cc:740] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.562677 23333 consensus_queue.cc:260] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.564072 23333 raft_consensus.cc:3060] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.568363 23644 consensus_queue.cc:1048] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:42.561744 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d977355e4c47b0b512afd66397f579" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.569796 23485 raft_consensus.cc:3060] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.574846 23567 consensus_queue.cc:1048] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:42.576423 23624 raft_consensus.cc:993] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: : Instructing follower 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.576987 23624 raft_consensus.cc:1081] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Signalling peer 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.578703 23410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "292f35692307405f8137fab0ccb56b42"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:34120
I20260709 13:20:42.579269 23410 raft_consensus.cc:493] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.579733 23410 raft_consensus.cc:3060] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.583617 23485 raft_consensus.cc:2468] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.587543 23373 leader_election.cc:304] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.587973 23530 consensus_queue.cc:1048] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.588569 23682 raft_consensus.cc:2804] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.589098 23682 raft_consensus.cc:697] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.589350 23567 consensus_queue.cc:1048] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:42.589938 23682 consensus_queue.cc:237] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.587541 23410 raft_consensus.cc:515] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.598752 23333 raft_consensus.cc:2468] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.600662 23640 raft_consensus.cc:993] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: : Instructing follower 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.601227 23640 raft_consensus.cc:1081] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Signalling peer 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.603175 23410 leader_election.cc:290] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.604447 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.605383 23483 raft_consensus.cc:3060] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.606654 23335 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "292f35692307405f8137fab0ccb56b42" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:42.607311 23335 raft_consensus.cc:3055] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.607609 23335 raft_consensus.cc:740] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.608407 23335 consensus_queue.cc:260] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.609627 23335 raft_consensus.cc:3060] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.618356 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:34136
I20260709 13:20:42.619139 23408 raft_consensus.cc:493] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.619221 23483 raft_consensus.cc:2468] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.619678 23408 raft_consensus.cc:3060] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.620466 23373 leader_election.cc:304] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.621309 23682 raft_consensus.cc:2804] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.622038 23682 raft_consensus.cc:697] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.622977 23682 consensus_queue.cc:237] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.624678 23335 raft_consensus.cc:2468] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.626157 23628 raft_consensus.cc:993] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.626652 23628 raft_consensus.cc:1081] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.632241 23335 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46228
I20260709 13:20:42.632242 23659 consensus_queue.cc:1048] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:42.632999 23335 raft_consensus.cc:493] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.633464 23335 raft_consensus.cc:3060] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.635067 23231 catalog_manager.cc:5697] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 1 to 2, leader changed from 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65) to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 2 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.637470 23408 raft_consensus.cc:515] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.640625 23408 leader_election.cc:290] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.642277 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.642974 23485 raft_consensus.cc:3055] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.643312 23485 raft_consensus.cc:740] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:42.643716 23335 raft_consensus.cc:515] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.644162 23485 consensus_queue.cc:260] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.645545 23485 raft_consensus.cc:3060] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.648970 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d140b9e8bb443d59f1825a41cf7c678" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:42.650213 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:42.649571 23335 leader_election.cc:290] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.650609 23332 raft_consensus.cc:3060] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.650848 23408 raft_consensus.cc:3055] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.655570 23408 raft_consensus.cc:740] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.650678 23484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6328a0664df342d596a4cd4e2d461429" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.656291 23484 raft_consensus.cc:3060] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.656425 23408 consensus_queue.cc:260] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.659912 23408 raft_consensus.cc:3060] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.664394 23484 raft_consensus.cc:2468] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.666491 23332 raft_consensus.cc:2468] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.666710 23485 raft_consensus.cc:2468] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.667579 23373 leader_election.cc:304] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:42.668318 23682 raft_consensus.cc:2804] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.668427 23298 leader_election.cc:304] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:42.668886 23682 raft_consensus.cc:697] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.669366 23644 raft_consensus.cc:2804] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.669749 23682 consensus_queue.cc:237] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.670553 23644 raft_consensus.cc:697] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.671622 23644 consensus_queue.cc:237] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.676106 23408 raft_consensus.cc:2468] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.681246 23231 catalog_manager.cc:5697] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.689843 23232 catalog_manager.cc:5697] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 1 to 2, leader changed from 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65) to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 2 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.704963 23232 catalog_manager.cc:5697] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 1 to 2, leader changed from d55654925a034a05b49afa7b64e1febf (127.14.41.67) to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 2 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.706096 23642 raft_consensus.cc:993] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: : Instructing follower 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.706650 23567 raft_consensus.cc:1081] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Signalling peer 5e58c4e5ee784a64bd7f5ab1045d33f4 to start an election
I20260709 13:20:42.708292 23332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
 from {username='slave'} at 127.0.0.1:46238
I20260709 13:20:42.708878 23332 raft_consensus.cc:493] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.709230 23332 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.716665 23332 raft_consensus.cc:515] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.718734 23332 leader_election.cc:290] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Requested vote from peers 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.719790 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.719812 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:42.720432 23485 raft_consensus.cc:3055] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.720654 23408 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.720813 23485 raft_consensus.cc:740] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:42.721702 23485 consensus_queue.cc:260] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.722913 23485 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.726963 23408 raft_consensus.cc:2468] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.728219 23300 leader_election.cc:304] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:42.728484 23485 raft_consensus.cc:2468] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e58c4e5ee784a64bd7f5ab1045d33f4 in term 2.
I20260709 13:20:42.729030 23644 raft_consensus.cc:2804] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.729463 23644 raft_consensus.cc:697] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Leader. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:42.730345 23644 consensus_queue.cc:237] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.736945 23232 catalog_manager.cc:5697] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 reported cstate change: term changed from 1 to 2, leader changed from d55654925a034a05b49afa7b64e1febf (127.14.41.67) to 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65). New cstate: current_term: 2 leader_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.818033 23642 raft_consensus.cc:993] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: : Instructing follower 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.818526 23567 raft_consensus.cc:1081] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Signalling peer 738afc0ebeed4f6eb80163fcd3006efb to start an election
I20260709 13:20:42.820030 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
 from {username='slave'} at 127.0.0.1:34136
I20260709 13:20:42.820520 23408 raft_consensus.cc:493] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:42.820900 23408 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.826562 23408 raft_consensus.cc:515] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.828193 23408 leader_election.cc:290] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), d55654925a034a05b49afa7b64e1febf (127.14.41.67:41431)
I20260709 13:20:42.829034 23332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:42.829304 23485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "738afc0ebeed4f6eb80163fcd3006efb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d55654925a034a05b49afa7b64e1febf"
I20260709 13:20:42.829715 23332 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.829913 23485 raft_consensus.cc:3055] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:42.830330 23485 raft_consensus.cc:740] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:42.831007 23485 consensus_queue.cc:260] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.832118 23485 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:42.835820 23332 raft_consensus.cc:2468] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.836922 23373 leader_election.cc:304] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, 738afc0ebeed4f6eb80163fcd3006efb; no voters: 
I20260709 13:20:42.837601 23682 raft_consensus.cc:2804] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:42.838050 23682 raft_consensus.cc:697] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Becoming Leader. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:42.838135 23485 raft_consensus.cc:2468] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 738afc0ebeed4f6eb80163fcd3006efb in term 2.
I20260709 13:20:42.838869 23682 consensus_queue.cc:237] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:42.845394 23232 catalog_manager.cc:5697] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb reported cstate change: term changed from 1 to 2, leader changed from d55654925a034a05b49afa7b64e1febf (127.14.41.67) to 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66). New cstate: current_term: 2 leader_uuid: "738afc0ebeed4f6eb80163fcd3006efb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:42.875016 23485 raft_consensus.cc:1275] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:42.876375 23644 consensus_queue.cc:1048] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:42.887606 23408 raft_consensus.cc:1275] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:42.889248 23644 consensus_queue.cc:1048] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:42.925359 23485 raft_consensus.cc:1275] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:42.926529 23694 consensus_queue.cc:1048] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:42.934875 23408 raft_consensus.cc:1275] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:42.936367 23644 consensus_queue.cc:1048] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.066250 23485 raft_consensus.cc:1275] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.067610 23644 consensus_queue.cc:1048] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.075727 23408 raft_consensus.cc:1275] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.081220 23624 consensus_queue.cc:1048] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.101349 23332 raft_consensus.cc:1275] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.102558 23682 consensus_queue.cc:1048] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.110220 23485 raft_consensus.cc:1275] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.112435 23628 consensus_queue.cc:1048] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.117146 23484 raft_consensus.cc:1275] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.118696 23628 consensus_queue.cc:1048] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.123950 23332 raft_consensus.cc:1275] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.125833 23659 consensus_queue.cc:1048] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.126031 23484 raft_consensus.cc:1275] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.129319 23644 consensus_queue.cc:1048] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.143252 23408 raft_consensus.cc:1275] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer 5e58c4e5ee784a64bd7f5ab1045d33f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.145061 23644 consensus_queue.cc:1048] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.147884 23332 raft_consensus.cc:1275] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.149339 23682 consensus_queue.cc:1048] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.162495 23485 raft_consensus.cc:1275] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.163807 23628 consensus_queue.cc:1048] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.304528 23332 raft_consensus.cc:1275] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.305939 23628 consensus_queue.cc:1048] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.314806 23485 raft_consensus.cc:1275] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Refusing update from remote peer 738afc0ebeed4f6eb80163fcd3006efb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.316406 23682 consensus_queue.cc:1048] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [LEADER]: Connected to new peer: Peer: permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:45.435595 23232 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:45.454903 23232 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47700:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:45.494700 14501 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:45.705513 23735 tablet.cc:1724] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:45.741143 23730 log.cc:927] Time spent T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:20:45.742616 23733 log.cc:927] Time spent T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:20:45.677974 23734 tablet.cc:1724] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:45.765661 23721 log.cc:927] Time spent T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:20:45.767832 23511 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:5baac476c5b34c1997d95e49815a9e08)
W20260709 13:20:45.787474 23511 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:5baac476c5b34c1997d95e49815a9e08)
W20260709 13:20:45.790191 23511 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:5baac476c5b34c1997d95e49815a9e08)
W20260709 13:20:45.799542 23723 log.cc:927] Time spent T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: Append to log took a long time: real 0.115s	user 0.005s	sys 0.000s
W20260709 13:20:45.848680 23744 log.cc:927] Time spent T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:20:45.924557 23373 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:40035, user_credentials={real_user=slave}} blocked reactor thread for 44176us
I20260709 13:20:45.857018 23762 tablet.cc:1724] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:45.935992 23728 log.cc:927] Time spent T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Append to log took a long time: real 0.231s	user 0.000s	sys 0.003s
W20260709 13:20:45.936388 23747 log.cc:927] Time spent T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:20:45.933758 23736 log.cc:927] Time spent T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Append to log took a long time: real 0.226s	user 0.003s	sys 0.000s
W20260709 13:20:45.941984 23750 log.cc:927] Time spent T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: Append to log took a long time: real 0.095s	user 0.004s	sys 0.000s
I20260709 13:20:45.943089 23761 tablet.cc:1724] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:45.943197 23770 tablet.cc:1724] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:45.948124 23729 log.cc:927] Time spent T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: Append to log took a long time: real 0.273s	user 0.002s	sys 0.002s
I20260709 13:20:45.888684 23754 tablet.cc:1724] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:45.981015 23767 tablet.cc:1724] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:45.992816 23768 tablet.cc:1724] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.040647 23771 tablet.cc:1724] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.063151 23768 tablet.cc:1724] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.066305 23774 tablet.cc:1724] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.044579 23772 tablet.cc:1724] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.082756 23776 tablet.cc:1724] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.088452 23331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
mode: GRACEFUL
new_leader_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:46252
I20260709 13:20:46.089264 23331 raft_consensus.cc:606] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Received request to transfer leadership to TS d55654925a034a05b49afa7b64e1febf
I20260709 13:20:46.090780 23734 tablet.cc:1724] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.094019 23754 tablet.cc:1724] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.099532 23772 tablet.cc:1724] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.108618 23762 tablet.cc:1724] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.118786 23718 raft_consensus.cc:993] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: : Instructing follower d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.119459 23778 raft_consensus.cc:1081] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Signalling peer d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.125633 23735 tablet.cc:1724] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.126819 23481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:40126
I20260709 13:20:46.138088 23481 raft_consensus.cc:493] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.141278 23481 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.145367 23770 tablet.cc:1724] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.153460 23761 tablet.cc:1724] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.171635 23734 tablet.cc:1724] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.181089 23771 tablet.cc:1724] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.185599 23734 tablet.cc:1724] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.184428 23767 tablet.cc:1724] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.205986 23768 tablet.cc:1724] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.212800 23774 tablet.cc:1724] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.218447 23481 raft_consensus.cc:515] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.226181 23334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:46.226533 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ac50ce746d3415d9fafdac4d5b6d7ad" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:46.227229 23408 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.226922 23334 raft_consensus.cc:3055] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:46.227877 23334 raft_consensus.cc:740] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:46.229693 23410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
mode: GRACEFUL
new_leader_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:34160
I20260709 13:20:46.230338 23410 raft_consensus.cc:606] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Received request to transfer leadership to TS d55654925a034a05b49afa7b64e1febf
I20260709 13:20:46.221531 23481 leader_election.cc:290] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 3 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:46.234428 23408 raft_consensus.cc:2468] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 3.
I20260709 13:20:46.236294 23334 consensus_queue.cc:260] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.237761 23449 leader_election.cc:304] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:46.240137 14501 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:20:46.242869 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:46.240425 23567 raft_consensus.cc:2804] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:46.245617 23567 raft_consensus.cc:697] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 3 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:46.240361 23334 raft_consensus.cc:3060] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.246492 23567 consensus_queue.cc:237] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.242040 23761 tablet.cc:1724] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.252736 23409 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254995c426e1458891deefc10a44988b"
dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
mode: GRACEFUL
new_leader_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:34160
I20260709 13:20:46.253456 23409 raft_consensus.cc:606] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Received request to transfer leadership to TS d55654925a034a05b49afa7b64e1febf
I20260709 13:20:46.256884 23334 raft_consensus.cc:2468] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 3.
I20260709 13:20:46.257206 23331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5"
dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
mode: GRACEFUL
new_leader_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:46252
I20260709 13:20:46.257870 23331 raft_consensus.cc:606] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Received request to transfer leadership to TS d55654925a034a05b49afa7b64e1febf
I20260709 13:20:46.259368 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:46.260085 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:46.269068 23232 catalog_manager.cc:6242] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc: soft_deleted_table [id=a02f6c596e8d4a3da0443b5418042342] alter complete (version 1)
I20260709 13:20:46.280148 23230 catalog_manager.cc:5697] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 2 to 3, leader changed from 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65) to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 3 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.301322 23752 raft_consensus.cc:993] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: : Instructing follower d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.301993 23743 raft_consensus.cc:1081] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Signalling peer d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.303738 23482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:40142
I20260709 13:20:46.304296 23482 raft_consensus.cc:493] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.304656 23482 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.311051 23482 raft_consensus.cc:515] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.314055 23482 leader_election.cc:290] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 3 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:46.314982 23331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:46.315503 23409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242019cbacb74194aa9ce7408f9621c0" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:46.315771 23331 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.316185 23409 raft_consensus.cc:3055] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:46.316540 23409 raft_consensus.cc:740] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:46.317469 23409 consensus_queue.cc:260] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.318608 23409 raft_consensus.cc:3060] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.323031 23331 raft_consensus.cc:2468] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 3.
I20260709 13:20:46.324669 23447 leader_election.cc:304] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:46.324690 23409 raft_consensus.cc:2468] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 3.
I20260709 13:20:46.325624 23567 raft_consensus.cc:2804] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:46.326164 23567 raft_consensus.cc:697] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 3 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:46.326965 23567 consensus_queue.cc:237] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.335335 23230 catalog_manager.cc:5697] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 2 to 3, leader changed from 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66) to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 3 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.336390 23743 raft_consensus.cc:993] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb: : Instructing follower d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.336957 23743 raft_consensus.cc:1081] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Signalling peer d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.338656 23482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "254995c426e1458891deefc10a44988b"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:40142
I20260709 13:20:46.339232 23482 raft_consensus.cc:493] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.339964 23482 raft_consensus.cc:3060] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.347265 23482 raft_consensus.cc:515] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.349274 23482 leader_election.cc:290] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 2 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:46.350358 23409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:46.350601 23331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254995c426e1458891deefc10a44988b" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:46.351087 23409 raft_consensus.cc:3055] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:46.351315 23331 raft_consensus.cc:3060] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.351487 23409 raft_consensus.cc:740] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 738afc0ebeed4f6eb80163fcd3006efb, State: Running, Role: LEADER
I20260709 13:20:46.352452 23409 consensus_queue.cc:260] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.353826 23409 raft_consensus.cc:3060] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:46.359491 23331 raft_consensus.cc:2468] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 2.
I20260709 13:20:46.360891 23447 leader_election.cc:304] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e58c4e5ee784a64bd7f5ab1045d33f4, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:46.361203 23409 raft_consensus.cc:2468] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 2.
I20260709 13:20:46.361647 23567 raft_consensus.cc:2804] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:46.362171 23567 raft_consensus.cc:697] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 2 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:46.362946 23567 consensus_queue.cc:237] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.370644 23230 catalog_manager.cc:5697] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 1 to 2, leader changed from 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66) to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 2 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.613402 23740 raft_consensus.cc:993] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4: : Instructing follower d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.613853 23718 raft_consensus.cc:1081] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Signalling peer d55654925a034a05b49afa7b64e1febf to start an election
I20260709 13:20:46.615226 23482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5"
dest_uuid: "d55654925a034a05b49afa7b64e1febf"
 from {username='slave'} at 127.0.0.1:40126
I20260709 13:20:46.615670 23482 raft_consensus.cc:493] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:46.615926 23482 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.621093 23482 raft_consensus.cc:515] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.622913 23482 leader_election.cc:290] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 3 election: Requested vote from peers 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035), 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889)
I20260709 13:20:46.623701 23331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4"
I20260709 13:20:46.623960 23409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c3eaa1a95b4446870b696c08f305b5" candidate_uuid: "d55654925a034a05b49afa7b64e1febf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "738afc0ebeed4f6eb80163fcd3006efb"
I20260709 13:20:46.624420 23331 raft_consensus.cc:3055] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:46.624565 23409 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.624855 23331 raft_consensus.cc:740] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e58c4e5ee784a64bd7f5ab1045d33f4, State: Running, Role: LEADER
I20260709 13:20:46.625813 23331 consensus_queue.cc:260] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.627099 23331 raft_consensus.cc:3060] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:46.631501 23408 raft_consensus.cc:1275] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:46.632333 23409 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 3.
I20260709 13:20:46.632812 23567 consensus_queue.cc:1048] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:46.633505 23449 leader_election.cc:304] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 738afc0ebeed4f6eb80163fcd3006efb, d55654925a034a05b49afa7b64e1febf; no voters: 
I20260709 13:20:46.634238 23567 raft_consensus.cc:2804] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:46.634637 23567 raft_consensus.cc:697] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 3 LEADER]: Becoming Leader. State: Replica: d55654925a034a05b49afa7b64e1febf, State: Running, Role: LEADER
I20260709 13:20:46.634650 23331 raft_consensus.cc:2468] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55654925a034a05b49afa7b64e1febf in term 3.
I20260709 13:20:46.635458 23567 consensus_queue.cc:237] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } }
I20260709 13:20:46.644210 23331 raft_consensus.cc:1275] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:46.644901 23230 catalog_manager.cc:5697] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf reported cstate change: term changed from 2 to 3, leader changed from 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65) to d55654925a034a05b49afa7b64e1febf (127.14.41.67). New cstate: current_term: 3 leader_uuid: "d55654925a034a05b49afa7b64e1febf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55654925a034a05b49afa7b64e1febf" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41431 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:46.646373 23567 consensus_queue.cc:1048] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:46.727589 23409 raft_consensus.cc:1275] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:46.728801 23722 consensus_queue.cc:1048] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:46.738865 23331 raft_consensus.cc:1275] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:46.740804 23567 consensus_queue.cc:1048] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:46.881713 23331 raft_consensus.cc:1275] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:46.881712 23409 raft_consensus.cc:1275] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:46.886665 23788 consensus_queue.cc:1048] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:46.890211 23792 consensus_queue.cc:1048] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:47.052157 23333 raft_consensus.cc:1275] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.053884 23798 consensus_queue.cc:1048] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e58c4e5ee784a64bd7f5ab1045d33f4" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 40035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.066416 23409 raft_consensus.cc:1275] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Refusing update from remote peer d55654925a034a05b49afa7b64e1febf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.068658 23722 consensus_queue.cc:1048] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [LEADER]: Connected to new peer: Peer: permanent_uuid: "738afc0ebeed4f6eb80163fcd3006efb" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 41889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:47.335220 14501 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:47.341856 14501 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:20:47.342444 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:47.348021 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:47.348424 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:48.380476 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
W20260709 13:20:48.405941 23373 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:20:48.412992 23373 consensus_peers.cc:597] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.418692 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:48.419729 14501 tablet_replica.cc:333] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.421175 14501 raft_consensus.cc:2243] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.421923 14501 raft_consensus.cc:2272] T 292f35692307405f8137fab0ccb56b42 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.424861 14501 tablet_replica.cc:333] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.425531 14501 raft_consensus.cc:2243] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.426127 14501 raft_consensus.cc:2272] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.428426 14501 tablet_replica.cc:333] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.429121 14501 raft_consensus.cc:2243] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.429590 14501 raft_consensus.cc:2272] T 242019cbacb74194aa9ce7408f9621c0 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.431912 14501 tablet_replica.cc:333] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.432482 14501 raft_consensus.cc:2243] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.433501 14501 raft_consensus.cc:2272] T 64ed631afb5b40deab23c5105b53c92c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.436105 14501 tablet_replica.cc:333] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.436800 14501 raft_consensus.cc:2243] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.437777 14501 raft_consensus.cc:2272] T be0192c3bed641f28d70fbdc314c602e P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.440361 14501 tablet_replica.cc:333] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.441017 14501 raft_consensus.cc:2243] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.442010 14501 raft_consensus.cc:2272] T df221801e57f4d60b2e276ea25d5c609 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.444495 14501 tablet_replica.cc:333] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.445242 14501 raft_consensus.cc:2243] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.446070 14501 raft_consensus.cc:2272] T f5abc3429e1c4cb1bdd420b10b7193a8 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.451161 14501 tablet_replica.cc:333] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.452361 14501 raft_consensus.cc:2243] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:20:48.453203 23447 consensus_peers.cc:597] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.453737 14501 raft_consensus.cc:2272] T a825c60bd0164a5c9e666b550895674c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.457182 14501 tablet_replica.cc:333] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.457868 14501 raft_consensus.cc:2243] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.459035 14501 raft_consensus.cc:2272] T d0c42e7d0697419394362b8cfb0d2f11 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.461994 14501 tablet_replica.cc:333] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.462626 14501 raft_consensus.cc:2243] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.463537 14501 raft_consensus.cc:2272] T 6328a0664df342d596a4cd4e2d461429 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.465981 14501 tablet_replica.cc:333] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.466553 14501 raft_consensus.cc:2243] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.466940 14501 raft_consensus.cc:2272] T b8c3eaa1a95b4446870b696c08f305b5 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.469118 14501 tablet_replica.cc:333] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.469620 14501 raft_consensus.cc:2243] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.470083 14501 raft_consensus.cc:2272] T 5baac476c5b34c1997d95e49815a9e08 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.472343 14501 tablet_replica.cc:333] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.472954 14501 raft_consensus.cc:2243] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.473448 14501 raft_consensus.cc:2272] T 0d140b9e8bb443d59f1825a41cf7c678 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.477182 14501 tablet_replica.cc:333] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.478044 14501 raft_consensus.cc:2243] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:48.478257 23373 consensus_peers.cc:597] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.478667 14501 raft_consensus.cc:2272] T 5e6b34608a4742518655634e5c95cee4 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.481501 14501 tablet_replica.cc:333] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.482103 14501 raft_consensus.cc:2243] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.482558 14501 raft_consensus.cc:2272] T 254995c426e1458891deefc10a44988b P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.484946 14501 tablet_replica.cc:333] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.485548 14501 raft_consensus.cc:2243] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.486146 14501 raft_consensus.cc:2272] T 17d977355e4c47b0b512afd66397f579 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.489596 14501 tablet_replica.cc:333] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.490370 14501 raft_consensus.cc:2243] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.490861 14501 raft_consensus.cc:2272] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.493853 14501 tablet_replica.cc:333] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4: stopping tablet replica
I20260709 13:20:48.494498 14501 raft_consensus.cc:2243] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.495085 14501 raft_consensus.cc:2272] T 9b5226718aaa41678f08260fcab186a6 P 5e58c4e5ee784a64bd7f5ab1045d33f4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.524480 23298 connection.cc:466] server connection from 127.0.0.1:46238 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46238 (request call id 100) could send its response
W20260709 13:20:48.525985 23447 consensus_peers.cc:597] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Network error: recv got EOF from 127.14.41.65:40035 (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:48.528232 23373 consensus_peers.cc:597] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.544911 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
I20260709 13:20:48.590204 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
W20260709 13:20:48.614586 23447 consensus_peers.cc:597] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:40035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:48.628489 23373 consensus_peers.cc:597] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:40035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.631695 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:48.632468 14501 tablet_replica.cc:333] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.633327 14501 raft_consensus.cc:2243] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.634366 14501 raft_consensus.cc:2272] T 292f35692307405f8137fab0ccb56b42 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.637348 14501 tablet_replica.cc:333] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.638171 14501 raft_consensus.cc:2243] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.638947 14501 raft_consensus.cc:2272] T 0ac50ce746d3415d9fafdac4d5b6d7ad P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.640210 23447 consensus_peers.cc:597] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:40035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.641860 14501 tablet_replica.cc:333] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.642503 14501 raft_consensus.cc:2243] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.642972 14501 raft_consensus.cc:2272] T 242019cbacb74194aa9ce7408f9621c0 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.645370 14501 tablet_replica.cc:333] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.645953 14501 raft_consensus.cc:2243] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.646459 14501 raft_consensus.cc:2272] T 64ed631afb5b40deab23c5105b53c92c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.648960 14501 tablet_replica.cc:333] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.649644 14501 raft_consensus.cc:2243] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.650496 14501 raft_consensus.cc:2272] T f5abc3429e1c4cb1bdd420b10b7193a8 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.653620 14501 tablet_replica.cc:333] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.654410 14501 raft_consensus.cc:2243] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.655376 14501 raft_consensus.cc:2272] T 0d140b9e8bb443d59f1825a41cf7c678 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.657636 14501 tablet_replica.cc:333] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.658365 14501 raft_consensus.cc:2243] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.658876 14501 raft_consensus.cc:2272] T 5baac476c5b34c1997d95e49815a9e08 P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.661154 14501 tablet_replica.cc:333] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.661697 14501 raft_consensus.cc:2243] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.662602 14501 raft_consensus.cc:2272] T 5e6b34608a4742518655634e5c95cee4 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.665009 14501 tablet_replica.cc:333] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.665613 14501 raft_consensus.cc:2243] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.666061 14501 raft_consensus.cc:2272] T 254995c426e1458891deefc10a44988b P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.668229 14501 tablet_replica.cc:333] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.668867 14501 raft_consensus.cc:2243] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.669376 14501 raft_consensus.cc:2272] T be0192c3bed641f28d70fbdc314c602e P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.671590 14501 tablet_replica.cc:333] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.672237 14501 raft_consensus.cc:2243] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.672801 14501 raft_consensus.cc:2272] T df221801e57f4d60b2e276ea25d5c609 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.675089 14501 tablet_replica.cc:333] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.675626 14501 raft_consensus.cc:2243] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.676112 14501 raft_consensus.cc:2272] T 9b5226718aaa41678f08260fcab186a6 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.678390 14501 tablet_replica.cc:333] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.678929 14501 raft_consensus.cc:2243] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.679492 14501 raft_consensus.cc:2272] T 6328a0664df342d596a4cd4e2d461429 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.681943 14501 tablet_replica.cc:333] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.682546 14501 raft_consensus.cc:2243] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.683233 14501 raft_consensus.cc:2272] T a825c60bd0164a5c9e666b550895674c P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.686275 14501 tablet_replica.cc:333] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
W20260709 13:20:48.686494 23449 consensus_peers.cc:597] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf -> Peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Couldn't send request to peer 738afc0ebeed4f6eb80163fcd3006efb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.687054 14501 raft_consensus.cc:2243] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.687661 14501 raft_consensus.cc:2272] T d0c42e7d0697419394362b8cfb0d2f11 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.689945 14501 tablet_replica.cc:333] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.690479 14501 raft_consensus.cc:2243] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.691298 14501 raft_consensus.cc:2272] T 17d977355e4c47b0b512afd66397f579 P 738afc0ebeed4f6eb80163fcd3006efb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.694013 14501 tablet_replica.cc:333] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.694456 14501 raft_consensus.cc:2243] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.695492 14501 raft_consensus.cc:2272] T d0cd9a81cc7049ad91e8cd9c680dfe1c P 738afc0ebeed4f6eb80163fcd3006efb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.698817 14501 tablet_replica.cc:333] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb: stopping tablet replica
I20260709 13:20:48.699538 14501 raft_consensus.cc:2243] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.700125 14501 raft_consensus.cc:2272] T b8c3eaa1a95b4446870b696c08f305b5 P 738afc0ebeed4f6eb80163fcd3006efb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:48.746410 23449 consensus_peers.cc:597] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf -> Peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Couldn't send request to peer 738afc0ebeed4f6eb80163fcd3006efb. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:41889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.746961 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
W20260709 13:20:48.774394 23449 consensus_peers.cc:597] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf -> Peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Couldn't send request to peer 738afc0ebeed4f6eb80163fcd3006efb. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:41889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.792215 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
W20260709 13:20:48.815438 23447 consensus_peers.cc:597] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:40035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.825064 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:48.826046 14501 tablet_replica.cc:333] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.827174 14501 raft_consensus.cc:2243] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:48.827235 23447 consensus_peers.cc:597] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf -> Peer 5e58c4e5ee784a64bd7f5ab1045d33f4 (127.14.41.65:40035): Couldn't send request to peer 5e58c4e5ee784a64bd7f5ab1045d33f4. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:40035: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.827893 14501 raft_consensus.cc:2272] T 64ed631afb5b40deab23c5105b53c92c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.830286 14501 tablet_replica.cc:333] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.830914 14501 raft_consensus.cc:2243] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.831437 14501 raft_consensus.cc:2272] T 292f35692307405f8137fab0ccb56b42 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.833751 14501 tablet_replica.cc:333] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.834381 14501 raft_consensus.cc:2243] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.835239 14501 raft_consensus.cc:2272] T 0ac50ce746d3415d9fafdac4d5b6d7ad P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.837463 14501 tablet_replica.cc:333] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.838043 14501 raft_consensus.cc:2243] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.838538 14501 raft_consensus.cc:2272] T 0d140b9e8bb443d59f1825a41cf7c678 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.840881 14501 tablet_replica.cc:333] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.841445 14501 raft_consensus.cc:2243] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.841996 14501 raft_consensus.cc:2272] T 5e6b34608a4742518655634e5c95cee4 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.844449 14501 tablet_replica.cc:333] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.845067 14501 raft_consensus.cc:2243] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.845944 14501 raft_consensus.cc:2272] T 5baac476c5b34c1997d95e49815a9e08 P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.848141 14501 tablet_replica.cc:333] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.848798 14501 raft_consensus.cc:2243] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.849617 14501 raft_consensus.cc:2272] T 242019cbacb74194aa9ce7408f9621c0 P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.851850 14501 tablet_replica.cc:333] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.852455 14501 raft_consensus.cc:2243] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.853312 14501 raft_consensus.cc:2272] T 9b5226718aaa41678f08260fcab186a6 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.855495 14501 tablet_replica.cc:333] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.856047 14501 raft_consensus.cc:2243] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.856563 14501 raft_consensus.cc:2272] T 6328a0664df342d596a4cd4e2d461429 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.858666 14501 tablet_replica.cc:333] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.859241 14501 raft_consensus.cc:2243] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.859700 14501 raft_consensus.cc:2272] T a825c60bd0164a5c9e666b550895674c P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.861850 14501 tablet_replica.cc:333] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.862457 14501 raft_consensus.cc:2243] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.862931 14501 raft_consensus.cc:2272] T d0c42e7d0697419394362b8cfb0d2f11 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.865293 14501 tablet_replica.cc:333] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.866015 14501 raft_consensus.cc:2243] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.866643 14501 raft_consensus.cc:2272] T 17d977355e4c47b0b512afd66397f579 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.869215 14501 tablet_replica.cc:333] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.869827 14501 raft_consensus.cc:2243] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:48.870280 23449 consensus_peers.cc:597] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf -> Peer 738afc0ebeed4f6eb80163fcd3006efb (127.14.41.66:41889): Couldn't send request to peer 738afc0ebeed4f6eb80163fcd3006efb. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:41889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:48.870358 14501 raft_consensus.cc:2272] T d0cd9a81cc7049ad91e8cd9c680dfe1c P d55654925a034a05b49afa7b64e1febf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.872861 14501 tablet_replica.cc:333] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.873453 14501 raft_consensus.cc:2243] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.873975 14501 raft_consensus.cc:2272] T be0192c3bed641f28d70fbdc314c602e P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.877147 14501 tablet_replica.cc:333] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.877796 14501 raft_consensus.cc:2243] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.878501 14501 raft_consensus.cc:2272] T df221801e57f4d60b2e276ea25d5c609 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.881783 14501 tablet_replica.cc:333] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.882362 14501 raft_consensus.cc:2243] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:48.882893 14501 raft_consensus.cc:2272] T f5abc3429e1c4cb1bdd420b10b7193a8 P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.885123 14501 tablet_replica.cc:333] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.885623 14501 raft_consensus.cc:2243] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.886415 14501 raft_consensus.cc:2272] T 254995c426e1458891deefc10a44988b P d55654925a034a05b49afa7b64e1febf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.888589 14501 tablet_replica.cc:333] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf: stopping tablet replica
I20260709 13:20:48.889196 14501 raft_consensus.cc:2243] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.889995 14501 raft_consensus.cc:2272] T b8c3eaa1a95b4446870b696c08f305b5 P d55654925a034a05b49afa7b64e1febf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.932778 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:20:48.969501 14501 master.cc:562] Master@127.14.41.126:43723 shutting down...
I20260709 13:20:48.991767 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:48.992420 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:48.992832 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P de6b0f7603164b2189111efa201cd9dc: stopping tablet replica
I20260709 13:20:49.014250 14501 master.cc:584] Master@127.14.41.126:43723 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12783 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:20:49.069074 14501 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.41.126:37585
I20260709 13:20:49.070225 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:49.076359 23810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.076428 23809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.077016 23812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:49.079352 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:49.080396 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:49.080755 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:49.080916 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603249080880 us; error 0 us; skew 500 ppm
I20260709 13:20:49.081499 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:49.083971 14501 webserver.cc:533] Webserver started at http://127.14.41.126:41459/ using document root <none> and password file <none>
I20260709 13:20:49.084488 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:49.084733 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:49.085018 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:49.086159 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/master-0-root/instance:
uuid: "cd1535c6cc52418eb102d9fab190d46c"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.090579 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:49.094033 23817 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.095052 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:49.095455 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/master-0-root
uuid: "cd1535c6cc52418eb102d9fab190d46c"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.095769 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:49.113221 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:49.114439 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:49.154083 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.126:37585
I20260709 13:20:49.154203 23868 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.126:37585 every 8 connection(s)
I20260709 13:20:49.158018 23869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.170043 23869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c: Bootstrap starting.
I20260709 13:20:49.174999 23869 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.179504 23869 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c: No bootstrap required, opened a new log
I20260709 13:20:49.182099 23869 raft_consensus.cc:359] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd1535c6cc52418eb102d9fab190d46c" member_type: VOTER }
I20260709 13:20:49.182561 23869 raft_consensus.cc:385] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.182766 23869 raft_consensus.cc:740] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd1535c6cc52418eb102d9fab190d46c, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.183311 23869 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd1535c6cc52418eb102d9fab190d46c" member_type: VOTER }
I20260709 13:20:49.183909 23869 raft_consensus.cc:399] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:49.184177 23869 raft_consensus.cc:493] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:49.184491 23869 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:49.189756 23869 raft_consensus.cc:515] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd1535c6cc52418eb102d9fab190d46c" member_type: VOTER }
I20260709 13:20:49.190416 23869 leader_election.cc:304] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd1535c6cc52418eb102d9fab190d46c; no voters: 
I20260709 13:20:49.191680 23869 leader_election.cc:290] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:49.192139 23872 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:49.193650 23872 raft_consensus.cc:697] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 1 LEADER]: Becoming Leader. State: Replica: cd1535c6cc52418eb102d9fab190d46c, State: Running, Role: LEADER
I20260709 13:20:49.194425 23872 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd1535c6cc52418eb102d9fab190d46c" member_type: VOTER }
I20260709 13:20:49.195114 23869 sys_catalog.cc:565] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:49.199785 23873 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd1535c6cc52418eb102d9fab190d46c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd1535c6cc52418eb102d9fab190d46c" member_type: VOTER } }
I20260709 13:20:49.199962 23874 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd1535c6cc52418eb102d9fab190d46c. Latest consensus state: current_term: 1 leader_uuid: "cd1535c6cc52418eb102d9fab190d46c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd1535c6cc52418eb102d9fab190d46c" member_type: VOTER } }
I20260709 13:20:49.200997 23873 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:49.201011 23874 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:49.212580 23879 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:49.218595 23879 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:49.219699 14501 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:49.227854 23879 catalog_manager.cc:1383] Generated new cluster ID: b11ffb4efafa49f5a9a67a5277b78e88
I20260709 13:20:49.228174 23879 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:49.253229 23879 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:49.254590 23879 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:49.270180 23879 catalog_manager.cc:6070] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c: Generated new TSK 0
I20260709 13:20:49.270900 23879 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:49.286770 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:49.292794 23890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.294153 23891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:49.295614 14501 server_base.cc:1061] running on GCE node
W20260709 13:20:49.295500 23893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:49.296999 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:49.297245 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:49.297420 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603249297402 us; error 0 us; skew 500 ppm
I20260709 13:20:49.298003 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:49.300323 14501 webserver.cc:533] Webserver started at http://127.14.41.65:40603/ using document root <none> and password file <none>
I20260709 13:20:49.300859 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:49.301055 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:49.301337 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:49.302455 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-0-root/instance:
uuid: "f682cda79e67414dba6535d6c8173e3c"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.307307 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:49.310899 23898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.311821 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:49.312155 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-0-root
uuid: "f682cda79e67414dba6535d6c8173e3c"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.312462 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:49.331959 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:49.333242 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:49.334771 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:49.337113 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:49.337355 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.337599 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:49.337788 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.379536 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.65:37045
I20260709 13:20:49.379637 23960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.65:37045 every 8 connection(s)
I20260709 13:20:49.384778 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:49.392164 23965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.395560 23966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.395684 23968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:49.397328 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:49.398679 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:49.398981 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:49.399196 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603249399176 us; error 0 us; skew 500 ppm
I20260709 13:20:49.399452 23961 heartbeater.cc:344] Connected to a master server at 127.14.41.126:37585
I20260709 13:20:49.399837 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:49.399922 23961 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:49.400938 23961 heartbeater.cc:507] Master 127.14.41.126:37585 requested a full tablet report, sending...
I20260709 13:20:49.402753 14501 webserver.cc:533] Webserver started at http://127.14.41.66:41507/ using document root <none> and password file <none>
I20260709 13:20:49.403189 23834 ts_manager.cc:194] Registered new tserver with Master: f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045)
I20260709 13:20:49.403364 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:49.403757 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:49.404048 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:49.405300 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-1-root/instance:
uuid: "c0fb1228ab664a3793904682a2ad6e3b"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.405311 23834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45278
I20260709 13:20:49.410030 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:20:49.413686 23973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.414520 14501 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:49.414858 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-1-root
uuid: "c0fb1228ab664a3793904682a2ad6e3b"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.415156 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:49.424256 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:49.425618 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:49.427107 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:49.429440 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:49.429677 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.429936 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:49.430111 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.471575 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.66:42379
I20260709 13:20:49.471684 24035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.66:42379 every 8 connection(s)
I20260709 13:20:49.476670 14501 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:49.483299 24039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.485601 24040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.487138 24042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:49.488590 14501 server_base.cc:1061] running on GCE node
I20260709 13:20:49.489800 14501 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:20:49.489851 24036 heartbeater.cc:344] Connected to a master server at 127.14.41.126:37585
W20260709 13:20:49.490144 14501 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:49.490347 24036 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:49.490375 14501 hybrid_clock.cc:648] HybridClock initialized: now 1783603249490355 us; error 0 us; skew 500 ppm
I20260709 13:20:49.491353 14501 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:49.491400 24036 heartbeater.cc:507] Master 127.14.41.126:37585 requested a full tablet report, sending...
I20260709 13:20:49.494046 23834 ts_manager.cc:194] Registered new tserver with Master: c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:49.494374 14501 webserver.cc:533] Webserver started at http://127.14.41.67:46193/ using document root <none> and password file <none>
I20260709 13:20:49.495007 14501 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:49.495195 14501 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:49.495486 14501 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:49.495745 23834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45280
I20260709 13:20:49.496803 14501 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-2-root/instance:
uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.501875 14501 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:49.506955 24047 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.508109 14501 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:49.508463 14501 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-2-root
uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-56lb"
I20260709 13:20:49.508842 14501 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskPs_OrH/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602979306007-14501-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:49.546456 14501 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:49.547727 14501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:49.549222 14501 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:49.551584 14501 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:49.551846 14501 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.552094 14501 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:49.552273 14501 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.594600 14501 rpc_server.cc:307] RPC server started. Bound to: 127.14.41.67:41699
I20260709 13:20:49.594708 24109 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.41.67:41699 every 8 connection(s)
I20260709 13:20:49.608932 24110 heartbeater.cc:344] Connected to a master server at 127.14.41.126:37585
I20260709 13:20:49.609362 24110 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:49.610059 24110 heartbeater.cc:507] Master 127.14.41.126:37585 requested a full tablet report, sending...
I20260709 13:20:49.612102 23834 ts_manager.cc:194] Registered new tserver with Master: 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:49.612679 14501 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014649489s
I20260709 13:20:49.613963 23834 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45288
I20260709 13:20:49.640208 23834 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45292:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:49.643045 23834 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:49.712460 24075 tablet_service.cc:1511] Processing CreateTablet for tablet a92f85cccf484f8bbc169b23127704bc (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:49.714107 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92f85cccf484f8bbc169b23127704bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.714769 23926 tablet_service.cc:1511] Processing CreateTablet for tablet a92f85cccf484f8bbc169b23127704bc (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:49.716274 23926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92f85cccf484f8bbc169b23127704bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.717981 23925 tablet_service.cc:1511] Processing CreateTablet for tablet ab7ffb484a02418f9c8e84a8363140e1 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:49.718528 24074 tablet_service.cc:1511] Processing CreateTablet for tablet ab7ffb484a02418f9c8e84a8363140e1 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:49.720000 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7ffb484a02418f9c8e84a8363140e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.722572 23924 tablet_service.cc:1511] Processing CreateTablet for tablet c61b8cddbe78443b95f6709de681c2c4 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:49.726015 23923 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1e33c13f8d4ea4b3f76339cc4543b3 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:49.727177 24073 tablet_service.cc:1511] Processing CreateTablet for tablet c61b8cddbe78443b95f6709de681c2c4 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:49.728782 24000 tablet_service.cc:1511] Processing CreateTablet for tablet ab7ffb484a02418f9c8e84a8363140e1 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:49.729673 23922 tablet_service.cc:1511] Processing CreateTablet for tablet e42c17102bdb427aab8aed53855f71bc (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:49.729852 24072 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1e33c13f8d4ea4b3f76339cc4543b3 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:49.730346 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7ffb484a02418f9c8e84a8363140e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.729664 24001 tablet_service.cc:1511] Processing CreateTablet for tablet a92f85cccf484f8bbc169b23127704bc (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:49.732105 24001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a92f85cccf484f8bbc169b23127704bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.732197 23999 tablet_service.cc:1511] Processing CreateTablet for tablet c61b8cddbe78443b95f6709de681c2c4 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:49.733675 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61b8cddbe78443b95f6709de681c2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.737896 23998 tablet_service.cc:1511] Processing CreateTablet for tablet 9d1e33c13f8d4ea4b3f76339cc4543b3 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:49.739428 23998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1e33c13f8d4ea4b3f76339cc4543b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.741397 23922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42c17102bdb427aab8aed53855f71bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.741915 23997 tablet_service.cc:1511] Processing CreateTablet for tablet e42c17102bdb427aab8aed53855f71bc (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:49.742739 23924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61b8cddbe78443b95f6709de681c2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.742758 23921 tablet_service.cc:1511] Processing CreateTablet for tablet d2d125ce1999404e9128c5cd6d4e6567 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:49.743520 23997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42c17102bdb427aab8aed53855f71bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.744174 23923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1e33c13f8d4ea4b3f76339cc4543b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.744871 23921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d125ce1999404e9128c5cd6d4e6567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.745604 23925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7ffb484a02418f9c8e84a8363140e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.748365 24071 tablet_service.cc:1511] Processing CreateTablet for tablet e42c17102bdb427aab8aed53855f71bc (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:49.750872 23996 tablet_service.cc:1511] Processing CreateTablet for tablet d2d125ce1999404e9128c5cd6d4e6567 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:49.752348 23996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d125ce1999404e9128c5cd6d4e6567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.752797 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61b8cddbe78443b95f6709de681c2c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.760360 24071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e42c17102bdb427aab8aed53855f71bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.763940 24070 tablet_service.cc:1511] Processing CreateTablet for tablet d2d125ce1999404e9128c5cd6d4e6567 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:49.764729 23920 tablet_service.cc:1511] Processing CreateTablet for tablet a3b3211255b24eb0acea79058b8afcd8 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:49.765650 24070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d125ce1999404e9128c5cd6d4e6567. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.769884 23995 tablet_service.cc:1511] Processing CreateTablet for tablet a3b3211255b24eb0acea79058b8afcd8 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:49.771389 23920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b3211255b24eb0acea79058b8afcd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.773016 23994 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1c6cfef73349e1ba035ad88c9d18ef (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:49.775602 23919 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1c6cfef73349e1ba035ad88c9d18ef (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:49.777129 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1c6cfef73349e1ba035ad88c9d18ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.780571 23918 tablet_service.cc:1511] Processing CreateTablet for tablet 08fbf043863b4cf19206dafbd4e5a554 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:49.782356 23918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fbf043863b4cf19206dafbd4e5a554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.783578 23993 tablet_service.cc:1511] Processing CreateTablet for tablet 08fbf043863b4cf19206dafbd4e5a554 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:49.785936 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fbf043863b4cf19206dafbd4e5a554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.789798 23995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b3211255b24eb0acea79058b8afcd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.790251 24069 tablet_service.cc:1511] Processing CreateTablet for tablet a3b3211255b24eb0acea79058b8afcd8 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:49.791790 24069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3b3211255b24eb0acea79058b8afcd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.793102 23994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1c6cfef73349e1ba035ad88c9d18ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.798461 24068 tablet_service.cc:1511] Processing CreateTablet for tablet 0b1c6cfef73349e1ba035ad88c9d18ef (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:49.801206 24067 tablet_service.cc:1511] Processing CreateTablet for tablet 08fbf043863b4cf19206dafbd4e5a554 (DEFAULT_TABLE table=test-workload [id=6d021232dd9a425bad52ef004d62ded1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:49.827224 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d1e33c13f8d4ea4b3f76339cc4543b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.837179 24068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b1c6cfef73349e1ba035ad88c9d18ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.841012 24067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08fbf043863b4cf19206dafbd4e5a554. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:49.933691 24126 tablet_bootstrap.cc:492] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:49.949538 24126 tablet_bootstrap.cc:654] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.953446 24127 tablet_bootstrap.cc:492] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:49.960000 24125 tablet_bootstrap.cc:492] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:49.972015 24127 tablet_bootstrap.cc:654] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.974658 24126 tablet_bootstrap.cc:492] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:49.975211 24126 ts_tablet_manager.cc:1403] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.014s
I20260709 13:20:49.976688 24125 tablet_bootstrap.cc:654] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.976941 24127 tablet_bootstrap.cc:492] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:49.977478 24127 ts_tablet_manager.cc:1403] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.002s
I20260709 13:20:49.978324 24126 raft_consensus.cc:359] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:49.979176 24126 raft_consensus.cc:385] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.979482 24126 raft_consensus.cc:740] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.980070 24127 raft_consensus.cc:359] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:49.980994 24127 raft_consensus.cc:385] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.980434 24126 consensus_queue.cc:260] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:49.981279 24127 raft_consensus.cc:740] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.982498 24125 tablet_bootstrap.cc:492] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:49.982280 24127 consensus_queue.cc:260] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:49.982910 23961 heartbeater.cc:499] Master 127.14.41.126:37585 was elected leader, sending a full tablet report...
I20260709 13:20:49.983057 24125 ts_tablet_manager.cc:1403] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.005s
I20260709 13:20:49.983426 24126 ts_tablet_manager.cc:1434] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:20:49.984553 24126 tablet_bootstrap.cc:492] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:49.986387 24125 raft_consensus.cc:359] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:49.987131 24125 raft_consensus.cc:385] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:49.987437 24125 raft_consensus.cc:740] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:49.988338 24125 consensus_queue.cc:260] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:49.990643 24036 heartbeater.cc:499] Master 127.14.41.126:37585 was elected leader, sending a full tablet report...
I20260709 13:20:49.991467 24126 tablet_bootstrap.cc:654] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:49.996136 24125 ts_tablet_manager.cc:1434] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:20:49.997529 24125 tablet_bootstrap.cc:492] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.002270 24110 heartbeater.cc:499] Master 127.14.41.126:37585 was elected leader, sending a full tablet report...
I20260709 13:20:50.003551 24127 ts_tablet_manager.cc:1434] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.007s
I20260709 13:20:49.997360 24126 tablet_bootstrap.cc:492] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.004782 24127 tablet_bootstrap.cc:492] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.004920 24125 tablet_bootstrap.cc:654] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.005183 24126 ts_tablet_manager.cc:1403] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.003s
I20260709 13:20:50.012722 24127 tablet_bootstrap.cc:654] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.015215 24125 tablet_bootstrap.cc:492] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.015837 24125 ts_tablet_manager.cc:1403] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.010s
I20260709 13:20:50.016826 24126 raft_consensus.cc:359] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.018847 24126 raft_consensus.cc:385] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.019369 24126 raft_consensus.cc:740] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.019642 24125 raft_consensus.cc:359] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.020622 24125 raft_consensus.cc:385] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.020963 24125 raft_consensus.cc:740] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.020977 24126 consensus_queue.cc:260] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.021951 24125 consensus_queue.cc:260] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.024534 24125 ts_tablet_manager.cc:1434] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:20:50.025170 24126 ts_tablet_manager.cc:1434] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:20:50.025607 24125 tablet_bootstrap.cc:492] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.027105 24126 tablet_bootstrap.cc:492] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:50.030529 24127 tablet_bootstrap.cc:492] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.031287 24127 ts_tablet_manager.cc:1403] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.005s
I20260709 13:20:50.034159 24126 tablet_bootstrap.cc:654] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.034173 24125 tablet_bootstrap.cc:654] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.034691 24127 raft_consensus.cc:359] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.038887 24127 raft_consensus.cc:385] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.039244 24127 raft_consensus.cc:740] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.040354 24127 consensus_queue.cc:260] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.042246 24125 tablet_bootstrap.cc:492] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.042246 24126 tablet_bootstrap.cc:492] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.043025 24127 ts_tablet_manager.cc:1434] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:50.043128 24125 ts_tablet_manager.cc:1403] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:20:50.043128 24126 ts_tablet_manager.cc:1403] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:20:50.044153 24127 tablet_bootstrap.cc:492] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.046721 24126 raft_consensus.cc:359] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.046895 24125 raft_consensus.cc:359] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.047540 24126 raft_consensus.cc:385] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.047650 24125 raft_consensus.cc:385] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.047983 24126 raft_consensus.cc:740] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.048027 24125 raft_consensus.cc:740] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.049052 24126 consensus_queue.cc:260] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.049052 24125 consensus_queue.cc:260] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.050930 24127 tablet_bootstrap.cc:654] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.051594 24126 ts_tablet_manager.cc:1434] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:20:50.051756 24125 ts_tablet_manager.cc:1434] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:50.052799 24126 tablet_bootstrap.cc:492] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:50.052796 24125 tablet_bootstrap.cc:492] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.060446 24125 tablet_bootstrap.cc:654] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.060446 24126 tablet_bootstrap.cc:654] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.068320 24127 tablet_bootstrap.cc:492] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.069078 24133 raft_consensus.cc:493] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.069697 24133 raft_consensus.cc:515] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.074990 24125 tablet_bootstrap.cc:492] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.069126 24127 ts_tablet_manager.cc:1403] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.004s
I20260709 13:20:50.075726 24125 ts_tablet_manager.cc:1403] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.004s
I20260709 13:20:50.079046 24127 raft_consensus.cc:359] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.079988 24127 raft_consensus.cc:385] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.079466 24125 raft_consensus.cc:359] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.080374 24127 raft_consensus.cc:740] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.081564 24125 raft_consensus.cc:385] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.081965 24125 raft_consensus.cc:740] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.081972 24133 leader_election.cc:290] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.082870 24125 consensus_queue.cc:260] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.085253 24126 tablet_bootstrap.cc:492] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.085860 24126 ts_tablet_manager.cc:1403] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.011s
I20260709 13:20:50.085887 24125 ts_tablet_manager.cc:1434] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.005s
I20260709 13:20:50.087167 24125 tablet_bootstrap.cc:492] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.082824 24127 consensus_queue.cc:260] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.089159 24126 raft_consensus.cc:359] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.089943 24126 raft_consensus.cc:385] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.090253 24126 raft_consensus.cc:740] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.091646 24127 ts_tablet_manager.cc:1434] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:20:50.093880 24125 tablet_bootstrap.cc:654] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.093974 24127 tablet_bootstrap.cc:492] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.099517 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
W20260709 13:20:50.101851 23974 leader_election.cc:343] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.097994 24126 consensus_queue.cc:260] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.105518 24127 tablet_bootstrap.cc:654] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.109261 24126 ts_tablet_manager.cc:1434] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:20:50.110915 24126 tablet_bootstrap.cc:492] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:50.120767 24126 tablet_bootstrap.cc:654] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.129096 24125 tablet_bootstrap.cc:492] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.129873 24125 ts_tablet_manager.cc:1403] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.019s
I20260709 13:20:50.131368 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.132592 24085 raft_consensus.cc:2468] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:50.134435 24126 tablet_bootstrap.cc:492] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.134479 23976 leader_election.cc:304] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:50.135207 24126 ts_tablet_manager.cc:1403] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:20:50.135258 24127 tablet_bootstrap.cc:492] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.135879 24127 ts_tablet_manager.cc:1403] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.011s
I20260709 13:20:50.136004 24133 raft_consensus.cc:2804] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.136514 24133 raft_consensus.cc:493] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.136914 24133 raft_consensus.cc:3060] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.136966 24125 raft_consensus.cc:359] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.138032 24125 raft_consensus.cc:385] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.138403 24125 raft_consensus.cc:740] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.138505 24126 raft_consensus.cc:359] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.138935 24127 raft_consensus.cc:359] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.139503 24126 raft_consensus.cc:385] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.139730 24127 raft_consensus.cc:385] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.139340 24125 consensus_queue.cc:260] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.140022 24126 raft_consensus.cc:740] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.140134 24127 raft_consensus.cc:740] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.141214 24126 consensus_queue.cc:260] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.141268 24127 consensus_queue.cc:260] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.144152 24127 ts_tablet_manager.cc:1434] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:20:50.145328 24127 tablet_bootstrap.cc:492] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.145486 24133 raft_consensus.cc:515] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.147524 24131 raft_consensus.cc:493] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.148105 24131 raft_consensus.cc:515] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.148651 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:50.149307 23936 raft_consensus.cc:3060] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.149859 24132 raft_consensus.cc:493] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.150418 24132 raft_consensus.cc:515] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.152122 24127 tablet_bootstrap.cc:654] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.159888 24131 leader_election.cc:290] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.161365 23936 raft_consensus.cc:2468] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:50.163246 23974 leader_election.cc:304] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.171190 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:50.172120 24085 raft_consensus.cc:3060] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.172138 24132 leader_election.cc:290] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:50.182130 24126 ts_tablet_manager.cc:1434] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.002s
I20260709 13:20:50.183501 24085 raft_consensus.cc:2468] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:50.185680 24133 leader_election.cc:290] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.189354 24133 raft_consensus.cc:2804] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.189868 24133 raft_consensus.cc:697] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:50.190899 24133 consensus_queue.cc:237] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.197969 24126 tablet_bootstrap.cc:492] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:50.206406 24152 raft_consensus.cc:493] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.207049 24152 raft_consensus.cc:515] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.210258 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
W20260709 13:20:50.211853 23976 leader_election.cc:343] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:50.213981 23882 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:50.218588 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.219427 23936 raft_consensus.cc:2468] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:50.220695 23974 leader_election.cc:304] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:50.227659 24126 tablet_bootstrap.cc:654] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.227778 24152 leader_election.cc:290] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699), f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045)
I20260709 13:20:50.228808 24152 raft_consensus.cc:2804] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.229188 24152 raft_consensus.cc:493] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.229511 24152 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.239434 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.240229 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.240633 24011 raft_consensus.cc:2468] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 0.
W20260709 13:20:50.242740 24048 leader_election.cc:343] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.243574 24049 leader_election.cc:304] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:50.246414 24132 raft_consensus.cc:2804] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.246881 24132 raft_consensus.cc:493] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.247215 24132 raft_consensus.cc:3060] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.247213 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.248294 24085 raft_consensus.cc:2393] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f682cda79e67414dba6535d6c8173e3c in current term 1: Already voted for candidate c0fb1228ab664a3793904682a2ad6e3b in this term.
I20260709 13:20:50.250890 24125 ts_tablet_manager.cc:1434] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.121s	user 0.027s	sys 0.023s
I20260709 13:20:50.250042 23833 catalog_manager.cc:5697] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 1 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.251426 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.252206 24125 tablet_bootstrap.cc:492] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.253121 23900 leader_election.cc:304] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:50.254169 24131 raft_consensus.cc:2749] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.259833 24132 raft_consensus.cc:515] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.261914 24125 tablet_bootstrap.cc:654] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.263455 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:50.264699 24131 raft_consensus.cc:493] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.265153 24127 tablet_bootstrap.cc:492] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.265287 24131 raft_consensus.cc:515] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.265808 24127 ts_tablet_manager.cc:1403] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.121s	user 0.063s	sys 0.029s
I20260709 13:20:50.268518 24131 leader_election.cc:290] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
W20260709 13:20:50.269263 24048 leader_election.cc:343] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.269855 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.272078 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
W20260709 13:20:50.274046 23901 leader_election.cc:343] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:50.275255 23900 leader_election.cc:343] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.274857 24127 raft_consensus.cc:359] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.275765 23900 leader_election.cc:304] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:50.275993 24127 raft_consensus.cc:385] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.276487 24127 raft_consensus.cc:740] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.277012 24131 raft_consensus.cc:2749] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.277585 24127 consensus_queue.cc:260] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.278837 24132 leader_election.cc:290] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:50.280155 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:50.280917 24011 raft_consensus.cc:3060] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.277822 24152 raft_consensus.cc:515] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.290241 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
W20260709 13:20:50.291682 23976 leader_election.cc:343] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.292877 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:50.293474 24152 leader_election.cc:290] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Requested vote from peers 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699), f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045)
I20260709 13:20:50.293565 23936 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.298779 24126 tablet_bootstrap.cc:492] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.299391 24126 ts_tablet_manager.cc:1403] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.005s
I20260709 13:20:50.302624 24126 raft_consensus.cc:359] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.295293 24011 raft_consensus.cc:2468] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 1.
I20260709 13:20:50.305675 24049 leader_election.cc:304] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:50.306182 24125 tablet_bootstrap.cc:492] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.303908 23936 raft_consensus.cc:2468] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:50.303450 24126 raft_consensus.cc:385] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.307209 24132 raft_consensus.cc:2804] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.307519 24125 ts_tablet_manager.cc:1403] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.016s
I20260709 13:20:50.308378 24126 raft_consensus.cc:740] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.310180 24126 consensus_queue.cc:260] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.311129 24132 raft_consensus.cc:697] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:50.312860 24126 ts_tablet_manager.cc:1434] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:20:50.312453 24132 consensus_queue.cc:237] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.310544 24127 ts_tablet_manager.cc:1434] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.024s
I20260709 13:20:50.318123 24126 tablet_bootstrap.cc:492] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:50.317584 24125 raft_consensus.cc:359] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.318804 24125 raft_consensus.cc:385] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.319255 24125 raft_consensus.cc:740] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.320811 23974 leader_election.cc:304] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:50.320384 24125 consensus_queue.cc:260] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.321700 24127 tablet_bootstrap.cc:492] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.323637 24125 ts_tablet_manager.cc:1434] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:20:50.325157 24125 tablet_bootstrap.cc:492] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.322364 24147 raft_consensus.cc:2804] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.327415 24147 raft_consensus.cc:697] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:50.328471 24147 consensus_queue.cc:237] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.332965 24126 tablet_bootstrap.cc:654] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.343354 24125 tablet_bootstrap.cc:654] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.353542 24127 tablet_bootstrap.cc:654] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.357008 24147 raft_consensus.cc:493] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.359550 24147 raft_consensus.cc:515] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.360255 23834 catalog_manager.cc:5697] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 1 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.363291 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.362937 23833 catalog_manager.cc:5697] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 1 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:50.365355 23974 leader_election.cc:343] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.366510 24147 leader_election.cc:290] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.370496 24125 tablet_bootstrap.cc:492] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.370908 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.371310 24125 ts_tablet_manager.cc:1403] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.021s
W20260709 13:20:50.373303 23976 leader_election.cc:343] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.374127 23976 leader_election.cc:304] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:50.375296 24147 raft_consensus.cc:2749] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.375417 24125 raft_consensus.cc:359] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.376703 24125 raft_consensus.cc:385] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.377030 24125 raft_consensus.cc:740] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.377784 24125 consensus_queue.cc:260] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.379501 24126 tablet_bootstrap.cc:492] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.380100 24126 ts_tablet_manager.cc:1403] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.012s
I20260709 13:20:50.380108 24125 ts_tablet_manager.cc:1434] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:50.381230 24125 tablet_bootstrap.cc:492] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.383270 24126 raft_consensus.cc:359] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.384048 24126 raft_consensus.cc:385] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.384357 24126 raft_consensus.cc:740] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.385346 24126 consensus_queue.cc:260] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.389163 24126 ts_tablet_manager.cc:1434] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:50.390261 24126 tablet_bootstrap.cc:492] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:50.390610 24125 tablet_bootstrap.cc:654] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.392437 24131 raft_consensus.cc:493] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.393031 24131 raft_consensus.cc:515] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.395287 24131 leader_election.cc:290] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.397064 24126 tablet_bootstrap.cc:654] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.396934 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61b8cddbe78443b95f6709de681c2c4" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.399197 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61b8cddbe78443b95f6709de681c2c4" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
W20260709 13:20:50.399499 23901 leader_election.cc:343] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.400017 24011 raft_consensus.cc:2468] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:50.401528 23900 leader_election.cc:304] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:50.402758 24131 raft_consensus.cc:2804] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.403189 24131 raft_consensus.cc:493] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.403548 24131 raft_consensus.cc:3060] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.404412 24126 tablet_bootstrap.cc:492] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.405036 24126 ts_tablet_manager.cc:1403] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:20:50.406733 24127 tablet_bootstrap.cc:492] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.407315 24127 ts_tablet_manager.cc:1403] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.005s
I20260709 13:20:50.407943 24126 raft_consensus.cc:359] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.408787 24126 raft_consensus.cc:385] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.409065 24126 raft_consensus.cc:740] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.409983 24125 tablet_bootstrap.cc:492] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.409763 24126 consensus_queue.cc:260] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.410605 24125 ts_tablet_manager.cc:1403] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 13:20:50.412956 24126 ts_tablet_manager.cc:1434] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:50.414017 24126 tablet_bootstrap.cc:492] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:50.413561 24125 raft_consensus.cc:359] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.414515 24125 raft_consensus.cc:385] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.414788 24125 raft_consensus.cc:740] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.415553 24125 consensus_queue.cc:260] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.417650 24131 raft_consensus.cc:515] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.420590 24126 tablet_bootstrap.cc:654] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.420590 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61b8cddbe78443b95f6709de681c2c4" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:50.420890 24125 ts_tablet_manager.cc:1434] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:20:50.421298 24011 raft_consensus.cc:3060] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.421978 24125 tablet_bootstrap.cc:492] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:50.428476 24125 tablet_bootstrap.cc:654] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.431552 24011 raft_consensus.cc:2468] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:50.433358 23900 leader_election.cc:304] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.410485 24127 raft_consensus.cc:359] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.436084 24127 raft_consensus.cc:385] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.436493 24127 raft_consensus.cc:740] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.439795 24127 consensus_queue.cc:260] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.444525 24169 raft_consensus.cc:2804] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.445684 24169 raft_consensus.cc:697] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:50.447184 24169 consensus_queue.cc:237] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.448381 24132 raft_consensus.cc:493] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.449288 24132 raft_consensus.cc:515] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.452499 24132 leader_election.cc:290] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:50.454733 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.456827 24127 ts_tablet_manager.cc:1434] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.049s	user 0.011s	sys 0.000s
W20260709 13:20:50.457578 24049 leader_election.cc:343] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.458595 24127 tablet_bootstrap.cc:492] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.463008 24125 tablet_bootstrap.cc:492] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:50.463927 24125 ts_tablet_manager.cc:1403] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.016s
I20260709 13:20:50.467307 24125 raft_consensus.cc:359] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.468060 24125 raft_consensus.cc:385] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.468369 24125 raft_consensus.cc:740] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.469178 24147 raft_consensus.cc:493] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.469820 24147 raft_consensus.cc:515] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.472039 24131 leader_election.cc:290] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.472402 24147 leader_election.cc:290] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.478631 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.478914 24125 consensus_queue.cc:260] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.480302 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.481056 23936 raft_consensus.cc:2468] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:50.481246 24125 ts_tablet_manager.cc:1434] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:20:50.481048 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61b8cddbe78443b95f6709de681c2c4" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:50.482839 23974 leader_election.cc:304] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.479525 24084 raft_consensus.cc:2468] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
W20260709 13:20:50.483626 23901 leader_election.cc:343] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.484519 24147 raft_consensus.cc:2804] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.485045 24147 raft_consensus.cc:493] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.485440 24147 raft_consensus.cc:3060] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.486999 24172 raft_consensus.cc:493] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.487741 24172 raft_consensus.cc:515] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.490413 24172 leader_election.cc:290] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.479960 23833 catalog_manager.cc:5697] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:50.491808 23900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:42379, user_credentials={real_user=slave}} blocked reactor thread for 58601us
I20260709 13:20:50.494046 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.494237 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.495323 23936 raft_consensus.cc:2468] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 0.
I20260709 13:20:50.495908 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.497028 24011 raft_consensus.cc:2468] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:50.494673 24084 raft_consensus.cc:2468] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:50.498736 24048 leader_election.cc:304] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:50.499233 23901 leader_election.cc:304] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.500134 24132 raft_consensus.cc:2804] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.500846 24132 raft_consensus.cc:493] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.501322 24132 raft_consensus.cc:3060] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.507786 24127 tablet_bootstrap.cc:654] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.508235 24169 raft_consensus.cc:2804] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.508785 24169 raft_consensus.cc:493] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.509197 24169 raft_consensus.cc:3060] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.513522 24132 raft_consensus.cc:515] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.514919 24126 tablet_bootstrap.cc:492] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:50.515507 24126 ts_tablet_manager.cc:1403] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.102s	user 0.038s	sys 0.048s
I20260709 13:20:50.517166 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:50.517735 24132 leader_election.cc:290] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:50.518110 24127 tablet_bootstrap.cc:492] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.518287 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:50.518761 24127 ts_tablet_manager.cc:1403] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.004s
I20260709 13:20:50.518921 24011 raft_consensus.cc:3060] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.522217 24127 raft_consensus.cc:359] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.522985 24127 raft_consensus.cc:385] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.523298 24127 raft_consensus.cc:740] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.524178 24127 consensus_queue.cc:260] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.527213 24011 raft_consensus.cc:2468] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 1.
I20260709 13:20:50.527591 24127 ts_tablet_manager.cc:1434] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:20:50.527971 24147 raft_consensus.cc:515] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.528756 24127 tablet_bootstrap.cc:492] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.528712 24049 leader_election.cc:304] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: 
I20260709 13:20:50.529829 24132 raft_consensus.cc:2804] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.530517 24132 raft_consensus.cc:697] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:50.531383 24132 consensus_queue.cc:237] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.531913 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:50.532779 23935 raft_consensus.cc:3060] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.536191 24127 tablet_bootstrap.cc:654] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.536116 24126 raft_consensus.cc:359] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.537065 24126 raft_consensus.cc:385] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.537209 24152 raft_consensus.cc:493] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.537387 24126 raft_consensus.cc:740] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.537786 24169 raft_consensus.cc:515] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.537926 24152 raft_consensus.cc:515] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.538319 24126 consensus_queue.cc:260] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.542002 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b3211255b24eb0acea79058b8afcd8" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.542309 24126 ts_tablet_manager.cc:1434] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:20:50.542809 24084 raft_consensus.cc:2468] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:50.544472 23976 leader_election.cc:304] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: 
I20260709 13:20:50.545449 24133 raft_consensus.cc:2804] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.545892 24133 raft_consensus.cc:493] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.546305 24133 raft_consensus.cc:3060] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.546669 23936 raft_consensus.cc:2393] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f98538eefa3478c8fadf65a8fa22a6c in current term 1: Already voted for candidate f682cda79e67414dba6535d6c8173e3c in this term.
I20260709 13:20:50.549326 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:50.550243 23934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b3211255b24eb0acea79058b8afcd8" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.551100 23934 raft_consensus.cc:2468] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:50.545892 24152 leader_election.cc:290] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.555860 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08fbf043863b4cf19206dafbd4e5a554" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:50.556824 24011 raft_consensus.cc:2393] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f682cda79e67414dba6535d6c8173e3c in current term 1: Already voted for candidate 0f98538eefa3478c8fadf65a8fa22a6c in this term.
I20260709 13:20:50.558048 23900 leader_election.cc:304] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:50.559024 24131 raft_consensus.cc:2749] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.559151 24169 leader_election.cc:290] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.563553 24127 tablet_bootstrap.cc:492] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.564018 24169 raft_consensus.cc:493] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.564397 24127 ts_tablet_manager.cc:1403] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.015s
I20260709 13:20:50.564692 24169 raft_consensus.cc:515] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.569993 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:50.569386 24127 raft_consensus.cc:359] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.570742 24084 raft_consensus.cc:3060] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.568341 24147 leader_election.cc:290] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.570878 24127 raft_consensus.cc:385] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.571493 24127 raft_consensus.cc:740] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.571628 23935 raft_consensus.cc:2468] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:50.572739 24127 consensus_queue.cc:260] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.573357 23974 leader_election.cc:304] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.574611 24147 raft_consensus.cc:2804] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.575485 24147 raft_consensus.cc:697] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:50.575927 24127 ts_tablet_manager.cc:1434] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:50.568230 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.577359 24011 raft_consensus.cc:2393] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f682cda79e67414dba6535d6c8173e3c in current term 1: Already voted for candidate 0f98538eefa3478c8fadf65a8fa22a6c in this term.
I20260709 13:20:50.576568 24147 consensus_queue.cc:237] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.577461 24127 tablet_bootstrap.cc:492] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:50.581182 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.581416 24169 leader_election.cc:290] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.583287 23901 leader_election.cc:304] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:50.563397 24133 raft_consensus.cc:515] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.585958 24127 tablet_bootstrap.cc:654] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.585407 24169 raft_consensus.cc:3060] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.591583 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b3211255b24eb0acea79058b8afcd8" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:50.592214 23935 raft_consensus.cc:3060] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.594254 23833 catalog_manager.cc:5697] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 1 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:50.600318 23935 raft_consensus.cc:2468] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:50.601779 23974 leader_election.cc:304] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.602767 24147 raft_consensus.cc:2804] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.603259 24147 raft_consensus.cc:697] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:50.604383 24084 raft_consensus.cc:2468] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:50.606523 24169 raft_consensus.cc:2749] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.604187 24147 consensus_queue.cc:237] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.610442 24127 tablet_bootstrap.cc:492] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:50.611179 24127 ts_tablet_manager.cc:1403] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.006s
I20260709 13:20:50.611812 24133 leader_election.cc:290] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.613094 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3b3211255b24eb0acea79058b8afcd8" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:50.602103 23831 catalog_manager.cc:5697] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 1 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.614240 24127 raft_consensus.cc:359] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.614975 24127 raft_consensus.cc:385] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.615273 24127 raft_consensus.cc:740] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.616050 24127 consensus_queue.cc:260] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.618793 24127 ts_tablet_manager.cc:1434] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:50.613862 24084 raft_consensus.cc:3060] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.627209 24084 raft_consensus.cc:2468] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:50.628978 24132 raft_consensus.cc:493] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.629293 24169 raft_consensus.cc:493] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.629487 24132 raft_consensus.cc:515] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.629905 24169 raft_consensus.cc:515] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.632843 24132 leader_election.cc:290] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:50.634023 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61b8cddbe78443b95f6709de681c2c4" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.634213 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1e33c13f8d4ea4b3f76339cc4543b3" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:50.634990 24084 raft_consensus.cc:2468] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:50.635057 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61b8cddbe78443b95f6709de681c2c4" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.635754 24169 leader_election.cc:290] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.635958 24011 raft_consensus.cc:2393] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f98538eefa3478c8fadf65a8fa22a6c in current term 1: Already voted for candidate f682cda79e67414dba6535d6c8173e3c in this term.
I20260709 13:20:50.636363 23901 leader_election.cc:304] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.637360 24169 raft_consensus.cc:2804] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:50.637506 24049 leader_election.cc:304] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c; no voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:50.637814 24169 raft_consensus.cc:493] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:50.638304 24169 raft_consensus.cc:3060] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.638449 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1e33c13f8d4ea4b3f76339cc4543b3" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.638964 24132 raft_consensus.cc:3060] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.639209 24011 raft_consensus.cc:2468] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:50.641227 24159 raft_consensus.cc:493] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.641767 24159 raft_consensus.cc:515] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:50.644083 24159 leader_election.cc:290] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:50.644405 23831 catalog_manager.cc:5697] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 1 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.646644 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:50.646646 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:50.647724 23935 raft_consensus.cc:2393] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f98538eefa3478c8fadf65a8fa22a6c in current term 1: Already voted for candidate c0fb1228ab664a3793904682a2ad6e3b in this term.
I20260709 13:20:50.647853 24132 raft_consensus.cc:2749] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.649088 24048 leader_election.cc:304] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c; no voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:50.650254 24132 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.653122 24169 raft_consensus.cc:515] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.655285 24169 leader_election.cc:290] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:50.656209 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1e33c13f8d4ea4b3f76339cc4543b3" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:50.656931 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d1e33c13f8d4ea4b3f76339cc4543b3" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:50.657625 24084 raft_consensus.cc:3060] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.656970 24011 raft_consensus.cc:3060] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.657817 24132 raft_consensus.cc:2749] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:50.660957 24147 consensus_queue.cc:1048] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.663146 24084 raft_consensus.cc:2468] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:50.664682 23901 leader_election.cc:304] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:50.665665 24169 raft_consensus.cc:2804] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.666268 24011 raft_consensus.cc:2468] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:50.666718 24169 raft_consensus.cc:697] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:50.668041 24169 consensus_queue.cc:237] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.677739 23833 catalog_manager.cc:5697] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:50.684758 24152 consensus_queue.cc:1048] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:50.760110 24152 consensus_queue.cc:1048] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.772310 24152 consensus_queue.cc:1048] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:50.931978 24132 consensus_queue.cc:1048] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.941655 24132 consensus_queue.cc:1048] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.961448 24132 consensus_queue.cc:1048] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.966704 24169 consensus_queue.cc:1048] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.974236 24159 consensus_queue.cc:1048] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.989938 24169 consensus_queue.cc:1048] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:50.995596 24159 raft_consensus.cc:493] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.996284 24159 raft_consensus.cc:515] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:50.998893 24169 raft_consensus.cc:493] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.999523 24169 raft_consensus.cc:515] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.000229 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:51.001030 24010 raft_consensus.cc:2468] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 0.
I20260709 13:20:51.001932 24169 leader_election.cc:290] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:51.002292 24049 leader_election.cc:304] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: 
I20260709 13:20:51.002775 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:51.003299 24191 raft_consensus.cc:2804] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.003446 24010 raft_consensus.cc:2468] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:51.003865 24191 raft_consensus.cc:493] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.004227 24191 raft_consensus.cc:3060] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.004071 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:51.005080 23900 leader_election.cc:304] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:51.006083 24169 raft_consensus.cc:2804] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.006541 24169 raft_consensus.cc:493] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.006956 24169 raft_consensus.cc:3060] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.008744 24159 leader_election.cc:290] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:51.000229 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:51.015774 24169 raft_consensus.cc:515] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.016197 24191 raft_consensus.cc:515] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.017372 23935 raft_consensus.cc:2393] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f98538eefa3478c8fadf65a8fa22a6c in current term 1: Already voted for candidate f682cda79e67414dba6535d6c8173e3c in this term.
I20260709 13:20:51.017663 24085 raft_consensus.cc:2393] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f682cda79e67414dba6535d6c8173e3c in current term 1: Already voted for candidate 0f98538eefa3478c8fadf65a8fa22a6c in this term.
I20260709 13:20:51.019364 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:51.020079 24010 raft_consensus.cc:3060] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.022341 24169 leader_election.cc:290] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:51.022048 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:51.023681 23935 raft_consensus.cc:2393] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f98538eefa3478c8fadf65a8fa22a6c in current term 1: Already voted for candidate f682cda79e67414dba6535d6c8173e3c in this term.
I20260709 13:20:51.024214 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:51.023808 24191 leader_election.cc:290] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:51.023600 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:51.026473 24085 raft_consensus.cc:2393] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f682cda79e67414dba6535d6c8173e3c in current term 1: Already voted for candidate 0f98538eefa3478c8fadf65a8fa22a6c in this term.
I20260709 13:20:51.026523 24049 leader_election.cc:304] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c; no voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:51.028815 24010 raft_consensus.cc:2468] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:51.028949 24191 raft_consensus.cc:2749] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.029753 24147 consensus_queue.cc:1048] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.030160 23900 leader_election.cc:304] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:51.031096 24169 raft_consensus.cc:2804] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.031695 24169 raft_consensus.cc:697] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:51.032562 24169 consensus_queue.cc:237] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.042959 23833 catalog_manager.cc:5697] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.044646 24133 consensus_queue.cc:1048] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.141660 24152 consensus_queue.cc:1048] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.153323 24133 consensus_queue.cc:1048] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.191470 24010 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc"
dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
mode: GRACEFUL
new_leader_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:59662
I20260709 13:20:51.192039 24010 raft_consensus.cc:606] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Received request to transfer leadership to TS f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:51.197808 24011 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1"
dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
mode: GRACEFUL
new_leader_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:59662
I20260709 13:20:51.198419 24011 raft_consensus.cc:606] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Received request to transfer leadership to TS f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:51.198796 24169 consensus_queue.cc:1048] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.213644 24169 consensus_queue.cc:1048] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.230311 24085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc"
dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
mode: GRACEFUL
new_leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:57950
I20260709 13:20:51.231057 24085 raft_consensus.cc:606] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Received request to transfer leadership to TS c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:51.252739 23935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
mode: GRACEFUL
new_leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:57320
I20260709 13:20:51.253324 23935 raft_consensus.cc:606] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Received request to transfer leadership to TS c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:51.332337 24152 raft_consensus.cc:993] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b: : Instructing follower f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:51.332875 24133 raft_consensus.cc:1081] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Signalling peer f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:51.334426 23935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:20:51.335007 23935 raft_consensus.cc:493] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.335337 23935 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.340879 23935 raft_consensus.cc:515] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:51.342644 23935 leader_election.cc:290] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Requested vote from peers 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:51.343765 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:51.344009 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:51.344419 24010 raft_consensus.cc:3055] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.344708 24085 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.344868 24010 raft_consensus.cc:740] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:51.345717 24010 consensus_queue.cc:260] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:51.346710 24010 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.350459 24085 raft_consensus.cc:2468] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:51.351778 23901 leader_election.cc:304] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:51.352097 24010 raft_consensus.cc:2468] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:51.352777 24169 raft_consensus.cc:2804] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.353322 24169 raft_consensus.cc:697] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:51.354195 24169 consensus_queue.cc:237] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:51.361127 23834 catalog_manager.cc:5697] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 1 to 2, leader changed from c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66) to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 2 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.466104 24169 consensus_queue.cc:1048] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.477994 24169 consensus_queue.cc:1048] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.486691 24131 raft_consensus.cc:993] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c: : Instructing follower c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:51.487212 24169 raft_consensus.cc:1081] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Signalling peer c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:51.489164 24010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef"
dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:59644
I20260709 13:20:51.489677 24010 raft_consensus.cc:493] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.490017 24010 raft_consensus.cc:3060] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.495173 24010 raft_consensus.cc:515] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.497164 24010 leader_election.cc:290] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:51.497833 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:51.498468 23935 raft_consensus.cc:3055] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.498664 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b1c6cfef73349e1ba035ad88c9d18ef" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:51.498684 23935 raft_consensus.cc:740] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:51.499331 24085 raft_consensus.cc:3060] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.499802 23935 consensus_queue.cc:260] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.501049 23935 raft_consensus.cc:3060] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.509289 24085 raft_consensus.cc:2468] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:51.511355 23976 leader_election.cc:304] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: 
I20260709 13:20:51.512315 24147 raft_consensus.cc:2804] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.512928 24147 raft_consensus.cc:697] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:51.513741 24147 consensus_queue.cc:237] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.513952 23935 raft_consensus.cc:2468] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:51.521096 23831 catalog_manager.cc:5697] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 1 to 2, leader changed from f682cda79e67414dba6535d6c8173e3c (127.14.41.65) to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 2 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.529171 24191 raft_consensus.cc:993] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c: : Instructing follower c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:51.529811 24159 raft_consensus.cc:1081] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Signalling peer c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:51.531883 24010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc"
dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:59646
I20260709 13:20:51.532523 24010 raft_consensus.cc:493] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.532991 24010 raft_consensus.cc:3060] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.538875 24010 raft_consensus.cc:515] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.540791 24010 leader_election.cc:290] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:51.541755 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:51.541877 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e42c17102bdb427aab8aed53855f71bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:51.542501 23935 raft_consensus.cc:3060] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.542621 24085 raft_consensus.cc:3055] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.543067 24085 raft_consensus.cc:740] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:51.544178 24085 consensus_queue.cc:260] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.545397 24085 raft_consensus.cc:3060] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.548404 23935 raft_consensus.cc:2468] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:51.549860 23974 leader_election.cc:304] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:51.550812 24147 raft_consensus.cc:2804] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.551302 24147 raft_consensus.cc:697] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:51.551645 24085 raft_consensus.cc:2468] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:51.552212 24147 consensus_queue.cc:237] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.559015 23834 catalog_manager.cc:5697] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 1 to 2, leader changed from 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67) to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 2 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.798858 24147 raft_consensus.cc:993] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b: : Instructing follower f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:51.799387 24152 raft_consensus.cc:1081] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Signalling peer f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:51.801165 23935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:57308
I20260709 13:20:51.801693 23935 raft_consensus.cc:493] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.802021 23935 raft_consensus.cc:3060] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.807777 23935 raft_consensus.cc:515] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.809428 23935 leader_election.cc:290] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:51.810261 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:51.810458 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7ffb484a02418f9c8e84a8363140e1" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:51.811074 24010 raft_consensus.cc:3055] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.811091 24085 raft_consensus.cc:3060] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.811447 24010 raft_consensus.cc:740] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:51.812196 24010 consensus_queue.cc:260] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.813262 24010 raft_consensus.cc:3060] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.817128 24085 raft_consensus.cc:2468] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:51.818395 23901 leader_election.cc:304] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:51.819162 24131 raft_consensus.cc:2804] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.819924 24131 raft_consensus.cc:697] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:51.819128 24010 raft_consensus.cc:2468] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:51.820864 24131 consensus_queue.cc:237] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:51.829342 23834 catalog_manager.cc:5697] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 1 to 2, leader changed from c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66) to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 2 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.830344 24010 raft_consensus.cc:1275] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.831714 24131 consensus_queue.cc:1048] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.843253 24085 raft_consensus.cc:1275] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.844792 24172 consensus_queue.cc:1048] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.954468 23935 raft_consensus.cc:1275] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.955847 24152 consensus_queue.cc:1048] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:51.965513 24085 raft_consensus.cc:1275] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:51.967446 24133 consensus_queue.cc:1048] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.004691 24085 raft_consensus.cc:1275] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.006356 24133 consensus_queue.cc:1048] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.015017 23935 raft_consensus.cc:1275] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.016947 24147 consensus_queue.cc:1048] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.299206 24085 raft_consensus.cc:1275] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.300565 24208 consensus_queue.cc:1048] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.309890 24010 raft_consensus.cc:1275] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.312454 24172 consensus_queue.cc:1048] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:54.286235 23834 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45308:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:54.289156 23834 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:54.340330 23919 tablet_service.cc:1511] Processing CreateTablet for tablet ffdcfb8128a74f94b4daa69112696352 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:54.341737 23919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdcfb8128a74f94b4daa69112696352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.341732 23993 tablet_service.cc:1511] Processing CreateTablet for tablet ffdcfb8128a74f94b4daa69112696352 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:54.342953 24068 tablet_service.cc:1511] Processing CreateTablet for tablet ffdcfb8128a74f94b4daa69112696352 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:54.343772 23993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdcfb8128a74f94b4daa69112696352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.344308 24068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffdcfb8128a74f94b4daa69112696352. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.346472 23920 tablet_service.cc:1511] Processing CreateTablet for tablet ec56f77c89a84742a328ca4e3f9a0d9e (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:54.347856 23920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec56f77c89a84742a328ca4e3f9a0d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.350374 24075 tablet_service.cc:1511] Processing CreateTablet for tablet ec56f77c89a84742a328ca4e3f9a0d9e (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:54.351815 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec56f77c89a84742a328ca4e3f9a0d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.353612 23921 tablet_service.cc:1511] Processing CreateTablet for tablet c6f662a792404411b7efedb2b98b3d63 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:54.354992 23921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f662a792404411b7efedb2b98b3d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.355924 24073 tablet_service.cc:1511] Processing CreateTablet for tablet c6f662a792404411b7efedb2b98b3d63 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:54.357331 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f662a792404411b7efedb2b98b3d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.357568 23998 tablet_service.cc:1511] Processing CreateTablet for tablet ec56f77c89a84742a328ca4e3f9a0d9e (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:54.358888 23998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec56f77c89a84742a328ca4e3f9a0d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.361629 24001 tablet_service.cc:1511] Processing CreateTablet for tablet c6f662a792404411b7efedb2b98b3d63 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:54.362188 23926 tablet_service.cc:1511] Processing CreateTablet for tablet a32f027009e848c6a0b83c11fe589b88 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:54.363065 24001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f662a792404411b7efedb2b98b3d63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.363466 23926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f027009e848c6a0b83c11fe589b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.365662 24070 tablet_service.cc:1511] Processing CreateTablet for tablet fdd85ada407242a086fda75dbeec4278 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:54.367059 24070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd85ada407242a086fda75dbeec4278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.370235 23922 tablet_service.cc:1511] Processing CreateTablet for tablet fdd85ada407242a086fda75dbeec4278 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:54.371659 23922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd85ada407242a086fda75dbeec4278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.373052 24000 tablet_service.cc:1511] Processing CreateTablet for tablet fdd85ada407242a086fda75dbeec4278 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:54.374496 24000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdd85ada407242a086fda75dbeec4278. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.384179 23996 tablet_service.cc:1511] Processing CreateTablet for tablet a32f027009e848c6a0b83c11fe589b88 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:54.385648 23996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f027009e848c6a0b83c11fe589b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.390419 24072 tablet_service.cc:1511] Processing CreateTablet for tablet a32f027009e848c6a0b83c11fe589b88 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:54.391865 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f027009e848c6a0b83c11fe589b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.404165 23926 tablet_service.cc:1511] Processing CreateTablet for tablet 47d8a0aed387469bbb51d8a63b9b78bc (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:54.409427 23999 tablet_service.cc:1511] Processing CreateTablet for tablet 47d8a0aed387469bbb51d8a63b9b78bc (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:54.410297 23926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d8a0aed387469bbb51d8a63b9b78bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.410809 23999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d8a0aed387469bbb51d8a63b9b78bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.416730 24069 tablet_service.cc:1511] Processing CreateTablet for tablet 47d8a0aed387469bbb51d8a63b9b78bc (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:54.417069 23925 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0424e0a61d48768f8f5d154bb40a96 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:54.418223 24069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47d8a0aed387469bbb51d8a63b9b78bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.418228 23925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0424e0a61d48768f8f5d154bb40a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.422410 24074 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0424e0a61d48768f8f5d154bb40a96 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:54.423913 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0424e0a61d48768f8f5d154bb40a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.422402 23924 tablet_service.cc:1511] Processing CreateTablet for tablet cfc3445285fe41f2b2e85f456d445e21 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:54.430110 23924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc3445285fe41f2b2e85f456d445e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.420365 23995 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0424e0a61d48768f8f5d154bb40a96 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:54.433254 23995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0424e0a61d48768f8f5d154bb40a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.440490 24231 tablet_bootstrap.cc:492] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.443863 23994 tablet_service.cc:1511] Processing CreateTablet for tablet cfc3445285fe41f2b2e85f456d445e21 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:54.445323 23994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc3445285fe41f2b2e85f456d445e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.454789 24067 tablet_service.cc:1511] Processing CreateTablet for tablet cfc3445285fe41f2b2e85f456d445e21 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:54.456262 24067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfc3445285fe41f2b2e85f456d445e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.456002 23923 tablet_service.cc:1511] Processing CreateTablet for tablet de979a18e9df4780b76419497fe11336 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:54.457150 23923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de979a18e9df4780b76419497fe11336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.459353 23997 tablet_service.cc:1511] Processing CreateTablet for tablet de979a18e9df4780b76419497fe11336 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:54.460566 23997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de979a18e9df4780b76419497fe11336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.474773 24071 tablet_service.cc:1511] Processing CreateTablet for tablet de979a18e9df4780b76419497fe11336 (DEFAULT_TABLE table=soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:54.476177 24071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de979a18e9df4780b76419497fe11336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:54.493403 24230 tablet_bootstrap.cc:492] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.504366 24232 tablet_bootstrap.cc:492] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.509775 24230 tablet_bootstrap.cc:654] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.510389 24231 tablet_bootstrap.cc:654] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.512066 24232 tablet_bootstrap.cc:654] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.548372 24231 tablet_bootstrap.cc:492] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:54.548952 24231 ts_tablet_manager.cc:1403] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.109s	user 0.000s	sys 0.015s
I20260709 13:20:54.551930 24231 raft_consensus.cc:359] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.556856 24231 raft_consensus.cc:385] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.560339 24232 tablet_bootstrap.cc:492] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.557325 24231 raft_consensus.cc:740] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.561317 24232 ts_tablet_manager.cc:1403] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.007s
I20260709 13:20:54.561669 24231 consensus_queue.cc:260] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.564198 24231 ts_tablet_manager.cc:1434] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 13:20:54.565313 24231 tablet_bootstrap.cc:492] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.565415 24232 raft_consensus.cc:359] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.566059 24232 raft_consensus.cc:385] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.566285 24232 raft_consensus.cc:740] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.566900 24232 consensus_queue.cc:260] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.569193 24232 ts_tablet_manager.cc:1434] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:20:54.570559 24232 tablet_bootstrap.cc:492] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.572543 24231 tablet_bootstrap.cc:654] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.577772 24232 tablet_bootstrap.cc:654] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.582147 24230 tablet_bootstrap.cc:492] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.582913 24230 ts_tablet_manager.cc:1403] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.008s
I20260709 13:20:54.587409 24230 raft_consensus.cc:359] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.588527 24230 raft_consensus.cc:385] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.588946 24230 raft_consensus.cc:740] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.589906 24230 consensus_queue.cc:260] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.594730 24230 ts_tablet_manager.cc:1434] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:20:54.596101 24230 tablet_bootstrap.cc:492] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.599800 24231 tablet_bootstrap.cc:492] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:54.602833 24231 ts_tablet_manager.cc:1403] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.014s
I20260709 13:20:54.603475 24232 tablet_bootstrap.cc:492] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.603987 24230 tablet_bootstrap.cc:654] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.604043 24232 ts_tablet_manager.cc:1403] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.008s
I20260709 13:20:54.605850 24231 raft_consensus.cc:359] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.606666 24231 raft_consensus.cc:385] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.606940 24231 raft_consensus.cc:740] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.607722 24231 consensus_queue.cc:260] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.607570 24232 raft_consensus.cc:359] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.608798 24232 raft_consensus.cc:385] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.609246 24232 raft_consensus.cc:740] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.610440 24231 ts_tablet_manager.cc:1434] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:54.611554 24231 tablet_bootstrap.cc:492] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.610590 24232 consensus_queue.cc:260] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.614306 24232 ts_tablet_manager.cc:1434] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:20:54.615662 24232 tablet_bootstrap.cc:492] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.621575 24231 tablet_bootstrap.cc:654] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.627206 24230 tablet_bootstrap.cc:492] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.627362 24232 tablet_bootstrap.cc:654] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.627830 24230 ts_tablet_manager.cc:1403] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.019s
I20260709 13:20:54.631011 24230 raft_consensus.cc:359] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.631735 24230 raft_consensus.cc:385] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.632037 24230 raft_consensus.cc:740] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.634508 24230 consensus_queue.cc:260] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.635937 24232 tablet_bootstrap.cc:492] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.636492 24232 ts_tablet_manager.cc:1403] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:20:54.636973 24230 ts_tablet_manager.cc:1434] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:20:54.640395 24232 raft_consensus.cc:359] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.641250 24232 raft_consensus.cc:385] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.641559 24232 raft_consensus.cc:740] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.642248 24230 tablet_bootstrap.cc:492] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.642362 24232 consensus_queue.cc:260] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.645046 24232 ts_tablet_manager.cc:1434] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:20:54.646204 24232 tablet_bootstrap.cc:492] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.650146 24230 tablet_bootstrap.cc:654] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.653172 24232 tablet_bootstrap.cc:654] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:54.653155 24111 tablet.cc:2406] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:54.663981 24231 tablet_bootstrap.cc:492] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:54.664517 24231 ts_tablet_manager.cc:1403] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.053s	user 0.022s	sys 0.014s
I20260709 13:20:54.667810 24231 raft_consensus.cc:359] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.668565 24231 raft_consensus.cc:385] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.668879 24231 raft_consensus.cc:740] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.669582 24231 consensus_queue.cc:260] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.671653 24231 ts_tablet_manager.cc:1434] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:20:54.672835 24231 tablet_bootstrap.cc:492] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.674299 24230 tablet_bootstrap.cc:492] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.674893 24230 ts_tablet_manager.cc:1403] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:20:54.677990 24232 tablet_bootstrap.cc:492] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.678685 24232 ts_tablet_manager.cc:1403] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.013s
I20260709 13:20:54.678278 24230 raft_consensus.cc:359] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.679281 24230 raft_consensus.cc:385] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.679657 24230 raft_consensus.cc:740] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.679793 24231 tablet_bootstrap.cc:654] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.680503 24230 consensus_queue.cc:260] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.682300 24232 raft_consensus.cc:359] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.683039 24230 ts_tablet_manager.cc:1434] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:20:54.683210 24232 raft_consensus.cc:385] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.683681 24232 raft_consensus.cc:740] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.684267 24230 tablet_bootstrap.cc:492] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.684551 24232 consensus_queue.cc:260] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.687251 24232 ts_tablet_manager.cc:1434] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:20:54.688490 24232 tablet_bootstrap.cc:492] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.692070 24230 tablet_bootstrap.cc:654] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.700409 24232 tablet_bootstrap.cc:654] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.712267 24230 tablet_bootstrap.cc:492] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.712849 24230 ts_tablet_manager.cc:1403] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.011s
I20260709 13:20:54.713382 24232 tablet_bootstrap.cc:492] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.713932 24232 ts_tablet_manager.cc:1403] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.026s	user 0.002s	sys 0.014s
I20260709 13:20:54.714267 24231 tablet_bootstrap.cc:492] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:54.714932 24231 ts_tablet_manager.cc:1403] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.011s
I20260709 13:20:54.716228 24230 raft_consensus.cc:359] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.716316 24232 raft_consensus.cc:359] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.717211 24230 raft_consensus.cc:385] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.717332 24232 raft_consensus.cc:385] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.717674 24230 raft_consensus.cc:740] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.717752 24232 raft_consensus.cc:740] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.717911 24231 raft_consensus.cc:359] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.718717 24231 raft_consensus.cc:385] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.718794 24232 consensus_queue.cc:260] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.719094 24231 raft_consensus.cc:740] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.718817 24230 consensus_queue.cc:260] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.720196 24231 consensus_queue.cc:260] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.722759 24231 ts_tablet_manager.cc:1434] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:54.723032 24232 ts_tablet_manager.cc:1434] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:54.723723 24230 ts_tablet_manager.cc:1434] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:20:54.723862 24231 tablet_bootstrap.cc:492] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.724785 24230 tablet_bootstrap.cc:492] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.726202 24218 raft_consensus.cc:493] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.726715 24218 raft_consensus.cc:515] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.729755 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f662a792404411b7efedb2b98b3d63" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:54.730432 24010 raft_consensus.cc:2468] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:54.731803 23900 leader_election.cc:304] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:54.732120 24230 tablet_bootstrap.cc:654] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.732766 24240 raft_consensus.cc:2804] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:54.733186 24240 raft_consensus.cc:493] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.733558 24240 raft_consensus.cc:3060] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.735802 24231 tablet_bootstrap.cc:654] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.749624 24218 leader_election.cc:290] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.751605 24230 tablet_bootstrap.cc:492] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.752492 24230 ts_tablet_manager.cc:1403] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.004s
I20260709 13:20:54.755307 24240 raft_consensus.cc:515] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.756112 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f662a792404411b7efedb2b98b3d63" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:54.758029 24232 tablet_bootstrap.cc:492] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.758793 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f662a792404411b7efedb2b98b3d63" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:54.756546 24230 raft_consensus.cc:359] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.759418 24010 raft_consensus.cc:3060] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.759450 24230 raft_consensus.cc:385] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.760110 24230 raft_consensus.cc:740] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.761369 24230 consensus_queue.cc:260] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.756842 24085 raft_consensus.cc:2468] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:54.767046 24232 tablet_bootstrap.cc:654] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.770453 24230 ts_tablet_manager.cc:1434] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:20:54.764734 24239 raft_consensus.cc:493] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.776098 24239 raft_consensus.cc:515] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.776916 24230 tablet_bootstrap.cc:492] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.778713 24239 leader_election.cc:290] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.781159 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:54.781875 24232 tablet_bootstrap.cc:492] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.782655 24232 ts_tablet_manager.cc:1403] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.001s
W20260709 13:20:54.783106 23900 leader_election.cc:343] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:54.785080 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:54.785883 24085 raft_consensus.cc:2468] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:54.786063 24230 tablet_bootstrap.cc:654] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.787438 23901 leader_election.cc:304] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:54.788407 24218 raft_consensus.cc:2804] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:54.788865 24218 raft_consensus.cc:493] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.789211 24218 raft_consensus.cc:3060] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.798115 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f662a792404411b7efedb2b98b3d63" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:54.798841 24085 raft_consensus.cc:3060] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.802731 24232 raft_consensus.cc:359] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.803624 24232 raft_consensus.cc:385] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.803912 24232 raft_consensus.cc:740] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.804721 24232 consensus_queue.cc:260] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.805444 24230 tablet_bootstrap.cc:492] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.806077 24230 ts_tablet_manager.cc:1403] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 13:20:54.806918 24232 ts_tablet_manager.cc:1434] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.003s
I20260709 13:20:54.807948 24232 tablet_bootstrap.cc:492] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.809052 24230 raft_consensus.cc:359] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.809810 24230 raft_consensus.cc:385] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.810076 24230 raft_consensus.cc:740] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.810849 24230 consensus_queue.cc:260] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.813401 24230 ts_tablet_manager.cc:1434] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:20:54.814352 24231 tablet_bootstrap.cc:492] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:54.814881 24231 ts_tablet_manager.cc:1403] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.091s	user 0.029s	sys 0.036s
I20260709 13:20:54.816020 24230 tablet_bootstrap.cc:492] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.817032 24240 leader_election.cc:290] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.817899 24231 raft_consensus.cc:359] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.818687 24231 raft_consensus.cc:385] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.818966 24231 raft_consensus.cc:740] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.819705 24231 consensus_queue.cc:260] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.821943 24231 ts_tablet_manager.cc:1434] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:54.821825 24218 raft_consensus.cc:515] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.822938 24231 tablet_bootstrap.cc:492] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.825721 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:54.826413 24084 raft_consensus.cc:3060] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.827028 24232 tablet_bootstrap.cc:654] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.775350 24010 raft_consensus.cc:2468] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:54.831609 24230 tablet_bootstrap.cc:654] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.835043 24218 leader_election.cc:290] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.837107 24231 tablet_bootstrap.cc:654] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.839907 24230 tablet_bootstrap.cc:492] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.840428 24230 ts_tablet_manager.cc:1403] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 13:20:54.843393 24230 raft_consensus.cc:359] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.844168 24230 raft_consensus.cc:385] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.844480 24230 raft_consensus.cc:740] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.845458 24230 consensus_queue.cc:260] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.850163 24230 ts_tablet_manager.cc:1434] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:54.852854 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:54.855683 23900 leader_election.cc:304] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
W20260709 13:20:54.856575 23900 leader_election.cc:343] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:54.857178 24230 tablet_bootstrap.cc:492] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.858022 24239 raft_consensus.cc:2804] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:54.859527 24239 raft_consensus.cc:697] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:54.861446 24084 raft_consensus.cc:2468] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:54.863186 23901 leader_election.cc:304] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:54.865073 24218 raft_consensus.cc:2804] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:54.865681 24218 raft_consensus.cc:697] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:54.867066 24230 tablet_bootstrap.cc:654] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.866758 24218 consensus_queue.cc:237] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.860406 24239 consensus_queue.cc:237] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.845890 24085 raft_consensus.cc:2468] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:54.880318 24230 tablet_bootstrap.cc:492] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:54.880920 24230 ts_tablet_manager.cc:1403] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:20:54.883785 24230 raft_consensus.cc:359] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.884708 24230 raft_consensus.cc:385] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.885084 24230 raft_consensus.cc:740] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.885854 24230 consensus_queue.cc:260] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.888917 24230 ts_tablet_manager.cc:1434] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:54.889950 24230 tablet_bootstrap.cc:492] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b: Bootstrap starting.
I20260709 13:20:54.894873 24231 tablet_bootstrap.cc:492] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:54.894891 24232 tablet_bootstrap.cc:492] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.895659 24232 ts_tablet_manager.cc:1403] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.012s
I20260709 13:20:54.895659 24231 ts_tablet_manager.cc:1403] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.012s
I20260709 13:20:54.898551 24159 raft_consensus.cc:493] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.899004 24232 raft_consensus.cc:359] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.899241 24231 raft_consensus.cc:359] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.899871 24232 raft_consensus.cc:385] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.899080 24159 raft_consensus.cc:515] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.900107 24231 raft_consensus.cc:385] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.900229 24232 raft_consensus.cc:740] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.900556 24231 raft_consensus.cc:740] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.903337 24159 leader_election.cc:290] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:54.903617 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:54.904227 24232 consensus_queue.cc:260] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.904925 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
W20260709 13:20:54.906518 24048 leader_election.cc:343] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:54.906731 24232 ts_tablet_manager.cc:1434] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:54.901003 24230 tablet_bootstrap.cc:654] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.907987 24232 tablet_bootstrap.cc:492] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.904763 24231 consensus_queue.cc:260] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.905052 24010 raft_consensus.cc:2468] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 0.
I20260709 13:20:54.910557 24049 leader_election.cc:304] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:54.911095 24256 raft_consensus.cc:493] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.911656 24256 raft_consensus.cc:515] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.910817 24231 ts_tablet_manager.cc:1434] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 13:20:54.912922 24159 raft_consensus.cc:2804] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:54.913407 24159 raft_consensus.cc:493] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.913763 24159 raft_consensus.cc:3060] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.914219 24231 tablet_bootstrap.cc:492] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.913854 24256 leader_election.cc:290] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.916823 24240 raft_consensus.cc:493] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.917371 24240 raft_consensus.cc:515] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.919798 24240 leader_election.cc:290] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.921618 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:54.922353 23935 raft_consensus.cc:2468] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:54.922570 24232 tablet_bootstrap.cc:654] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.902033 24261 raft_consensus.cc:493] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.923533 24261 raft_consensus.cc:515] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.924145 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de979a18e9df4780b76419497fe11336" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:54.925058 24084 raft_consensus.cc:2468] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:54.916249 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:54.926304 24261 leader_election.cc:290] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:54.926412 24085 raft_consensus.cc:2468] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:54.926440 24231 tablet_bootstrap.cc:654] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.927935 23974 leader_election.cc:304] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:54.929463 23901 leader_election.cc:304] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:54.930270 24257 raft_consensus.cc:493] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.930343 24240 raft_consensus.cc:2804] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:54.930801 24240 raft_consensus.cc:493] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.931223 24240 raft_consensus.cc:3060] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.930819 24257 raft_consensus.cc:515] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.933295 24257 leader_election.cc:290] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.933832 24257 raft_consensus.cc:2804] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:54.934139 24257 raft_consensus.cc:493] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.934455 24257 raft_consensus.cc:3060] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.929433 24261 raft_consensus.cc:493] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.935034 24261 raft_consensus.cc:515] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.937742 24261 leader_election.cc:290] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:54.939842 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:54.941640 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:54.922065 23831 catalog_manager.cc:5697] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:54.942917 23974 leader_election.cc:343] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:54.943179 24240 raft_consensus.cc:515] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
W20260709 13:20:54.944463 23976 leader_election.cc:343] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:54.943913 23831 catalog_manager.cc:5697] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:54.945008 23976 leader_election.cc:304] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:54.946200 24219 raft_consensus.cc:2749] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:54.949287 24240 leader_election.cc:290] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.949599 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:54.949783 23934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:54.951112 23935 raft_consensus.cc:2468] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 0.
I20260709 13:20:54.952525 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de979a18e9df4780b76419497fe11336" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:54.950148 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de979a18e9df4780b76419497fe11336" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:54.953567 24232 tablet_bootstrap.cc:492] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:54.953740 24010 raft_consensus.cc:2468] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:54.953912 24085 raft_consensus.cc:3060] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.954114 24232 ts_tablet_manager.cc:1403] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.006s
I20260709 13:20:54.955189 24011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de979a18e9df4780b76419497fe11336" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:54.955821 24011 raft_consensus.cc:3060] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.957306 24232 raft_consensus.cc:359] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.958024 24232 raft_consensus.cc:385] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:54.958289 24232 raft_consensus.cc:740] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.958945 24232 consensus_queue.cc:260] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.961468 24232 ts_tablet_manager.cc:1434] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:54.966532 24085 raft_consensus.cc:2468] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:54.968261 23901 leader_election.cc:304] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
W20260709 13:20:54.969369 24048 leader_election.cc:343] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:54.969448 24240 raft_consensus.cc:2804] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:54.970912 24240 raft_consensus.cc:697] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:54.971071 24257 raft_consensus.cc:515] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.972927 24232 tablet_bootstrap.cc:492] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: Bootstrap starting.
I20260709 13:20:54.974598 24159 raft_consensus.cc:515] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.976735 24048 leader_election.cc:304] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:54.977708 24261 raft_consensus.cc:2804] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:54.978084 24261 raft_consensus.cc:493] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:54.978397 24261 raft_consensus.cc:3060] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.978863 24232 tablet_bootstrap.cc:654] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:54.980417 24231 tablet_bootstrap.cc:492] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:54.981017 24231 ts_tablet_manager.cc:1403] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.067s	user 0.019s	sys 0.010s
I20260709 13:20:54.982030 24257 leader_election.cc:290] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:54.984233 24231 raft_consensus.cc:359] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.985065 24231 raft_consensus.cc:385] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:20:54.985014 24049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.41.66:42379, user_credentials={real_user=slave}} blocked reactor thread for 74567.3us
I20260709 13:20:54.985646 24231 raft_consensus.cc:740] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:54.986405 24231 consensus_queue.cc:260] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:54.986828 23934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:54.987715 23934 raft_consensus.cc:3060] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:54.988859 24231 ts_tablet_manager.cc:1434] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:20:54.989176 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:54.989965 24231 tablet_bootstrap.cc:492] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:54.989969 24010 raft_consensus.cc:2393] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f98538eefa3478c8fadf65a8fa22a6c in current term 1: Already voted for candidate c0fb1228ab664a3793904682a2ad6e3b in this term.
I20260709 13:20:54.992338 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:54.992807 24239 raft_consensus.cc:493] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:54.993637 24239 raft_consensus.cc:515] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.000177 24010 raft_consensus.cc:2468] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 0.
I20260709 13:20:55.002594 24240 consensus_queue.cc:237] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.008826 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd85ada407242a086fda75dbeec4278" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:55.009871 24084 raft_consensus.cc:2468] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:55.010286 24231 tablet_bootstrap.cc:654] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.011439 23901 leader_election.cc:304] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:55.012641 24252 raft_consensus.cc:2804] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.013049 24252 raft_consensus.cc:493] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.013505 24252 raft_consensus.cc:3060] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.015003 24261 raft_consensus.cc:515] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.006575 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:55.007323 24239 leader_election.cc:290] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
W20260709 13:20:55.023186 24048 leader_election.cc:343] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.025939 24252 raft_consensus.cc:515] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.026743 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:55.029582 23934 raft_consensus.cc:2468] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:55.017573 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd85ada407242a086fda75dbeec4278" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:55.030680 24009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd85ada407242a086fda75dbeec4278" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.031399 24010 raft_consensus.cc:2468] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 0.
I20260709 13:20:55.033080 24257 raft_consensus.cc:493] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.033257 23974 leader_election.cc:304] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:55.033694 24257 raft_consensus.cc:515] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.034250 24256 raft_consensus.cc:2804] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.034730 24256 raft_consensus.cc:697] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:55.034559 24049 leader_election.cc:304] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.035883 24257 leader_election.cc:290] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.035725 24256 consensus_queue.cc:237] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.037228 24262 raft_consensus.cc:2804] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.037645 24262 raft_consensus.cc:493] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.037990 24262 raft_consensus.cc:3060] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.037801 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.039592 24010 raft_consensus.cc:3060] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.005155 24159 leader_election.cc:290] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:55.018445 24011 raft_consensus.cc:2468] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:55.018483 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:55.043856 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc3445285fe41f2b2e85f456d445e21" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:55.048059 23934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc3445285fe41f2b2e85f456d445e21" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:55.062779 24085 raft_consensus.cc:2393] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0fb1228ab664a3793904682a2ad6e3b in current term 1: Already voted for candidate 0f98538eefa3478c8fadf65a8fa22a6c in this term.
I20260709 13:20:55.063802 24261 leader_election.cc:290] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:55.063488 24262 raft_consensus.cc:515] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.067106 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:55.067745 23936 raft_consensus.cc:3060] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:55.068573 23976 leader_election.cc:343] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.060246 24159 raft_consensus.cc:493] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.072242 24159 raft_consensus.cc:515] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.074590 24159 leader_election.cc:290] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:55.075479 23936 raft_consensus.cc:2468] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 1.
I20260709 13:20:55.075730 24252 leader_election.cc:290] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.076879 24262 leader_election.cc:290] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:55.077414 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdd85ada407242a086fda75dbeec4278" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:55.082522 24084 raft_consensus.cc:3060] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.084682 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:55.087067 24010 raft_consensus.cc:2468] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 1.
I20260709 13:20:55.087662 24230 tablet_bootstrap.cc:492] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b: No bootstrap required, opened a new log
I20260709 13:20:55.088227 24230 ts_tablet_manager.cc:1403] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b: Time spent bootstrapping tablet: real 0.198s	user 0.047s	sys 0.041s
I20260709 13:20:55.062312 23934 raft_consensus.cc:2468] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 0.
I20260709 13:20:55.081387 24048 leader_election.cc:304] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
W20260709 13:20:55.090317 24048 leader_election.cc:343] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.091054 24262 raft_consensus.cc:2804] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.091638 24262 raft_consensus.cc:697] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:55.090713 23974 leader_election.cc:304] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:55.092496 24230 raft_consensus.cc:359] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.093292 24232 tablet_bootstrap.cc:492] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: No bootstrap required, opened a new log
I20260709 13:20:55.093350 24230 raft_consensus.cc:385] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.093914 24230 raft_consensus.cc:740] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.093955 24232 ts_tablet_manager.cc:1403] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent bootstrapping tablet: real 0.121s	user 0.045s	sys 0.029s
I20260709 13:20:55.092504 24262 consensus_queue.cc:237] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.094732 24230 consensus_queue.cc:260] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.095569 24256 raft_consensus.cc:2804] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.096824 24256 raft_consensus.cc:493] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.097791 24256 raft_consensus.cc:3060] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.100466 24009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.101384 24009 raft_consensus.cc:3060] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.107044 24084 raft_consensus.cc:2468] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 1.
I20260709 13:20:55.098143 24230 ts_tablet_manager.cc:1434] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:20:55.097935 24010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0424e0a61d48768f8f5d154bb40a96" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.099841 24049 leader_election.cc:304] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.100019 24008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:55.110546 24008 raft_consensus.cc:2468] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 0.
I20260709 13:20:55.107131 24256 raft_consensus.cc:515] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.097563 24232 raft_consensus.cc:359] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.111871 24232 raft_consensus.cc:385] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.111171 24049 leader_election.cc:304] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c; no voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.111470 24009 raft_consensus.cc:2468] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 1.
I20260709 13:20:55.111853 24270 raft_consensus.cc:2804] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.113159 24159 raft_consensus.cc:2749] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:55.112879 24232 raft_consensus.cc:740] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.114113 23934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc3445285fe41f2b2e85f456d445e21" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:55.114343 24270 raft_consensus.cc:697] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:55.114197 24049 leader_election.cc:304] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.114805 23934 raft_consensus.cc:3060] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.115267 24261 raft_consensus.cc:2804] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.115604 24261 raft_consensus.cc:493] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.115942 24261 raft_consensus.cc:3060] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.115389 24270 consensus_queue.cc:237] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.117293 24232 consensus_queue.cc:260] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.120462 24232 ts_tablet_manager.cc:1434] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:20:55.122759 24261 raft_consensus.cc:515] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.124776 24261 leader_election.cc:290] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:55.125721 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
W20260709 13:20:55.127463 24048 leader_election.cc:343] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.127372 24009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.129171 24009 raft_consensus.cc:3060] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.131225 24256 leader_election.cc:290] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.132923 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfc3445285fe41f2b2e85f456d445e21" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:55.133069 23901 leader_election.cc:304] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:55.133854 24085 raft_consensus.cc:3060] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.134775 24240 raft_consensus.cc:2804] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.135493 24240 raft_consensus.cc:697] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:55.136214 24240 consensus_queue.cc:237] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.142376 24231 tablet_bootstrap.cc:492] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:55.142971 24231 ts_tablet_manager.cc:1403] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.013s
I20260709 13:20:55.146209 23934 raft_consensus.cc:2468] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:55.147732 23974 leader_election.cc:304] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:55.148921 24256 raft_consensus.cc:2804] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.150269 24256 raft_consensus.cc:697] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:55.151613 24256 consensus_queue.cc:237] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.154034 24085 raft_consensus.cc:2468] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 1.
I20260709 13:20:55.153824 23834 catalog_manager.cc:5697] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 1 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.155690 23830 catalog_manager.cc:5697] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 1 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.158775 24009 raft_consensus.cc:2468] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 1.
I20260709 13:20:55.159749 24257 raft_consensus.cc:493] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.160192 24049 leader_election.cc:304] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.160297 24257 raft_consensus.cc:515] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.161727 24270 raft_consensus.cc:2804] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.162281 24270 raft_consensus.cc:697] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:55.162649 24257 leader_election.cc:290] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.163118 24270 consensus_queue.cc:237] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.170336 23934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f682cda79e67414dba6535d6c8173e3c" is_pre_election: true
I20260709 13:20:55.174614 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:55.175487 24084 raft_consensus.cc:2393] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0fb1228ab664a3793904682a2ad6e3b in current term 1: Already voted for candidate f682cda79e67414dba6535d6c8173e3c in this term.
I20260709 13:20:55.176564 23976 leader_election.cc:304] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.177444 24256 raft_consensus.cc:3060] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.177309 23834 catalog_manager.cc:5697] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.179351 23834 catalog_manager.cc:5697] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 0 to 1, leader changed from <none> to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 1 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.180258 23831 catalog_manager.cc:5697] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 1 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.184860 24256 raft_consensus.cc:2749] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:55.176856 24231 raft_consensus.cc:359] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.185552 24231 raft_consensus.cc:385] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.185869 24231 raft_consensus.cc:740] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.186656 24231 consensus_queue.cc:260] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.189020 24231 ts_tablet_manager.cc:1434] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.003s
I20260709 13:20:55.190194 24231 tablet_bootstrap.cc:492] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: Bootstrap starting.
I20260709 13:20:55.192886 23830 catalog_manager.cc:5697] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 0 to 1, leader changed from <none> to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 1 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.195945 24231 tablet_bootstrap.cc:654] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.205662 24231 tablet_bootstrap.cc:492] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: No bootstrap required, opened a new log
I20260709 13:20:55.206101 24231 ts_tablet_manager.cc:1403] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:20:55.205935 23831 catalog_manager.cc:5697] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 1 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.208773 24231 raft_consensus.cc:359] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.209482 24231 raft_consensus.cc:385] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.209734 24231 raft_consensus.cc:740] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.210386 24231 consensus_queue.cc:260] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.213191 24231 ts_tablet_manager.cc:1434] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:55.277796 24252 consensus_queue.cc:1048] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.281829 24252 raft_consensus.cc:493] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.282377 24252 raft_consensus.cc:515] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.285722 24009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:55.285837 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:55.286502 24009 raft_consensus.cc:2393] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f682cda79e67414dba6535d6c8173e3c in current term 1: Already voted for candidate 0f98538eefa3478c8fadf65a8fa22a6c in this term.
I20260709 13:20:55.288065 23900 leader_election.cc:304] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:55.288365 24252 leader_election.cc:290] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.289736 24218 raft_consensus.cc:3060] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.293829 24239 consensus_queue.cc:1048] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:55.297832 24218 raft_consensus.cc:2749] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:55.330428 24084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352"
dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
mode: GRACEFUL
new_leader_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:57950
I20260709 13:20:55.330991 24084 raft_consensus.cc:606] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Received request to transfer leadership to TS f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.336870 24084 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e"
dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
mode: GRACEFUL
new_leader_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:57950
I20260709 13:20:55.337514 24084 raft_consensus.cc:606] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Received request to transfer leadership to TS f682cda79e67414dba6535d6c8173e3c
I20260709 13:20:55.338322 24218 consensus_queue.cc:1048] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.349855 24218 consensus_queue.cc:1048] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:55.353854 23936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
mode: GRACEFUL
new_leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:57320
I20260709 13:20:55.354528 23936 raft_consensus.cc:606] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Received request to transfer leadership to TS c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:55.362049 24085 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc"
dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
mode: GRACEFUL
new_leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:57950
I20260709 13:20:55.362705 24085 raft_consensus.cc:606] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Received request to transfer leadership to TS c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:55.364451 24218 raft_consensus.cc:493] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.365041 24218 raft_consensus.cc:515] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.368194 24218 leader_election.cc:290] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.369490 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" is_pre_election: true
I20260709 13:20:55.370110 24008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b" is_pre_election: true
I20260709 13:20:55.371078 24008 raft_consensus.cc:2393] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f682cda79e67414dba6535d6c8173e3c in current term 1: Already voted for candidate 0f98538eefa3478c8fadf65a8fa22a6c in this term.
I20260709 13:20:55.372087 23900 leader_election.cc:304] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f682cda79e67414dba6535d6c8173e3c; no voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:55.372897 24218 raft_consensus.cc:3060] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.377445 23936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de979a18e9df4780b76419497fe11336"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
mode: GRACEFUL
new_leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
 from {username='slave'} at 127.0.0.1:57320
I20260709 13:20:55.378085 23936 raft_consensus.cc:606] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Received request to transfer leadership to TS 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:55.380111 24218 raft_consensus.cc:2749] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:55.442479 24218 consensus_queue.cc:1048] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.449290 24239 raft_consensus.cc:993] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: : Instructing follower 0f98538eefa3478c8fadf65a8fa22a6c to start an election
I20260709 13:20:55.449764 24252 raft_consensus.cc:1081] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Signalling peer 0f98538eefa3478c8fadf65a8fa22a6c to start an election
I20260709 13:20:55.452790 24083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de979a18e9df4780b76419497fe11336"
dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
 from {username='slave'} at 127.0.0.1:57942
I20260709 13:20:55.453593 24083 raft_consensus.cc:493] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.454023 24083 raft_consensus.cc:3060] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.459615 24240 consensus_queue.cc:1048] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:55.463104 24083 raft_consensus.cc:515] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.466639 23936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de979a18e9df4780b76419497fe11336" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:55.467165 24083 leader_election.cc:290] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 2 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:55.467284 23936 raft_consensus.cc:3055] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:55.468554 23936 raft_consensus.cc:740] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:55.469004 24009 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de979a18e9df4780b76419497fe11336" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.469467 23936 consensus_queue.cc:260] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.470533 23936 raft_consensus.cc:3060] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.477674 23936 raft_consensus.cc:2468] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 2.
I20260709 13:20:55.478788 24048 leader_election.cc:304] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: c0fb1228ab664a3793904682a2ad6e3b
I20260709 13:20:55.479709 24262 raft_consensus.cc:2804] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:55.480232 24262 raft_consensus.cc:697] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:55.481153 24262 consensus_queue.cc:237] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.487802 23831 catalog_manager.cc:5697] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 1 to 2, leader changed from f682cda79e67414dba6535d6c8173e3c (127.14.41.65) to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 2 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.492326 24262 consensus_queue.cc:1048] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.499567 24270 raft_consensus.cc:993] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: : Instructing follower f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:55.500082 24159 raft_consensus.cc:1081] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Signalling peer f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:55.512352 23936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:57316
I20260709 13:20:55.512851 24159 consensus_queue.cc:1048] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.513077 23936 raft_consensus.cc:493] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.513851 23936 raft_consensus.cc:3060] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.520419 23936 raft_consensus.cc:515] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.523134 23936 leader_election.cc:290] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.523415 24008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.523806 24083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec56f77c89a84742a328ca4e3f9a0d9e" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:55.524266 24008 raft_consensus.cc:3060] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.524511 24083 raft_consensus.cc:3055] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:55.524942 24083 raft_consensus.cc:740] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:55.525673 24083 consensus_queue.cc:260] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.526911 24083 raft_consensus.cc:3060] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.530748 24008 raft_consensus.cc:2468] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:55.532095 23900 leader_election.cc:304] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:55.533002 24240 raft_consensus.cc:2804] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:55.533527 24240 raft_consensus.cc:697] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:55.533511 24083 raft_consensus.cc:2468] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:55.534504 24240 consensus_queue.cc:237] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.536739 24219 consensus_queue.cc:1048] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.544059 23830 catalog_manager.cc:5697] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 1 to 2, leader changed from 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67) to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 2 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.550029 24257 consensus_queue.cc:1048] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:55.557113 24261 consensus_queue.cc:1048] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.554400 24240 consensus_queue.cc:1048] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.562501 24257 consensus_queue.cc:1048] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.576231 24159 raft_consensus.cc:993] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: : Instructing follower f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:55.576804 24159 raft_consensus.cc:1081] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Signalling peer f682cda79e67414dba6535d6c8173e3c to start an election
I20260709 13:20:55.579784 23936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
 from {username='slave'} at 127.0.0.1:57316
I20260709 13:20:55.581104 23936 raft_consensus.cc:493] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.581650 23936 raft_consensus.cc:3060] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.584245 24159 consensus_queue.cc:1048] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:55.601877 24009 raft_consensus.cc:3060] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.603016 24219 consensus_queue.cc:1048] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:55.618244 23936 raft_consensus.cc:515] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.624095 23936 leader_election.cc:290] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Requested vote from peers c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.621515 24008 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:55.625890 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffdcfb8128a74f94b4daa69112696352" candidate_uuid: "f682cda79e67414dba6535d6c8173e3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:55.626221 24008 raft_consensus.cc:3060] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.626969 24084 raft_consensus.cc:3055] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:55.627455 24084 raft_consensus.cc:740] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:55.628526 24084 consensus_queue.cc:260] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.630163 24084 raft_consensus.cc:3060] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.630722 24239 consensus_queue.cc:1048] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:55.643898 24084 raft_consensus.cc:2468] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:55.643898 24008 raft_consensus.cc:2468] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f682cda79e67414dba6535d6c8173e3c in term 2.
I20260709 13:20:55.645555 23901 leader_election.cc:304] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:55.646729 24239 raft_consensus.cc:2804] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:55.647220 24239 raft_consensus.cc:697] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Becoming Leader. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:55.648100 24239 consensus_queue.cc:237] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.655280 23830 catalog_manager.cc:5697] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c reported cstate change: term changed from 1 to 2, leader changed from 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67) to f682cda79e67414dba6535d6c8173e3c (127.14.41.65). New cstate: current_term: 2 leader_uuid: "f682cda79e67414dba6535d6c8173e3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.673702 24159 consensus_queue.cc:1048] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.686369 24262 consensus_queue.cc:1048] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:55.696026 24159 raft_consensus.cc:993] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: : Instructing follower c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:55.696503 24262 raft_consensus.cc:1081] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Signalling peer c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:55.698171 24008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc"
dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:59646
I20260709 13:20:55.698725 24008 raft_consensus.cc:493] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.699066 24008 raft_consensus.cc:3060] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.705487 24008 raft_consensus.cc:515] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.707401 24008 leader_election.cc:290] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.708328 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:55.708777 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47d8a0aed387469bbb51d8a63b9b78bc" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:55.709100 23935 raft_consensus.cc:3060] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.709576 24084 raft_consensus.cc:3055] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:55.709970 24084 raft_consensus.cc:740] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:55.710870 24084 consensus_queue.cc:260] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.712406 24084 raft_consensus.cc:3060] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.717340 23935 raft_consensus.cc:2468] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:55.718442 23974 leader_election.cc:304] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0fb1228ab664a3793904682a2ad6e3b, f682cda79e67414dba6535d6c8173e3c; no voters: 
I20260709 13:20:55.719172 24256 raft_consensus.cc:2804] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:55.719741 24256 raft_consensus.cc:697] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:55.719655 24084 raft_consensus.cc:2468] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:55.721061 24256 consensus_queue.cc:237] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.728926 23834 catalog_manager.cc:5697] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 1 to 2, leader changed from 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67) to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 2 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.872375 24239 raft_consensus.cc:993] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: : Instructing follower c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:55.872916 24252 raft_consensus.cc:1081] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Signalling peer c0fb1228ab664a3793904682a2ad6e3b to start an election
I20260709 13:20:55.874579 24008 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88"
dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
 from {username='slave'} at 127.0.0.1:59644
I20260709 13:20:55.875133 24008 raft_consensus.cc:493] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:55.875432 24008 raft_consensus.cc:3060] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.880558 24008 raft_consensus.cc:515] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.882457 24008 leader_election.cc:290] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67:41699)
I20260709 13:20:55.883487 23935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:55.883817 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f027009e848c6a0b83c11fe589b88" candidate_uuid: "c0fb1228ab664a3793904682a2ad6e3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
I20260709 13:20:55.884223 23935 raft_consensus.cc:3055] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:55.884456 24084 raft_consensus.cc:3060] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.884644 23935 raft_consensus.cc:740] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:55.885453 23935 consensus_queue.cc:260] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.886385 23935 raft_consensus.cc:3060] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.890301 24084 raft_consensus.cc:2468] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:55.891134 23935 raft_consensus.cc:2468] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0fb1228ab664a3793904682a2ad6e3b in term 2.
I20260709 13:20:55.891724 23976 leader_election.cc:304] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: 
I20260709 13:20:55.892764 24256 raft_consensus.cc:2804] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:55.893234 24256 raft_consensus.cc:697] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Becoming Leader. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:55.893957 24256 consensus_queue.cc:237] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:55.901544 23834 catalog_manager.cc:5697] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b reported cstate change: term changed from 1 to 2, leader changed from f682cda79e67414dba6535d6c8173e3c (127.14.41.65) to c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66). New cstate: current_term: 2 leader_uuid: "c0fb1228ab664a3793904682a2ad6e3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.909662 23935 raft_consensus.cc:1275] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Refusing update from remote peer 0f98538eefa3478c8fadf65a8fa22a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:55.911142 24262 consensus_queue.cc:1048] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:55.919673 24008 raft_consensus.cc:3060] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:55.927373 24008 raft_consensus.cc:1275] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Refusing update from remote peer 0f98538eefa3478c8fadf65a8fa22a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:55.928680 24262 consensus_queue.cc:1048] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:55.946609 24008 raft_consensus.cc:1275] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:55.947845 24239 consensus_queue.cc:1048] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:55.955896 24084 raft_consensus.cc:1275] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:55.957237 24239 consensus_queue.cc:1048] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:56.035676 24084 raft_consensus.cc:1275] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:56.037314 24252 consensus_queue.cc:1048] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:56.046136 24008 raft_consensus.cc:1275] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Refusing update from remote peer f682cda79e67414dba6535d6c8173e3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:56.047858 24240 consensus_queue.cc:1048] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:56.160382 23935 raft_consensus.cc:1275] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:56.161849 24298 consensus_queue.cc:1048] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:56.169595 24084 raft_consensus.cc:1275] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:56.171258 24256 consensus_queue.cc:1048] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:56.503311 23935 raft_consensus.cc:1275] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:56.505107 24256 consensus_queue.cc:1048] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:56.514343 24084 raft_consensus.cc:1275] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Refusing update from remote peer c0fb1228ab664a3793904682a2ad6e3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:56.515950 24298 consensus_queue.cc:1048] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:58.381978 23831 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45308:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:58.406528 23831 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45308:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:58.492887 14501 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:20:58.727286 24347 log.cc:927] Time spent T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: Append to log took a long time: real 0.080s	user 0.004s	sys 0.000s
W20260709 13:20:58.728763 24338 log.cc:927] Time spent T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:20:58.752496 24340 log.cc:927] Time spent T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: Append to log took a long time: real 0.085s	user 0.004s	sys 0.000s
W20260709 13:20:58.754166 24341 log.cc:927] Time spent T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: Append to log took a long time: real 0.093s	user 0.004s	sys 0.000s
W20260709 13:20:58.846698 24346 log.cc:927] Time spent T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: Append to log took a long time: real 0.202s	user 0.006s	sys 0.011s
W20260709 13:20:58.849421 24349 log.cc:927] Time spent T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
W20260709 13:20:58.849526 24355 log.cc:927] Time spent T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:20:58.863580 24049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.66:42379, user_credentials={real_user=slave}} blocked reactor thread for 50680.7us
W20260709 13:20:58.874305 23976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.67:41699, user_credentials={real_user=slave}} blocked reactor thread for 47988.9us
W20260709 13:20:58.861855 23974 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:37045, user_credentials={real_user=slave}} blocked reactor thread for 59662.1us
W20260709 13:20:58.883358 24048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.41.65:37045, user_credentials={real_user=slave}} blocked reactor thread for 67524.2us
I20260709 13:20:58.864272 24364 tablet.cc:1724] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.881879 24368 tablet.cc:1724] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.947350 23933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc"
dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
mode: GRACEFUL
new_leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
 from {username='slave'} at 127.0.0.1:43920
I20260709 13:20:58.948225 23933 raft_consensus.cc:606] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Received request to transfer leadership to TS 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:58.965788 24376 tablet.cc:1724] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.965555 24375 tablet.cc:1724] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.971900 24371 tablet.cc:1724] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.974777 24373 tablet.cc:1724] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.963160 24377 tablet.cc:1724] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.985361 24380 tablet.cc:1724] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:58.987907 24374 tablet.cc:1724] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.000867 24372 tablet.cc:1724] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:59.002828 24366 log.cc:927] Time spent T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:20:59.019183 24378 tablet.cc:1724] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.015645 24368 tablet.cc:1724] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.031280 24377 tablet.cc:1724] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.043345 24364 tablet.cc:1724] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.049242 24376 tablet.cc:1724] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.054983 24373 tablet.cc:1724] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.062898 24007 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567"
dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
mode: GRACEFUL
new_leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
 from {username='slave'} at 127.0.0.1:38754
I20260709 13:20:59.063614 24007 raft_consensus.cc:606] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Received request to transfer leadership to TS 0f98538eefa3478c8fadf65a8fa22a6c
I20260709 13:20:59.065452 14501 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:59.066128 14501 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:59.065891 24381 tablet.cc:1724] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.066448 24378 tablet.cc:1724] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.056639 24372 tablet.cc:1724] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.093508 24380 tablet.cc:1724] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.097291 24371 tablet.cc:1724] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.097286 24377 tablet.cc:1724] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.101969 24381 tablet.cc:1724] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.105587 24374 tablet.cc:1724] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.130776 24219 raft_consensus.cc:993] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b: : Instructing follower 0f98538eefa3478c8fadf65a8fa22a6c to start an election
I20260709 13:20:59.130432 24368 tablet.cc:1724] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.131397 24219 raft_consensus.cc:1081] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Signalling peer 0f98538eefa3478c8fadf65a8fa22a6c to start an election
I20260709 13:20:59.133174 24364 tablet.cc:1724] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.133870 24083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567"
dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
 from {username='slave'} at 127.0.0.1:57930
I20260709 13:20:59.137253 24083 raft_consensus.cc:493] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.137701 24083 raft_consensus.cc:3060] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.140774 24376 tablet.cc:1724] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.150321 24083 raft_consensus.cc:515] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:59.170780 24083 leader_election.cc:290] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 2 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:59.171705 23933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:59.172675 23933 raft_consensus.cc:3060] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.172693 24007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d125ce1999404e9128c5cd6d4e6567" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:59.173557 24007 raft_consensus.cc:3055] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:59.173915 24007 raft_consensus.cc:740] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0fb1228ab664a3793904682a2ad6e3b, State: Running, Role: LEADER
I20260709 13:20:59.174952 24007 consensus_queue.cc:260] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:59.176173 24007 raft_consensus.cc:3060] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.186275 24007 raft_consensus.cc:2468] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 2.
I20260709 13:20:59.186275 23933 raft_consensus.cc:2468] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 2.
I20260709 13:20:59.187973 24049 leader_election.cc:304] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: 
I20260709 13:20:59.189098 24305 raft_consensus.cc:2804] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:59.189594 24305 raft_consensus.cc:697] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:59.190498 24305 consensus_queue.cc:237] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } }
I20260709 13:20:59.200318 23830 catalog_manager.cc:6242] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c: soft_deleted_table [id=0ec870f22bdb4322aa6c815d0e985560] alter complete (version 1)
I20260709 13:20:59.208590 23834 catalog_manager.cc:5697] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 1 to 2, leader changed from c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66) to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 2 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:59.241034 24240 raft_consensus.cc:993] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c: : Instructing follower 0f98538eefa3478c8fadf65a8fa22a6c to start an election
I20260709 13:20:59.241607 24325 raft_consensus.cc:1081] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Signalling peer 0f98538eefa3478c8fadf65a8fa22a6c to start an election
I20260709 13:20:59.243166 24083 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc"
dest_uuid: "0f98538eefa3478c8fadf65a8fa22a6c"
 from {username='slave'} at 127.0.0.1:57942
I20260709 13:20:59.243659 24083 raft_consensus.cc:493] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.244004 24083 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:59.249383 24083 raft_consensus.cc:515] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:59.251168 24083 leader_election.cc:290] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 3 election: Requested vote from peers f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045), c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379)
I20260709 13:20:59.252005 23933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f682cda79e67414dba6535d6c8173e3c"
I20260709 13:20:59.252321 24007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a92f85cccf484f8bbc169b23127704bc" candidate_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0fb1228ab664a3793904682a2ad6e3b"
I20260709 13:20:59.252635 23933 raft_consensus.cc:3055] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:59.252977 24007 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:59.253046 23933 raft_consensus.cc:740] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f682cda79e67414dba6535d6c8173e3c, State: Running, Role: LEADER
I20260709 13:20:59.254073 23933 consensus_queue.cc:260] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:59.255110 23933 raft_consensus.cc:3060] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:59.258412 24007 raft_consensus.cc:2468] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 3.
I20260709 13:20:59.259866 24049 leader_election.cc:304] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f98538eefa3478c8fadf65a8fa22a6c, c0fb1228ab664a3793904682a2ad6e3b; no voters: 
I20260709 13:20:59.260823 24305 raft_consensus.cc:2804] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:59.260849 23933 raft_consensus.cc:2468] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f98538eefa3478c8fadf65a8fa22a6c in term 3.
I20260709 13:20:59.261356 24305 raft_consensus.cc:697] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 3 LEADER]: Becoming Leader. State: Replica: 0f98538eefa3478c8fadf65a8fa22a6c, State: Running, Role: LEADER
I20260709 13:20:59.262491 24305 consensus_queue.cc:237] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } }
I20260709 13:20:59.271179 23834 catalog_manager.cc:5697] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c reported cstate change: term changed from 2 to 3, leader changed from f682cda79e67414dba6535d6c8173e3c (127.14.41.65) to 0f98538eefa3478c8fadf65a8fa22a6c (127.14.41.67). New cstate: current_term: 3 leader_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f98538eefa3478c8fadf65a8fa22a6c" member_type: VOTER last_known_addr { host: "127.14.41.67" port: 41699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:59.604290 23934 raft_consensus.cc:1275] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Refusing update from remote peer 0f98538eefa3478c8fadf65a8fa22a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.605710 24305 consensus_queue.cc:1048] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:59.618259 24007 raft_consensus.cc:1275] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Refusing update from remote peer 0f98538eefa3478c8fadf65a8fa22a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:59.620282 24305 consensus_queue.cc:1048] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:59.757513 24007 raft_consensus.cc:1275] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 3 FOLLOWER]: Refusing update from remote peer 0f98538eefa3478c8fadf65a8fa22a6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:59.758906 24389 consensus_queue.cc:1048] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0fb1228ab664a3793904682a2ad6e3b" member_type: VOTER last_known_addr { host: "127.14.41.66" port: 42379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:59.771797 23934 raft_consensus.cc:1275] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 3 FOLLOWER]: Refusing update from remote peer 0f98538eefa3478c8fadf65a8fa22a6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:59.773556 24305 consensus_queue.cc:1048] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f682cda79e67414dba6535d6c8173e3c" member_type: VOTER last_known_addr { host: "127.14.41.65" port: 37045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:00.125499 14501 tablet_server.cc:179] TabletServer@127.14.41.65:0 shutting down...
I20260709 13:21:00.167309 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:00.168182 14501 tablet_replica.cc:333] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.169023 14501 raft_consensus.cc:2243] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.169564 14501 raft_consensus.cc:2272] T 4b0424e0a61d48768f8f5d154bb40a96 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.172181 14501 tablet_replica.cc:333] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.172910 14501 raft_consensus.cc:2243] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.173691 14501 raft_consensus.cc:2272] T fdd85ada407242a086fda75dbeec4278 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.175863 14501 tablet_replica.cc:333] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.176496 14501 raft_consensus.cc:2243] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.177029 14501 raft_consensus.cc:2272] T de979a18e9df4780b76419497fe11336 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.179339 14501 tablet_replica.cc:333] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.180081 14501 raft_consensus.cc:2243] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.180908 14501 raft_consensus.cc:2272] T ffdcfb8128a74f94b4daa69112696352 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.183066 14501 tablet_replica.cc:333] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.183669 14501 raft_consensus.cc:2243] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.184425 14501 raft_consensus.cc:2272] T c6f662a792404411b7efedb2b98b3d63 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.186520 14501 tablet_replica.cc:333] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.187084 14501 raft_consensus.cc:2243] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.187582 14501 raft_consensus.cc:2272] T 0b1c6cfef73349e1ba035ad88c9d18ef P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.190699 14501 tablet_replica.cc:333] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.191526 14501 raft_consensus.cc:2243] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.192087 14501 raft_consensus.cc:2272] T 08fbf043863b4cf19206dafbd4e5a554 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.194350 24048 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
I20260709 13:21:00.195292 14501 tablet_replica.cc:333] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.196197 14501 raft_consensus.cc:2243] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.196877 14501 raft_consensus.cc:2272] T a3b3211255b24eb0acea79058b8afcd8 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.199203 24048 consensus_peers.cc:597] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c -> Peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Couldn't send request to peer f682cda79e67414dba6535d6c8173e3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.200525 14501 tablet_replica.cc:333] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.201340 14501 raft_consensus.cc:2243] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.201855 14501 raft_consensus.cc:2272] T e42c17102bdb427aab8aed53855f71bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.204320 14501 tablet_replica.cc:333] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.204960 14501 raft_consensus.cc:2243] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.205780 14501 raft_consensus.cc:2272] T ab7ffb484a02418f9c8e84a8363140e1 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.208048 14501 tablet_replica.cc:333] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.208702 14501 raft_consensus.cc:2243] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.209174 14501 raft_consensus.cc:2272] T 47d8a0aed387469bbb51d8a63b9b78bc P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.211287 14501 tablet_replica.cc:333] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.211836 14501 raft_consensus.cc:2243] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.212667 14501 raft_consensus.cc:2272] T c61b8cddbe78443b95f6709de681c2c4 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.215797 14501 tablet_replica.cc:333] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.216652 14501 raft_consensus.cc:2243] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.217212 14501 raft_consensus.cc:2272] T a92f85cccf484f8bbc169b23127704bc P f682cda79e67414dba6535d6c8173e3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.219816 14501 tablet_replica.cc:333] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.220326 14501 raft_consensus.cc:2243] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.220801 14501 raft_consensus.cc:2272] T cfc3445285fe41f2b2e85f456d445e21 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.222892 14501 tablet_replica.cc:333] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.223419 14501 raft_consensus.cc:2243] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.224203 14501 raft_consensus.cc:2272] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P f682cda79e67414dba6535d6c8173e3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.226473 14501 tablet_replica.cc:333] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.226986 14501 raft_consensus.cc:2243] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.227404 14501 raft_consensus.cc:2272] T a32f027009e848c6a0b83c11fe589b88 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.229354 14501 tablet_replica.cc:333] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.229830 14501 raft_consensus.cc:2243] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.230832 14501 raft_consensus.cc:2272] T ec56f77c89a84742a328ca4e3f9a0d9e P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.233597 14501 tablet_replica.cc:333] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c: stopping tablet replica
I20260709 13:21:00.234258 14501 raft_consensus.cc:2243] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.234797 14501 raft_consensus.cc:2272] T d2d125ce1999404e9128c5cd6d4e6567 P f682cda79e67414dba6535d6c8173e3c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.255688 24048 consensus_peers.cc:597] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c -> Peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Couldn't send request to peer f682cda79e67414dba6535d6c8173e3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.270948 14501 tablet_server.cc:196] TabletServer@127.14.41.65:0 shutdown complete.
I20260709 13:21:00.309572 14501 tablet_server.cc:179] TabletServer@127.14.41.66:0 shutting down...
I20260709 13:21:00.338901 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:00.339576 14501 tablet_replica.cc:333] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.340341 14501 raft_consensus.cc:2243] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.341226 14501 raft_consensus.cc:2272] T a32f027009e848c6a0b83c11fe589b88 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.343333 14501 tablet_replica.cc:333] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.343982 14501 raft_consensus.cc:2243] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.344923 14501 raft_consensus.cc:2272] T 4b0424e0a61d48768f8f5d154bb40a96 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.346983 14501 tablet_replica.cc:333] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.347632 14501 raft_consensus.cc:2243] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.348104 14501 raft_consensus.cc:2272] T fdd85ada407242a086fda75dbeec4278 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.350183 14501 tablet_replica.cc:333] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.350780 14501 raft_consensus.cc:2243] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.351240 14501 raft_consensus.cc:2272] T de979a18e9df4780b76419497fe11336 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.353446 14501 tablet_replica.cc:333] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.354143 14501 raft_consensus.cc:2243] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.354749 14501 raft_consensus.cc:2272] T c6f662a792404411b7efedb2b98b3d63 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.357489 14501 tablet_replica.cc:333] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.358266 14501 raft_consensus.cc:2243] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:21:00.358989 24048 consensus_peers.cc:597] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c -> Peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Couldn't send request to peer f682cda79e67414dba6535d6c8173e3c. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:37045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.359383 14501 raft_consensus.cc:2272] T 0b1c6cfef73349e1ba035ad88c9d18ef P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.361989 14501 tablet_replica.cc:333] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.362586 14501 raft_consensus.cc:2243] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.363035 14501 raft_consensus.cc:2272] T ffdcfb8128a74f94b4daa69112696352 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.365509 14501 tablet_replica.cc:333] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.366350 14501 raft_consensus.cc:2243] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.367636 14501 raft_consensus.cc:2272] T a3b3211255b24eb0acea79058b8afcd8 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.370743 14501 tablet_replica.cc:333] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.371518 14501 raft_consensus.cc:2243] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.372066 14501 raft_consensus.cc:2272] T 08fbf043863b4cf19206dafbd4e5a554 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:00.372116 23974 consensus_peers.cc:597] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b -> Peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Couldn't send request to peer f682cda79e67414dba6535d6c8173e3c. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:37045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.374619 14501 tablet_replica.cc:333] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.375239 14501 raft_consensus.cc:2243] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.375989 14501 raft_consensus.cc:2272] T cfc3445285fe41f2b2e85f456d445e21 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.378103 14501 tablet_replica.cc:333] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.378626 14501 raft_consensus.cc:2243] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.379060 14501 raft_consensus.cc:2272] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.381223 14501 tablet_replica.cc:333] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.381733 14501 raft_consensus.cc:2243] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.382122 14501 raft_consensus.cc:2272] T ec56f77c89a84742a328ca4e3f9a0d9e P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.384150 14501 tablet_replica.cc:333] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.384846 14501 raft_consensus.cc:2243] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.385290 14501 raft_consensus.cc:2272] T d2d125ce1999404e9128c5cd6d4e6567 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.388150 14501 tablet_replica.cc:333] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.388823 14501 raft_consensus.cc:2243] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.389631 14501 raft_consensus.cc:2272] T 47d8a0aed387469bbb51d8a63b9b78bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.391961 14501 tablet_replica.cc:333] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.392517 14501 raft_consensus.cc:2243] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.393059 14501 raft_consensus.cc:2272] T c61b8cddbe78443b95f6709de681c2c4 P c0fb1228ab664a3793904682a2ad6e3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.395690 14501 tablet_replica.cc:333] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.396286 14501 raft_consensus.cc:2243] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.396925 14501 raft_consensus.cc:2272] T a92f85cccf484f8bbc169b23127704bc P c0fb1228ab664a3793904682a2ad6e3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.399698 14501 tablet_replica.cc:333] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.400267 14501 raft_consensus.cc:2243] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.401219 14501 raft_consensus.cc:2272] T e42c17102bdb427aab8aed53855f71bc P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.403427 14501 tablet_replica.cc:333] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b: stopping tablet replica
I20260709 13:21:00.404137 14501 raft_consensus.cc:2243] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.404786 14501 raft_consensus.cc:2272] T ab7ffb484a02418f9c8e84a8363140e1 P c0fb1228ab664a3793904682a2ad6e3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.446482 14501 tablet_server.cc:196] TabletServer@127.14.41.66:0 shutdown complete.
W20260709 13:21:00.471891 24048 consensus_peers.cc:597] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c -> Peer f682cda79e67414dba6535d6c8173e3c (127.14.41.65:37045): Couldn't send request to peer f682cda79e67414dba6535d6c8173e3c. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.65:37045: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.483155 14501 tablet_server.cc:179] TabletServer@127.14.41.67:0 shutting down...
I20260709 13:21:00.509452 14501 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:21:00.509783 24049 consensus_peers.cc:597] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c -> Peer c0fb1228ab664a3793904682a2ad6e3b (127.14.41.66:42379): Couldn't send request to peer c0fb1228ab664a3793904682a2ad6e3b. Status: Network error: Client connection negotiation failed: client connection to 127.14.41.66:42379: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:00.510355 14501 tablet_replica.cc:333] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.511164 14501 raft_consensus.cc:2243] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.511655 14501 raft_consensus.cc:2272] T fdd85ada407242a086fda75dbeec4278 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.513764 14501 tablet_replica.cc:333] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.514371 14501 raft_consensus.cc:2243] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.515234 14501 raft_consensus.cc:2272] T de979a18e9df4780b76419497fe11336 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.517393 14501 tablet_replica.cc:333] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.517992 14501 raft_consensus.cc:2243] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.518456 14501 raft_consensus.cc:2272] T 4b0424e0a61d48768f8f5d154bb40a96 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.520452 14501 tablet_replica.cc:333] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.521060 14501 raft_consensus.cc:2243] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.521834 14501 raft_consensus.cc:2272] T a92f85cccf484f8bbc169b23127704bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.524709 14501 tablet_replica.cc:333] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.525282 14501 raft_consensus.cc:2243] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.525710 14501 raft_consensus.cc:2272] T 47d8a0aed387469bbb51d8a63b9b78bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.527602 14501 tablet_replica.cc:333] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.528102 14501 raft_consensus.cc:2243] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.528509 14501 raft_consensus.cc:2272] T c61b8cddbe78443b95f6709de681c2c4 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.530596 14501 tablet_replica.cc:333] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.531095 14501 raft_consensus.cc:2243] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.531498 14501 raft_consensus.cc:2272] T a32f027009e848c6a0b83c11fe589b88 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.533459 14501 tablet_replica.cc:333] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.533970 14501 raft_consensus.cc:2243] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.534373 14501 raft_consensus.cc:2272] T ec56f77c89a84742a328ca4e3f9a0d9e P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.536324 14501 tablet_replica.cc:333] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.536942 14501 raft_consensus.cc:2243] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.537745 14501 raft_consensus.cc:2272] T d2d125ce1999404e9128c5cd6d4e6567 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.540345 14501 tablet_replica.cc:333] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.540984 14501 raft_consensus.cc:2243] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.541574 14501 raft_consensus.cc:2272] T ffdcfb8128a74f94b4daa69112696352 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.543571 14501 tablet_replica.cc:333] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.544054 14501 raft_consensus.cc:2243] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.544451 14501 raft_consensus.cc:2272] T 0b1c6cfef73349e1ba035ad88c9d18ef P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.546470 14501 tablet_replica.cc:333] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.546952 14501 raft_consensus.cc:2243] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.547341 14501 raft_consensus.cc:2272] T c6f662a792404411b7efedb2b98b3d63 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.549224 14501 tablet_replica.cc:333] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.549692 14501 raft_consensus.cc:2243] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.550093 14501 raft_consensus.cc:2272] T cfc3445285fe41f2b2e85f456d445e21 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.552000 14501 tablet_replica.cc:333] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.552487 14501 raft_consensus.cc:2243] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.552981 14501 raft_consensus.cc:2272] T 9d1e33c13f8d4ea4b3f76339cc4543b3 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.554957 14501 tablet_replica.cc:333] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.555423 14501 raft_consensus.cc:2243] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.556154 14501 raft_consensus.cc:2272] T 08fbf043863b4cf19206dafbd4e5a554 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.558368 14501 tablet_replica.cc:333] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.558801 14501 raft_consensus.cc:2243] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.559165 14501 raft_consensus.cc:2272] T a3b3211255b24eb0acea79058b8afcd8 P 0f98538eefa3478c8fadf65a8fa22a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.561165 14501 tablet_replica.cc:333] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.561784 14501 raft_consensus.cc:2243] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.562240 14501 raft_consensus.cc:2272] T e42c17102bdb427aab8aed53855f71bc P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.564491 14501 tablet_replica.cc:333] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c: stopping tablet replica
I20260709 13:21:00.564975 14501 raft_consensus.cc:2243] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:00.565383 14501 raft_consensus.cc:2272] T ab7ffb484a02418f9c8e84a8363140e1 P 0f98538eefa3478c8fadf65a8fa22a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.605101 14501 tablet_server.cc:196] TabletServer@127.14.41.67:0 shutdown complete.
I20260709 13:21:00.638163 14501 master.cc:562] Master@127.14.41.126:37585 shutting down...
I20260709 13:21:00.660414 14501 raft_consensus.cc:2243] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:00.661089 14501 raft_consensus.cc:2272] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:00.661393 14501 tablet_replica.cc:333] T 00000000000000000000000000000000 P cd1535c6cc52418eb102d9fab190d46c: stopping tablet replica
I20260709 13:21:00.681775 14501 master.cc:584] Master@127.14.41.126:37585 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11663 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24447 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (281261 ms total)
[  PASSED  ] 8 tests.
I20260709 13:21:00.735037 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 399 messages since previous log ~14 seconds ago
I20260709 13:21:00.735306 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 399 messages since previous log ~14 seconds ago
I20260709 13:21:00.735476 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 396 messages since previous log ~14 seconds ago
I20260709 13:21:00.735714 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:21:00.735911 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:21:00.736104 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~148 seconds ago
I20260709 13:21:00.736414 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 5 messages since previous log ~0 seconds ago
I20260709 13:21:00.736744 14501 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
